Domain 2 of 6 · Chapter 4 of 5

Vertex AI ML Workflows

Unlock the complete study guide + 1,040 practice questions across 16 full exams.

Bundled into the existing Professional Cloud Architect premium course — no separate purchase.

Included in this chapter:

  • The Vertex AI lifecycle: which piece serves which stage
  • Vertex AI Pipelines: automating and auditing the lifecycle
  • Training at scale: accelerators and consumption models
  • Serving and data prep: endpoints, batch, and Feature Store

Accelerator consumption models for Vertex AI training and serving

Consumption modelCapacity assuranceMax durationBest for
On-demandBest-effort, no commitmentUnlimitedUnpredictable or short jobs where you accept the full rate
Committed use / reservationVery high (guaranteed)Unlimited (1+ year commit)Steady, always-on large training or serving; up to 53% off
Calendar mode (DWS)Very high (guaranteed)Up to 90 daysPlanned short runs needing dense, guaranteed capacity
Flex-start (DWS)Best-effortUp to 7 daysShort fine-tuning or batch jobs that tolerate a provisioning wait
Spot VMsBest-effort, preemptibleUnlimited (until preempted)Fault-tolerant batch and HPC; up to 91% off, not for must-stay-up serving

Decision tree

Matrix-bound, weeks-long,no custom ops?Train on TPUsTrain on GPUscustom ops / flexibilityYesNoSteady, must-stay-up,guaranteed capacity?then pick how you payReservation / CUDup to 53% off, assuredYes, steadyTolerates preemptionat any time?No, short / flexibleDWS Flex-start / Calendarshort runs, best-effortSpot VMsup to 91% off, preemptibleNoYes

Cheat sheet

  • Vertex AI is the unified platform for the whole custom-ML lifecycle
  • Use Vertex AI Pipelines to automate, reproduce, and audit the ML lifecycle
  • Vertex AI Pipelines tracks artifact lineage in Vertex ML Metadata
  • Pipeline execution caching skips steps whose inputs have not changed
  • Pick TPUs for matrix-bound, weeks-long training with no custom ops
  • Pick GPUs when the model needs custom ops or framework flexibility
  • AI Hypercomputer is an integrated stack, not a single product
  • Commit to reservations or CUDs for steady large training at guaranteed capacity
  • Use Dynamic Workload Scheduler for short accelerator runs that tolerate a wait
  • Run interruption-tolerant training on Spot for the deepest discount
  • Choose online Endpoints when a caller waits on each prediction
  • Choose batch prediction for bulk scoring with no waiting caller
  • Centralize features in Vertex AI Feature Store to share and avoid skew
  • Managed datasets centralize training data and apply consistent splits
  • AutoML trains a custom model with minimal code; custom training gives full control
  • Register a trained model in the Model Registry before deploying it
  • Distributed training scales a job across multiple workers with accelerators
  • Use BigQuery ML for SQL-shaped modelling, not a separate Vertex training stack
  • Grant the Notebooks Service Agent (not the user) compute.networkUser on the host project for Workbench in a Shared VPC
  • Cross-project custom training images need Artifact Registry Reader on the Vertex AI Service Agent
  • Custom containers report hyperparameter-tuning metrics with the cloudml-hypertune library
  • Build GPU custom training containers on the nvidia/cuda base image

Unlock with Premium — includes all practice exams and the complete study guide.

Also tested in

References

  1. Introduction to Vertex AI (unified platform)
  2. Vertex AI training overview
  3. Introduction to Vertex AI Pipelines
  4. Introduction to Cloud TPU
  5. AI Hypercomputer overview
  6. AI Hypercomputer consumption models
  7. Vertex AI predictions overview (online vs batch)
  8. Vertex AI Feature Store overview
  9. Using managed datasets for Vertex AI training