GCP AI Cost Optimization: Vertex AI Model Selection Guide

How to Choose the Right AI Model on GCP Without Blowing Your Budget in 2025. In this FinOps Weekly episode, we sit down with Bar to break down how to select the best AI model on Google Cloud’s Vertex AI (now Agent Platform), balancing pricing, performance, and business use cases.

Timestamps

00:00 – Intro to FinOps Weekly & Today’s Topic
01:20 – Why AI Cost Management Matters Now
03:20 – AI Availability: Everyone Touches It (Unlike Cloud)
05:20 – Beyond Price: Key Factors in Model Selection
07:00 – Target Audience & Use Case Considerations
09:20 – What is Vertex AI (Now Agent Platform)?
10:50 – Exploring Model Garden & Industry Filters
13:20 – Evaluation Phase: Staging Your Models
15:00 – Newest Model vs Cheapest Model Myth
17:00 – Case Study: Pricier Models Can Cost Less
19:20 – Tokens Aren’t Universal: Image/Video/Audio Pricing
20:40 – Input vs Output Token Pricing Ratios
22:20 – The Caching Challenge in LLMs
24:00 – Best Use Cases for Caching
25:40 – Data Privacy & Fine-Tuning for Sensitive Data
28:20 – Risks of Fine-Tuning & Checkpoints
30:20 – RAG as an Alternative to Fine-Tuning
36:40 – Wrap-Up & Closing Thoughts