No Priors: Artificial Intelligence | Technology | Startups
No Priors: Artificial Intelligence | Technology | Startups
Conviction
Baseten CEO Tuhin Srivastava on the AI Inference Crunch, Custom Models, and Building the Inference Cloud
42 minutes Posted May 1, 2026 at 7:34 pm.
Baseten growth
Why the app layer wins
Serving frontier customers
Open source model mix
Chinese models and geopolitics
Custom inference dominates
Post training acquisition
When to invest in custom models
Supply crunch and data centerse
Longer GPU Contracts
What Makes a Winner
Multi Chip Future
Runtime Roadmap
Scaling Edge Cases
Hiring and Leadership
Operations Pager Culture
Efficiency Drives Demand
Concierge Everything Future
Conclusion
0:00
42:57
Download MP3
Show notes
Baseten CEO and co-founder Tuhin Srivastava sits down with Sarah Guo and Elad Gil to discuss the rapid growth of AI inference demand, Baseten’s 30x growth, and why inference is becoming the strategic “last market.” Tuhin Srivastava argues the application layer will persist because companies with unique user signals can encode value into workflows and post-train specialized models, citing examples like Abridge and support workflows. The conversation covers GPU capacity constraints, Baseten’s multi-cloud fabric across 18 clouds and 90 clusters, long-term contracting dynamics, the importance of the software layer for stickiness, evolving workloads, multichip possibilities, and operational lessons at scale.
Sign up for new podcasts every week. Email feedback to [email protected]
Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @Tuhinone
 
Chapters: