Benny Chen is the cofounder of Fireworks AI, an AI infrastructure platform. They have raised $327M in funding from Benchmark, Sequoia, Lightspeed, Index, and others.   Benny's favorite book: Principles (Author: Ray Dalio)  (00:01) Intro and why AI infrastructure is having a moment (00:06) Training vs inference: what’s working and where the real bottlenecks are (01:25) Why inference is the hard problem in production (03:30) What breaks at scale when AI systems hit real users (05:29) GPUs,...

Benny Chen is the cofounder of Fireworks AI, an AI infrastructure platform. They have raised $327M in funding from Benchmark, Sequoia, Lightspeed, Index, and others.   Benny's favorite book: Principles (Author: Ray Dalio)

Intro and why AI infrastructure is having a moment

Training vs inference: what’s working and where the real bottlenecks are

Why inference is the hard problem in production

What breaks at scale when AI systems hit real users

The best place to find out how AI builders build. The host Prateek Joshi interviews world-class AI founders and VCs on this podcast. You can visit prateekj.com to learn more about the host.