In this episode I break down what NVIDIA is, why its GPUs (hint: these are the “chips” you hear so much about) became the backbone of the modern AI boom, and how CUDA locked in its dominance. The conversation moves from gaming history to trillion-dollar valuations and data centers stacked with H100s, offering a clear picture of why nearly every major AI system runs on NVIDIA hardware.

Main Topics Covered

• What NVIDIA is
• NVIDIA’s role in the AI economy
• Founding story and naming
• Early GPUs and the GeForce 256 
• Researchers linking GPU math to AI math
• CUDA and the 2012 AlexNet breakthrough
• NVIDIA vs Google TPUs
• H100 chips and DGX Systems
• CUDA lock-In and why NVIDIA likely won’t be dethroned
• Recent ChatGPT use: Chris McCausland using AI to describe images

Links & Resources for This Episode

• YouTube Video: Quick Tour of NVIDIA DGX H100
• YouTube Video: Inside the Modern Data Center! SuperClusters at Applied Digital
• Watch Chris’ Reel
• Read this episode's Curious Companion
• Subscribe to the Prompting Curiosity Newsletter
• Submit a Question
• Visit the Website
• Feeling curious AND generous? Click here to support the podcast.