Last Week in AI
Last Week in AI
Skynet Today
AI Computing Hardware - Past, Present, and Future
2 hour 4 minutes Posted Jan 29, 2025 at 8:02 am.
Introduction
Historical Recap: Early AI and Hardware
The Rise of GPUs and Deep Learning
Scaling Laws and the Evolution of AI Models
The Bitter Lesson and the Future of AI Compute
Moore's Law and Huang's Law
Memory and Logic in AI Hardware
Challenges in AI Hardware: The Memory Wall
The Role of GPUs in Modern AI
Fitting Neural Nets in GPUs
Batch Sizes and GPU Utilization
Parallelism in AI Models
Matrix Multiplications and GPUs
Understanding B200 and GB200
Data Center Hierarchy
High Bandwidth Memory (HBM)
Fabrication and Packaging
The Complexity of Semiconductor Fabrication
Understanding Process Nodes
The Art of Fabrication
The Role of Yield in Fabrication
The Photolithography Process
Deep Ultraviolet Lithography (DUV)
Extreme Ultraviolet Lithography (EUV)
Export Controls and Their Impact
The Rise of Custom AI Hardware
The Future of AI and Hardware
0:00
2:04:24
Download MP3
Show notes
A special one-off episode with a deep dive into the past, present, and future of how computer hardware makes AI possible.
Join our brand new Discord here! https://discord.gg/nTyezGSKwP
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/.
Sponsors:
The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence.
In this episode:
 - Google and Mistral sign deals with AP and AFP, respectively, to deliver up-to-date news through their AI platforms.
 - ChatGPT introduces a tasks feature for reminders and to-dos, positioning itself more as a personal assistant.
 - Synthesia raises $180 million to enhance its AI video platform for generating videos of human avatars.
 - New U.S. guidelines restrict exporting AI chips to various countries, impacting Nvidia and other tech firms.
If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form.
Timestamps:
See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.