The Circuit
The Circuit
Ben Bajarin and Jay Goldberg
Episode 60: Takeaways, observations, and insights from Nvidia GTC
45 minutes Posted Mar 25, 2024 at 2:00 am.
and Key Takeaways
Dominance in the Data Center
Full Stack Approach
Sum of the Parts Story
Optionality and the Walled Garden Debate
Importance of Inference and Generative AI
Need for More Compute Power
Topics: Silicon Monopoly, Robotics, and 6G
and Software Defined 6G
Potential of Robotics and 6G
Complexity of 6G and the Role of Ray Tracing
in Implementing 6G
Potential of Software Defined Networking
Controls and NIMS
Future of Software at NVIDIA
Uncertainty of NVIDIA's Software Revenue
Importance of NIMS and Software Differentiation
Future of AI Software
Computing S-Curve and Performance Gains
Longevity of Performance Gains
for the Future of AI
0:00
45:19
Download MP3
Show notes

Nvidia's recent keynote highlighted their dominance in the data center and their position as a platform company. They offer a full stack solution and are recognized for their sum of the parts story. While some customers may be concerned about getting locked into Nvidia's ecosystem, many appreciate the simplicity and turnkey nature of their offerings. The importance of inference and the transition to generative AI was also discussed, highlighting the complexity of scaling and the need for compute power. However, there may be room for competition in the inference market, particularly in relation to Nvidia's NVLink technology. The conversation covers various topics related to NVIDIA's keynote, including the need for more compute power, the potential of robotics and 6G, the challenges of implementing 6G, the future of software at NVIDIA, and the uncertainty of NVIDIA's software revenue. The conversation also touches on the future of AI software, the computing S-curve, and the longevity of performance gains. Overall, the conversation highlights the excitement and optimism surrounding NVIDIA's advancements in AI and computing.