Risks, Rewards, and Building the Unicorn Chip Company Taking on Nvidia | Inside Groq with Jonathan Ross from The Eric Ries Show

The Eric Ries Show

Eric Ries

Episodes

About

Reviews

Promote

Risks, Rewards, and Building the Unicorn Chip Company Taking on Nvidia | Inside Groq with Jonathan Ross

1 hour 15 minutes Posted Nov 7, 2024 at 1:00 pm.

) Jonathan’s involvement with the DeepMind Challenge Match between AlphaGo and Lee Sedol

) How Jonathan’s work Google and how it led him to that moment

) Why generative AI isn’t just the next internet or mobile

) The divine move in the DeepMind Challenge Match

) How Jonathan ended up designing chips without the usual background

) GPUs vs. TPUs

) What risk really is

) Groq’s mind-blowing AI demo

) How Jonathan decided to leave Google and start Groq

) The differences between doing an innovation project at a company and starting a new company

) Nassim Taleb’s Black Swan theory

) Groq’s founding story

) The difference in attitude towards AI now compared to 2016 and how it affected Groq

) The moment the tide turned with LLMs

) The week-over-week jump from 8,000 users to 400,000 users

) How Groq used HBM and what is it (the memory used by GPUs)

) Jonathan’s approach to disruption

) Groq’s initial raise and focus on software

) How struggling to survive made Groq stronger

) Hiring for return on luck

) How Jonathan and Groq think about the long-term

) Founder control issues

) How Groq thinks about maintaining its mission and trustworthiness

) Jonathan’s vision for a capital market that would support companies like Groq

) How Groq manages internal cultural alignment

) Groq’s mission and to preserve human agency in the age of AI how it approaches achieving it

) Lightning round

0:00

1:15:13

Download MP3

Share at current time

Show notes

The story of Groq, a semiconductor startup that makes chips for AI inference and was recently valued at $2.8 billion, is a classic “overnight success that was years in the making” tale. On this episode, I talk with founder and CEO Jonathan Ross.

He began the work that eventually led to Groq as an engineer at Google, where he was a member of the rapid eval team – “the team that comes up with all the crazy ideas at Google X.” For him, the risk involved in leaving to launch Groq in 2016 was far less than the risk of staying in-house and watching the project die.

Groq has had many “near-death” experiences in its eight years of existence, all of which Jonathan believes have ultimately put it in a much stronger position to achieve its mission: preserving human agency in the age of AI.

Groq is committed to giving everyone access to relatively low-cost generative AI compute, driving the price down even as they continue to increase speed. We talked about how the company culture supports that mission, what it feels like to now be on the same playing field as companies like Nvidia, and Jonathan’s belief that true disruption isn’t just doing things other people can’t do or don’t want to do, but doing things other people don’t believe can be done – even when you show them evidence to the contrary.