Episode 123I spoke with Suhail Doshi about:* Why benchmarks aren’t prepared for tomorrow’s AI models* How he thinks about artists in a world with advanced AI tools* Building a unified computer vision model that can generate, edit, and understand pixels. Suhail is a software engineer and entrepreneur known for founding Mixpanel, Mighty Computing, and Playground AI (they’re hiring!).Reach me at [email protected] for feedback, ideas, guest suggestions. Subscribe to The Gradient Podcast:  Apple Podcasts  | Spotify | Pocket Casts | RSSFollow The Gradient on TwitterOutline:*

Intro*

Ad read — MLOps conference*

Suhail is *not* in pivot hell but he *is* all-in on 50% AI-generated music*

AI and music, similarities to Playground*

Skill vs. creative capacity in art*

What we look for in music and art*

Enabling creative expression*

Building a unified computer vision model, underinvestment in computer vision*

Enhancing the aesthetic quality of images: color and contrast, benchmarks vs user desires*

“Benchmarks are not prepared for how powerful these models will become”*

Personalized models and personalized benchmarks*

Engaging users and benchmark development*

What a foundation model for graphics requires*

Text-to-image is insufficient*

DALL-E 2 and Imagen comparisons, FID*

Compositionality*

Why Playground focuses on images vs. 3d, video, etc.*

Open source and Playground’s strategy*

When to stop open-sourcing?*

Suhail’s thoughts on AGI discourse*