Data Science at Home
Data Science at Home
Francesco Gadaleta
From Tokens to Vectors: The Efficiency Hack That Could Save AI (Ep. 294)
46 minutes Posted Nov 11, 2025 at 8:58 am.
0:00
46:54
Download MP3
Show notes
LLMs generate text painfully slow, one low-info token at a time. Researchers just figured out how to compress 4 tokens into smart vectors & cut costs by 44%—with full code & proofs! Meanwhile OpenAI drops product ads, not papers. We explore CALM & why open science matters. 🔥📊
 
Sponsors
This episode is brought to you by Statistical Horizons At Statistical Horizons, you can stay ahead with expert-led livestream seminars that make data analytics and AI methods practical and accessible.Join thousands of researchers and professionals who’ve advanced their careers with Statistical Horizons.Get $200 off any seminar with code DATA25 at https://statisticalhorizons.com