Show notes
OpenAI has released their newest model, GPT-4o mini, which is more cost-efficient and excels in mathematical reasoning and coding tasks.NVIDIA's Mistral NeMo 12B is a state-of-the-art language model with unprecedented accuracy and enterprise-grade support.A new speech recognition keyboard and service for Android called Transcribro has been developed, which is private and on-device.Research papers explore the impact of vocabulary size on language model scaling, the use of large datastores for retrieval-based language models, and a method for generating long sequences of views of a cityscape using AI and computer vision.Contact: [email protected]Timestamps:01:40 OpenAI Announces GPT 4o mini03:11 Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model05:28 Transcribro: Private and on-device speech recognition keyboard and service for Android08:49 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies10:19 Scaling Retrieval-Based Language Models with a Trillion-Token Datastore11:49 Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusion

