Weaviate Podcast
Weaviate Podcast
Weaviate
Ofir Press on AliBi and Self-Ask - Weaviate Podcast #65!
1 hour 7 minutes Posted Aug 31, 2023 at 8:01 am.
Welcome Ofir Press
Large Context LLMs
Quadratic Complexity of Attention
AliBi Attention, Visual Demo!
Recency Bias in LLMs
RAG in Long Context LLM Training
Self-Ask Prompting
Chain-of-Thought and Self-Ask
Gorilla LLMs
New Directions for New Training Data
0:00
1:07:11
Download MP3
Show notes
Hey everyone! Thank you so much for watching the Weaviate Podcast! I am SUPER excited to publish my conversation with Ofir Press! Ofir has done incredible work pioneering AliBi attention and Self-Ask prompting and I learned so much from speaking with him! As always we are more than happy to answer any questions or discuss any ideas you have about the content in the podcast!
+Huge Congratulations on your Ph.D. Ofir!
AliBi Attention: https://arxiv.org/abs/2108.12409
Self-Ask Prompting: https://arxiv.org/abs/2210.03350
Ofir Pres on YouTube: https://www.youtube.com/@ofirpress
Chapters