Weaviate Podcast
Weaviate Podcast
Weaviate
Weights and Biases on Fine-Tuning LLMs - Weaviate Podcast #68!
52 minutes Posted Sep 20, 2023 at 1:00 pm.
Tiny Llamas!
Welcome!
LLM Fine-Tuning
Tooling for Fine-Tuning
Why Fine-Tune?
RAG vs. Fine-Tuning
Knowledge Distillation
Gorilla LLMs
Open-Source LLMs
Jonathan Frankle on W&B
Data Quality for LLM Training
W&B for Data Versioning
Curriculum Learning
GPU Rich and Data Quality
Vector DBs and Data Quality
Tuning Training with Weights & Biases
Training Reports
HF Collections and W&B Sweeps
Exciting Directions for AI
0:00
52:09
Download MP3
Show notes
Hey everyone! Thank you so much for watching the 68th episode of the Weaviate Podcast! We are super excited to welcome Morgan McGuire, Darek Kleczek, and Thomas Capelle! This was such a fun discussion beginning with generally how see the space of fine-tuning from why you would want to do it, to the available tooling, intersection with RAG and more!
Check out W&B Prompts! https://wandb.ai/site/prompts
Check out the W&B Tiny Llama Report! https://wandb.ai/capecape/llamac/reports/Training-Tiny-Llamas-for-Fun-and-Science--Vmlldzo1MDM2MDg0
Chapters