vBrownBag
vBrownBag
vBrownBag
Troubleshooting AWS Hallucinations from Vector Store DBs
48 minutes Posted Mar 5, 2026 at 6:08 pm.
Cold Open
Welcome & Introduction
Amelia's Background & DeepRacer Trophy
The JIRA Ticket Use Case Origin Story
Getting Into the Presentation
Accessing & Cleaning Data Sets
Losing Production Data & Recreating with ChatGPT
Understanding Vector Databases
How Embeddings Work
The Hallucination Discovery
Testing Strategies for Vector Stores
Debugging Vector Similarity Search
Real-World Troubleshooting Workflows
Where to Find Amelia & Wrap-up
0:00
48:04
Download MP3
Show notes
Join us as Amelia shares the debugging story nobody tells you about - how her vector store DB couldn't surface specific data until she tested it with simplified data from ChatGPT.
Amelia walks through her journey from throwing JIRA tickets into a large language model without understanding pipelines or data cleaning, to discovering why her production vector store was failing. You'll learn about the gap between chatting with data and getting accurate connections, how to validate vector similarity search results, the difference between production and synthetic test data, and practical troubleshooting workflows for AWS vector stores. This episode reveals the messy reality of RAG systems - when everything seems fine but the outputs are subtly wrong, and how testing with simplified data can expose what production complexity hides.
Timestamps
How to find Amelia:
https://www.linkedin.com/in/ameliahoughross/