Dirty White Coat
Dirty White Coat
Mel Herbert for FoolyBoo Inc
The Dangers and Delights of AI search and "The Pitt"
29 minutes Posted Mar 31, 2025 at 1:00 pm.
Introduction and The Pit Series Update
AI Search in Corpendium Overview
LLM Limitations and Challenges
Technical Explanation of RAG
Citation and Reference Systems
AI vs. Traditional Search Methods
Safety Concerns and Beta Release
Multiple Platform Search Challenges
User Feedback and Final Thoughts
0:00
29:12
Download MP3
Show notes

Send us a text

We're exploring the integration of AI search within Corpendium and discussing the delicate balance between powerful search capabilities and maintaining medical accuracy. Our team dives deep into the technical challenges and ethical considerations of implementing AI in a trusted medical reference platform.

• AI search struggles with staying confined to just Corpendium's content despite explicit instructions
• RAG (Retrieval Augmented Generation) allows AI to search internal databases while maintaining natural language understanding
• The tension between sensitivity and specificity mirrors clinical decision-making in emergency medicine
• Vector space embeddings help AI understand semantic relationships between medical terms beyond simple keyword matching
• Citations and references are crucial for verifying AI-generated information against human-authored content
• Traditional search still has value, especially in offline modes where large language models aren't available
• Expert human judgment remains essential as AI can make dangerous mistakes despite sounding authoritative
• Editorial teams benefit from AI by automating formatting tasks while focusing human expertise on clinical content
• The system will launch in beta with user feedback mechanisms to continuously improve accuracy
• AI is most valuable as a tool for experts rather than a replacement for medical education and training

AI doesn't replace the learning that medical professionals go through. It's exceptionally helpful in the hands of experts, but always scrutinize what it tells you.


Support the show