Show notes
Join us as Du'An digs into the real mechanics of running AI locally and in production - from GPU memory math to multi-agent architectures, observability, and the economics of self-hosted inference.Du'An walks through how model weights and KV cache compete for GPU memory, why continuous batching matters when you have more than a handful of users, and how agent architectures like single-agent, workflow, graph, swarm, and supervisor patterns each solve different problems. You will learn how to instrument your agents with Langfuse for observability and cost tracking, when to use Ollama versus vLLM, how prompt caching can cut provider costs by up to 75%, and why GPUs should never sit idle. Episode two of three - the next episode covers deploying at scale.TimestampsHow to find Du'An:https://duanlightfoot.comhttps://www.linkedin.com/in/duanlightfoot/Links from the show:https://langfuse.com/https://github.com/akamai-developers/akamai-workshop-solution-architect-agenthttps://amzn.to/4bvHn1phttps://vllm.ai/



