Large Language Models in Production Round-table Conversation from Agentic Conversations (formally mlops.community)

Large Language Models in Production Round-table Conversation

57 minutes Posted Mar 23, 2023 at 12:00 pm.

] Round table success to Virtual LLM in Production Conference on April 13th!

] Register for the Virtual LLM in Production Conference now!

] LLM in Production survey

] Lightning round of introduction of speakers

] Large Language Models definition

] What do we consider large?

] Thought process in use cases production

] LLM open source huge movements

] Problems qualifications

] Production use cases frameworks directions

] Open-source language models tokenizer

] Language models democratization

] Three categories for LLMs in Production

] Latency at 2 levels

] Defining production

] Hitting the latency problems

] Fundamental latency barrier

] Latency use case requirement

] Costs and the use cases

] Product management involvement in costing

] LLMs Hallucination definition

] Building deterministic systems trust

] Wrap up

0:00

57:47

Download MP3

Share at current time

Show notes

LLM in Production Round Table with Demetrios Brinkmann, Diego Oppenheimer, David Hershey, Hannes Hapke, James Richards, and Rebecca Qian.

// Abstract

Using LLM in production. That's right. Hype or here to stay? The conversation answers some of the questions that have been asked by our community members like; performance & cost of production, the difference in architectures, Reliability issues, and a bunch of random tangents. We have some heavy hitters for this event!

// MLOps Jobs board

https://mlops.pallet.xyz/jobs

// MLOps Swag/Merch

https://mlops-community.myshopify.com/

// Related Links

LLM in Production survey:

https://docs.google.com/forms/d/e/1FAIpQLSerEryK4xHEZTq0hSu-sVmBHilOzaT71BfCQgXe_uIRgIah-g/viewform

Virtual LLMs in Production Conference registration:

https://home.mlops.community/public/events/llms-in-production-conference-2023-04-13

Chinchilla papers:

https://paperswithcode.com/method/chinchilla, https://arxiv.org/abs/2203.15556

--------------- ✌️Connect With Us ✌️ -------------

Join our slack community: https://go.mlops.community/slack

Follow us on Twitter: @mlopscommunity

Sign up for the next meetup: https://go.mlops.community/register

Catch all episodes, blogs, newsletters, and more: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Diego on LinkedIn: https://www.linkedin.com/in/diego/

Connect with David on LinkedIn: https://www.linkedin.com/in/david-hershey-458ab081/

Connect with Hannes on LinkedIn: https://www.linkedin.com/in/hanneshapke/

Connect with James on LinkedIn: https://www.linkedin.com/in/james-richards-4baa73a7/

Connect with Rebecca on LinkedIn: https://www.linkedin.com/in/rebeccaqian/

Timestamps:

[

← See all 558 episodes of Agentic Conversations (formally mlops.community)