Model Performance Monitoring and Why You Need it Yesterday // Amit Paka // MLOps Coffee Sessions #42 from Agentic Conversations (formally mlops.community)

Agentic Conversations (formally mlops.community)

Demetrios

Episodes

About

Reviews

Promote

Model Performance Monitoring and Why You Need it Yesterday // Amit Paka // MLOps Coffee Sessions #42

1 hour 7 minutes Posted Jun 1, 2021 at 12:41 pm.

] Thank you to Fiddler AI!

] Introduction to Amit Paka

] Amit's background in tech

] EU Regulation

] "The goal that the EU seems to be going for is they want to go for helping build human-centric and responsible AI."  

] 4 AI Categories:              

] Deep dive into High-risk applications

] Digital Services Act (DSA) and Digital Marketing Act (DMA)

] Military  

] "They don't know what they don't know and they probably wanted the door open."  

] US on JIC Team transparency and increasing trustworthiness on AI

] Diversity of industries and Explainability  

] "The urgent need for Explainability comes from verticals that are facing the problems today on the ground and cannot run their business." [30:09] Model Performance Management (MPM)

] "When your model is facing issues, you now have to root-cause it within life."

] Control Theory

] "Control Theory means that you do not just measure it but you can influence it so you can actually keep it."

] Abstraction into being useful

] "You can train a model that accurately represents the reality."

] Data scientist doing ML Flow

] Amit's favorite surprise!

] Banking and Insurance adoption of ML

] Advise ML Scientists and Data Scientists in terms of Explainable AI

] "Models are incredibly hard to debug. You're just training a model for high accuracy but you don't know how that accuracy is distributed."

] Linking of EU Regulation and MPM

0:00

1:07:01

Download MP3

Share at current time

Show notes

Coffee Sessions #42 with Amit Paka of Fiddler AI, Model Performance Monitoring.

//Abstract

Machine Learning accelerates business growth but is prone to performance degradation due to its high reliance on data. Moreover, MLOps is often fragmented in many organizations, causing frictions to debug models in production. With new rules from the EU that focus on trust and transparency, it’s becoming more important to keep track of model performance. But how? We propose a new framework, a centralized ML Model Performance Management powered by Explainable AI. Learn more about how you can stay compliant while maximizing your model performance at all times with explainability and continuous monitoring.

//Bio

Amit is the co-founder and CPO of Fiddler, a Machine Learning Monitoring company that empowers companies to efficiently monitor and troubleshoot ML models with Explainable AI. Prior to founding Fiddler, Paka led the shopping apps product team at Samsung. Paka founded Parable, the Creative Photo Network, now part of the Samsung family. He also led PayPal's consumer in-store mobile payments launching innovations like hardware beacon payments and has developed successful startup products particularly in online advertising - paid search, a contextual, ad exchange, and display advertising. Paka has passions for actualizing new concepts, building great teams, and pushing the envelope, and aims to leverage these skills to help define how AI can be fair, ethical, and responsible.

--------------- ✌️Connect With Us ✌️ -------------

Join our slack community: https://go.mlops.community/slack

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Vishnu on LinkedIn: https://www.linkedin.com/in/vrachakonda/

Connect with Amit on LinkedIn: https://www.linkedin.com/in/amitpaka/

Timestamps:

[

1. Unacceptable risk applications

2. High-risk applications

3. Limited risk applications

4. Minimal risk applications

[

← See all 563 episodes of Agentic Conversations (formally mlops.community)