Common Mistakes in the ML Development Lifecycle // Kseniia Melnikova // MLOps Meetup #65 from Agentic Conversations (formally mlops.community)

Agentic Conversations (formally mlops.community)

Demetrios

Episodes

About

Reviews

Promote

Common Mistakes in the ML Development Lifecycle // Kseniia Melnikova // MLOps Meetup #65

54 minutes Posted Jun 1, 2021 at 6:13 pm.

] Introduction to Kseniia Melnikova

] MLOps World Conference Announcement

] AI Development process: Common Mistakes

] Step 1: Planning

] Mistake #1: Personal Decisions Teamwork

] Mistake #1: Cases

] Mistake #1: Solution

] Scrum

] "In Scrum, it's hard to plan because especially in research, you don't know which result affects new tasks that's why it might be a little slow for Machine Learning."

] Step 2: Data Processing

] Mistake #2: Chaos with Datasets

] Mistake #2: Cases

] Mistake #2: Solution

] Step 3: Experiments

] Mistake #3: Lack of Experiments Tracking

] Mistake #3: Case Manual Experiments Tracking

] Mistake #3: Solutions

] Experiments Tracking Tools Example: MLFlow UI

] Awareness of Existing Tools

] Tools' Features

] Possible Combination

] Another Possible Combination

] Best Practice

] Mistake #0: Lack of Information Sharing

] Mistake #0: Solution Organize more meetings/standups!  

] Find Your Mistakes

] Mistake #0: Solution Organize more meetings/standups!  

] Audio Data

] Experiment tracking of only 1 ML engineer

] "I prefer reproducibility tools because it's automatic and it also takes a lot of time to manually upload the results into conference."

] AI Development Check-list

] Check-list Results

] "I think it's always interesting to rate yourself to share the results with other people to compete out of it."

] Why to Implement

] "If we have more automation on experimentations for data sets versioning, it will lead to less manual work."

] "AI Development process implementation will have the possibility to reproduce and compare experiments."

] "AI Development process implementation will make you comfortable on solving the issues you'll face every day."

] "AI Development process implementation will lead to a faster commercialization cycle because you will take less time on the process and more time for the results."

] "If we will take all the principles of AI Development process implementation, it will lead to easy communication between team members. You'll gain trust, have great teamwork, and everyone will have respect for each other."  

] War stories prior to having AI Development process

] Calculating the lost money

0:00

54:30

Download MP3

Share at current time

Show notes

MLOps community meetup #65! Last Wednesday we talked to Kseniia Melnikova, Product Owner (Data/AI), SoftwareOne.

//Abstract

In this MLOps Meetup, we talked about the Machine Learning model lifecycle and development stages and then analyze the main mistakes that everybody does at each stage. Kseniia also provided the audience with solutions to the mistakes and we discussed existing tools for experiment management.

//Bio

Kseniia is a product owner for Data/AI-based products. Right now, she is working mostly with numeric data analysis, customer insights, and product recommendations.

Previously Kseniia worked at Samsung Research with the biometrics team. She was studying computer science in Russia (Moscow) and a little bit of management in South Korea (Seoul). One of the most interesting directions of research - Model Lifecycle Management Systems and Reproducibility.

----------- Connect With Us ✌️-------------

Join our Slack community: https://go.mlops.community/slack

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Kseniia on LinkedIn: https://www.linkedin.com/in/kseniia-melnikova/

Timestamps:

[

← See all 563 episodes of Agentic Conversations (formally mlops.community)