Feature Stores at Shopify and Skyscanner // Matt Delacour and Mike Moran // Reading Group #4 from Agentic Conversations (formally mlops.community)

Feature Stores at Shopify and Skyscanner // Matt Delacour and Mike Moran // Reading Group #4

49 minutes Posted Feb 23, 2022 at 3:01 pm.

] Matt's intro

] Mike's intro

] Matt’s talk: Feature store system at Shopify

] What is Shopify?

] Shopify Use Case

] Choosing a solution

] Managed service vs In-house vs Open-source (Feast)

] Why did we choose Feast?

] Implementation Strategy (multi-repo vs mono-repo approaches)

] Mono-repo approach breakdown

] Internal SDK

] Q&A: Does feast satisfy scalability for online inference of Shopify latency requirements?

] Q&A: Do you rely on Feast to serialize data to the online store?

] Q&A: Is your mono-repo library a subset of Feast?

] Q&A: Did you consider using git submodules for a multi-repo?

] Q&A: Are you storing embeddings with Feast?

] Q&A: Regarding the mono-repo, which modules are responsible for feature engineering? How do you guarantee that different feature engineering can be used across many DS?

] Mike’s talk (Feature store at Skyscanner)

] Kaleidoscope System

] Background and context of the Feature store

] Initial state of the feature store

] How does the marketing team also leverage the feature store

] Current state of the feature store (marketing & machine learning)

] SDK approach of creating schemas with dataframes (easy access)

] Reusability across teams among marketing and DS team

] GDPR constraints

] Data updates at the feature store

] Q&A: When a DS updates a feature, how are you communicating that across teams?

] Q&A: Are you applying different levels of feature engineering to increase the likelihood of a DS going back to a previous checkpoint of processing?

] Q&A: In what languages are you implementing the feature store?

] Q&A: Regarding performance-wise, how do you decide what code remains in Apache Spark vs SQL?

] Wrap-up

0:00

49:35

Download MP3

Share at current time

Show notes

MLOps Reading Group meeting on February 11, 2022

Reading Group Session about Feature Stores with Matt Delacour and Mike Moran

--------------- ✌️Connect With Us ✌️ -------------

Join our slack community: https://go.mlops.community/slack

Follow us on Twitter: @mlopscommunity

Connect with us on LinkedIn: https://www.linkedin.com/company/mlopscommunity/

Sign up for the next meetup: https://go.mlops.community/register

Catch all episodes, Feature Store, Machine Learning Monitoring and Blogs: https://mlops.community/

Timestamps:

[

← See all 562 episodes of Agentic Conversations (formally mlops.community)