Agentic Conversations (formally mlops.community)
Agentic Conversations (formally mlops.community)
Demetrios
Real-Time Exactly-Once Event Processing with Apache Flink, Kafka, and Pinot //Jacob Tsafatinos // MLOps Coffee Sessions #97
54 minutes Posted May 5, 2022 at 9:27 am.
] Introduction to Jacob Tsafatinos
] Takeaways
] Jacob's band
] Lyrics about software engineers or artistic stuff
] Connection of hobby and real-time system
] How to game Spotify Algorithm?
] Data stack for analytics
] Uber blog
] Video mess up
] Considerations and importance of the Uber System
] Challenges encountered through the Uber System journey
] Crucial to building the system
] Not exactly real-time
] Design decisions main questions
] Testament to OSS  
] Real-time processing systems for analytical use cases vs Real-time processing systems for predictive use cases
] Real-time systems necessity
] Potential that opens up new doors
] Runaway or learn it?
] Real-time use case target
] Resource constrained
] ML Oops stories
] Wrap up
0:00
54:12
Download MP3
Show notes
MLOps Coffee Sessions #97 with Jacob Tsafatinos, Real-Time Exactly-Once Event Processing with Apache Flink, Kafka, and Pinot co-hosted by Mihail Eric.
// Abstract
A few years ago Uber set out to create an ads platform for the Uber Eats app that relied heavily on three pillars; Speed, Reliability, and Accuracy. Some of the technical challenges they were faced with included exactly-once semantics in real-time. To accomplish this goal, they created the architecture diagram above with lots of love from Flink, Kafka, Hive, and Pinot. You can dig into the whole paper (https://go.mlops.community/k8gzZd) to see all the reasoning for their design decisions.
// Bio
Jacob Tsafatinos is a Staff Software Engineer at Elemy. He led the efforts of the Ad Events Processing system at Uber and has previously worked on a range of problems including data ingestion for search and machine learning recommendation pipelines. In his spare time, he can be found playing lead guitar in his band Good Kid.
// MLOps Jobs board  
https://mlops.pallet.xyz/jobs
// Related Links
Uber blog
https://eng.uber.com/author/jacob-tsafatinos/
https://eng.uber.com/real-time-exactly-once-ad-event-processing/
--------------- ✌️Connect With Us ✌️ -------------
Join our slack community: https://go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: https://go.mlops.community/register
Catch all episodes, blogs, newsletters, and more: https://mlops.community/
Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/
Connect with Mihail on LinkedIn: https://www.linkedin.com/in/mihaileric/
Connect with Jacob on LinkedIn: https://www.linkedin.com/in/jacobtsaf/
Timestamps:
[
[
[
[
[
[
[
[
[
[
[
[
[
[
[
[
[
[
[
[
[
[
[