The GeekNarrator
The GeekNarrator
Kaivalya Apte
Messaging and Streaming with Apache Pulsar - with Matteo Merli
1 hour 3 minutes Posted Jan 27, 2024 at 5:17 pm.
Introduction and Guest Introduction
Understanding Apache Pulsar and its Origin
The Problem Apache Pulsar was Designed to Solve
The Evolution of Apache Pulsar
Understanding Basic Concepts of Apache Pulsar
Deep Dive into Apache Pulsar's Architecture
Understanding the Flow of Data in Apache Pulsar
Understanding Subscriptions in Apache Pulsar
Understanding End-to-End Latency and Subscription Creation
Broker's Role and Handling Metadata
Memory Management and Consumer Handling
Message Processing and Flow Control
Message Storage and Retrieval
Comparing Pulsar with Kafka
Understanding Multi-Tenancy in Pulsar
Exploring Tiered Storage and Future Developments
0:00
1:03:46
Download MP3
Show notes
In this video I talk about Apache Pulsar with Matteo Merli, CTO at StreamNative. This episode will provide you good insight about how Apache Pulsar works and more importantly differs with the most popular Pub/Sub and streaming platform Apache Kafka. Things like, what enables possibility of 1 million topics? Why is rebalancing not required? How does decoupled storage and compute architecture works? How it uses the concept of Subscriptions to avoid retaining data unnecessarily?
And much more...
Chapters:
Important links:
StreamNative: https://streamnative.io/
Apache Pulsar: https://pulsar.apache.org/
Matteo Merli: https://twitter.com/merlimat
===============================================================================
For discount on the below courses:
Appsync: https://appsyncmasterclass.com/?affiliateId=41c07a65-24c8-4499-af3c-b853a3495003
Testing serverless: https://testserverlessapps.com/?affiliateId=41c07a65-24c8-4499-af3c-b853a3495003
Production-Ready Serverless: https://productionreadyserverless.com/?affiliateId=41c07a65-24c8-4499-af3c-b853a3495003
Use the button, Add Discount and enter "geeknarrator" discount code to get 20% discount.
===============================================================================
Follow me on Linkedin and Twitter: https://www.linkedin.com/in/kaivalyaapte/ and https://twitter.com/thegeeknarrator
If you like this episode, please hit the like button and share it with your network.
Also please subscribe if you haven't yet.
Database internals series: https://youtu.be/yV_Zp0Mi3xs
Popular playlists:
Realtime streaming systems: https://www.youtube.com/playlist?list=PLL7QpTxsA4se-mAKKoVOs3VcaP71X_LA-
Software Engineering: https://www.youtube.com/playlist?list=PLL7QpTxsA4sf6By03bot5BhKoMgxDUU17
Distributed systems and databases: https://www.youtube.com/playlist?list=PLL7QpTxsA4sfLDUnjBJXJGFhhz94jDd_d
Modern databases: https://www.youtube.com/playlist?list=PLL7QpTxsA4scSeZAsCUXijtnfW5ARlrsN
Stay Curios! Keep Learning!