The Backend Engineering Show with Hussein Nasser
The Backend Engineering Show with Hussein Nasser
Hussein Nasser
How Apache Kafka got faster by switching ext4 to XFS
33 minutes Posted Apr 29, 2024 at 6:00 pm.
Intro
Summary
How Kafka Works?
Producers Writes are Slow
Tracing Kafka Protocol
Tracing Kernel System Calls
Journaled File Systems
Improving ext4
Switching to XFS
0:00
33:52
Download MP3
Show notes
https://oscourse.win
Allegro improved their Kafka produce tail latency by over 80% when they switched from ext4 to xfs. What I enjoyed most about this article is the detailed analysis and tweaking the team made to ext4 before considering switching to xfs. This is a classic case of how a good tech blog looks like in my opinion. 
Blog
https://blog.allegro.tech/2024/03/kafka-performance-analysis.html