"We’ve all tried adjusting the number partitions, replica fetch size, batch size, socket buffer size, number of I/O threads … you could spend an hour enumerating the tuning options for Kafka to squeeze a few percent of extra performance. Finding the right combination of parameters is closer to alchemy than engineering work, time consuming and in bigger deployments sometimes even impossible!
What if there's a better way? What if you could ""just"" make Kafka more efficient and gain better performance without months of engineering effort?
Since Kafka is written in Java and Scala, in this talk, we'll discuss the effect of Java Virtual Machine (JVM) on a Kafka cluster. We'll demonstrate that running Kafka on Azul Prime JVM can reduce the latency by up to 40% while handling the same load. We’ll go beyond shiny marketing-y charts, dig into flamegraphs, and look at assembly code to fully understand where the speed up is coming from.
After the session, you'll understand the importance of the underlaying JVM and how you can leverage this knowledge to boost the performance of the cluster to achieve better SLAs or reduce the infrastructure costs."
32. 32
• The choice of JVM can drastically affect Kafka‘s performance
Takeaways
33. 33
• The choice of JVM can drastically affect Kafka‘s performance
• By improving Kafka performance, you can address the pain points – speed, response times and cost
Takeaways
34. 34
• The choice of JVM can drastically affect Kafka‘s performance
• By improving Kafka performance, you can address the pain points – speed, response times and cost
• Azul Platform Prime is the fastest JVM out there
Takeaways
35. 35
• The choice of JVM can drastically affect Kafka‘s performance
• By improving Kafka performance, you can address the pain points – speed, response times and cost
• Azul Platform Prime is the fastest JVM out there
• It‘s not just for Kafka – it works any for Java application!
Takeaways
36. 36
• The choice of JVM can drastically affect Kafka‘s performance
• By improving Kafka performance, you can address the pain points – speed, response times and cost
• Azul Platform Prime is the fastest JVM out there
• It‘s not just for Kafka – it works any for Java application!
• These are not optimizations you can do manually as a developer
Takeaways