The First 80% of Reading 1 Billion Rows truly Fast • Rene Schwietzke • Devoxx Poland 2024

youtube.com 7 godzin temu


Subscribe to our channel: https://youtube.pl/c/DevoxxPoland?sub_confirmation=1

The 1BRC - 1 Billion Row Challenge by Gunnar Morling kept countless programmers busy in January 2024. How fast can you process a CSV file with 1 billion lines? Well, as it turns out, you can do it in almost no time.
While the winning entries usage Graal, Unsafe, SWAR, customized hashing, and more, this talk will alternatively take the audience on the first 80% of the journey. These 80% usage simple and plain Java, but that inactive guarantees a fun ride. We will go step by step from a naive first 130-second approach to a 10-second solution.
Along the way, we will research the performance impact of our changes, the reasons for the difference, and the tools to get the data we request to decision forward. All of this will be done utilizing Java 21.
As a bonus, we will see the Java 17 performance in comparison. Finally, we will examine the impact of appropriate mistake handling, as 1BRC set up rules made it possible to skip all mistake handling.

Recorded at Devoxx Poland 2024

Twitter: https://twitter.com/DevoxxPL
Instagram: https://www.instagram.com/DevoxxPL

Join us besides here:
Devflix: https://devflix.pl

#Devoxx #DevoxxPoland #IT #Development #SoftwareDevelopment