Subscribe to our channel: https://youtube.pl/c/DevoxxPoland?sub_confirmation=1
So you've embraced Apache Kafka as the core of your data infrastructure, embracing event-driven services that communicate with each through topics, integrate with legacy systems through an ecosystem of connectors, and respond more or little in real time to things that happen in the planet outside your software. Logs of immutable events form a more robust backbone than the one-database-to-rule-them-all of your deep monolith past. Your stack is more evolvable, more responsive, and easier to reason about. There's just 1 problem: now that everything is simply a stream, how do you query things?
If this is you, you can most likely name at least 1 or 2 ways off the top of your head, but have you stopped to think through how to make the choice? It is time you did. In this talk, we'll research the solutions presently in usage in the planet for asking questions about the contents of a topic, including Kafka Streams, the various streaming SQL implementations, your favourite relational database, your favourite data lake, and real-time analytics databases like Apache Pinot. There is no single correct answer to the question, so as liable builders of systems, we must realize our options and the tradeoffs they present to us. You'll leave this talk even happier that you've embraced Kafka as the heart of your system, and ready to deploy the right choice for querying the logs that hold your data.
Recorded at Devoxx Poland 2024
Twitter: https://twitter.com/DevoxxPL
Instagram: https://www.instagram.com/DevoxxPL
Join us besides here:
Devflix: https://devflix.pl
#Devoxx #DevoxxPoland #IT #Development #SoftwareDevelopment
