GeeCON 2022: Mary Gryglewski - Event Streaming for the Best of All Worlds

youtube.com 1 rok temu


When it comes to distributed, event-driven messaging systems, we usually see them supporting either 1 of 2 types of semantics: streaming, or queueing, and seldom do we find a platform that supports both. In this presentation, we’ll first get an introduction and any clarifications of event-driven versus message-driven systems, event streams, and stream processing. We’ll then take a look at Apache Pulsar which offers a very unique capability in modern, cloud-native applications and architecture, in which its platform supports both Publish-Subscribe and Message Queues, and extends into streams processing as well as performs message mediation & transformation. We will see how it works closely with and relies on Apache Bookkeeper for its durable, scalable, and performant retention of log streams, and leverages on Apache Zookeeper to manage the otherwise very complex ecosystem. We will then compare Apache Pulsar with the popular Apache Kafka platform to realize any of their key differences as to how Pulsar can overcome any of Kafka's limitations. With Pulsar's flexible architecture and cloud-native readiness, we will take a look to see how it can be integrated and work collaboratively with the popular Spring framework