GeeCON 2023: Fawaz Ghali - Building advanced Performance Real-time Stream Processing Microservices

Real-time stream processing is increasing exponentially in fresh years, businesses request to gather insights from real-time data as shortly as it’s generated. To do this, developers and software architects usage various pipelines and tools to capture and process data in motion. Real-time stream processing has its own challenges specified as investigating and life-cycle management, scaling and performance, event time and late events, streaming responsibility tolerance, and processing guarantees. In this talk, I will address those challenges and show the best practices for real-time stream processing, from data ingestion to data processing with ultra-low latency at scale and at speed, utilizing the Hazelcast platform. I will discuss how you can optimize your real-time streaming projects in the following areas: scalability, performance, failover, reliability, and data recovery.