GeeCON Prague 2022: Pustelnik, Nawrot, Kwasiborski - How to build a planet-scale data replication...

You trust Google Cloud with your critical data, but did you know that Google relies on the same underlying retention infrastructure for its another businesses as well? That’s right, the same retention services that power Google Cloud besides underpin Google’s most critical services. Our home-grown copy service is the foundational retention strategy that takes care of data replication for availability and latency purposes. It supports a diverse scope of workloads copying massive amounts of data between all Google data centres around the world. In this talk, we will take a deeper look at the infrastructure behind the planet-scale replication service, discuss the challenges, and the approach taken to guarantee that your data is geographically distributed for durability, availability, and latency purposes