🧱 Jak budować nowoczesne potoki danych?
Chcesz zobaczyć, jak w praktyce projektować nowoczesne potoki ETL (zarówno batchowe, jak i streamingowe) przy użyciu najnowszych rozwiązań? Obejrzyj nagranie z Toruń JUG #87! Jacek Laskowski, ekspert inżynierii danych, prowadzi sesję live codingu opartą o Spark Declarative Pipelines (SDP) na Apache Spark 4.1.1 oraz Delta Lake 4.1.0.
👉 Informacje na temat spotkań: https://www.meetup.com/torun-jug/events/
👉 Chcesz rozwijać swoje umiejętności programistyczne? Subskrybuj nasz kanał: www.youtube.com/@TorunJUG?sub_confirmation=1
---------------------
📌 O prelekcji "Spark Declarative Pipelines (Apache Spark 4.1)"
Let's code a few data processing / ETL pipelines together using Spark Declarative Pipelines (SDP) on Apache Spark 4.1.1 and Delta Lake 4.1.0.
I'll have my own ETL pipeline ideas, but I'd rather have yours instead (to make the live coding session the best experience ever).
I can't promise I'll have all the answers, but I'll surely have a comment or two about your cases (unless there's a demo that speaks for itself).
I'm dreaming of a live coding session where we develop data processing pipelines (streaming and batch) together - you ask questions, and I answer them with an SDP demo.
You in? See you soon!
👨💻 O prelegencie:
Jacek Laskowski - A Freelance Data Engineer specializing in Apache Spark (incl. Spark SQL and Spark Structured Streaming), Delta Lake, Unity Catalog, MLflow, DSPy, Databricks with brief forays into a wider Data, ML and AI Engineering space (mostly during Warsaw Data Engineering meetups). Więcej na https://books.japila.pl/ lub https://www.linkedin.com/in/jaceklaskowski/.
---------------------
🤝 Partnerzy spotkania:
✅ Simplito (https://simplito.com)
✅ UMK WFAIIS (https://www.fizyka.umk.pl)
✅ Allegro Tech (https://allegro.tech)
✅ JetBrains (https://www.jetbrains.com)
✅ Helion (https://helion.pl)
🌐 Bądź częścią społeczności Toruń JUG:
✅ Meetup: https://www.meetup.com/Torun-JUG/
✅ Linkedin: https://www.linkedin.com/company/torun-jug
✅ X: https://twitter.com/torunjug/
✅ Facebook: https://facebook.com/torunjug
✅ WWW: https://torun.jug.pl
#apachespark #dataengineering #livecoding #deltalake #etl #bigdata #sparkpipelines #softwaredevelopment #torun #it #jug #torunjug
