Amsterdam Scala Matters Meet-up

Welcome to the Scala Matters Amsterdam Meet-up??‍?

Join us for an evening of knowledge sharing, networking, and all things Scala.

Whether you're a seasoned Scala expert or just beginning your journey into Functional Programming, this meet-up welcomes everyone!

? Wednesday 2nd October

⏰ Doors open at 18:00, talks start at 18:30 (Local Time)

?Marktplaats office, 224 Wibautstraat,1097 DN Amsterdam

?Food and drinks provided!

Talk 1 - Dario Amorosi, Big Data Engineer @ Adevinta

Optimizing Data Transfer Kafka to BQ: let's use Scala to make it custom.

I will explore how our team developed a custom solution to handle the escalating data and cost challenges faced by traditional cloud services in our data pipeline. Originally utilizing Dataflow for moving 2 billions of events daily from Kafka to BigQuery, the growing costs prompted a shift to a more sustainable model. I will detail our transition to a two-part custom application that stages data in GCP Cloud Storage before loading it into BigQuery, highlighting how Scala's features and the ZIO ecosystem significantly contributed to the performance and reliability of this application.

Talk 2 - TBC

Talk 3 - TBC

Please note: All talks will be held in English

Host or Publisher Scala Matters