Data & ML Talk

Streaming joins without tears

Name: Streaming joins without tears
Start: 2027-05-20T12:00:00+02:00
End: 2027-05-20T12:45:00+02:00
Location: Kiln Room, The Foundry Hall

Joining two streams is easy until one of them arrives late. Noor explains watermarks, retractions and idempotent sinks with a production incident that ran for three days before anyone noticed.

You will learn how to test time-dependent pipelines deterministically.

Streaming
Data engineering

Speaker

Noor Al-Hashimi

Data Platform Lead, Halcyon Forge

Noor leads a data platform team that moves a few billion events a day. She teaches data contracts and believes every pipeline deserves a test.