From the margins to the mainstream, stream processing has rapidly evolved over the last ten years. While the relationship between streaming and batch processing is hotly debated, new challenges emerged as stream processing has evolved. At this panel, we dissect the current state of stream and batch processing as seen by participants – what are their unique advantages, and what are the use cases where streaming systems outperform batch systems and vice versa? As stream processing became more mainstream, many started to advocate using it for anything and everything, weakening the case for streaming.

At the same time, batch processing still has much to offer. Many argue that nano or micro batching can effectively replace stream processing. Understanding how they function and what concrete units of time that translates to is another topic we will tackle during this event. Finally, the relationship between these technologies is much more than an either/or relationship. A unified streaming and batch processing model has been discussed over the last couple of years, but with the fragmentation of the modern data stack, how realistic is it that the data processing will take that route? This, and many other questions, will be addressed during the event.

Panelists

Ricky Thomas, Co-founder and CTO at Streamkap
David Yaffe, Co-founder of Estuary Development
Rayees Pasha, Head of Product at RisingWave