Setting up an Apache Iceberg stack can be complex. You need a query engine to write data, a catalog to manage metadata (like Nessie or a JDBC service), and an object store for the table files. Juggling these separate components requires significant s...
RisingWave's integration with Apache Iceberg took a significant step forward with the introduction of REST catalog support in v2.5. This enhancement allows you to connect RisingWave to any modern Iceberg catalog service through a standardized API. We...
About This Series This time, I’m taking on a 30-day challenge to focus on streaming pipelines. Following the idea of “knowing not just what works, but why it works,” we’ll start by building a simple streaming framework from scratch. This will help us...
Large Language Models (LLMs) are redefining what’s possible in data engineering, but beyond the hype, how do you integrate them effectively? For engineers building real-time applications where a streaming database like RisingWave serves as the centra...
