Apache Iceberg REST Catalog: The Complete Guide

Apache Iceberg REST Catalog: The Complete Guide

Apache Iceberg REST Catalog: The Complete Guide

The Apache Iceberg REST Catalog is a standardized HTTP API for managing Iceberg table metadata. It is the recommended catalog type by the Iceberg community because it decouples catalog operations from specific implementations — any REST-compliant server (Polaris, Lakekeeper, Tabular, custom) can serve as the backend.

Why REST Catalog?

Catalog TypeCouplingMulti-EngineRecommended
RESTLoose (HTTP API)✅ Best✅ Yes
HiveTight (Thrift)✅ GoodLegacy
JDBCModerate (SQL)✅ GoodSimple setups
Hadoop/StorageTight (filesystem)⚠️ LimitedDevelopment only

REST catalog advantages:

  • Interoperability: Any engine (Spark, Flink, Trino, RisingWave) connects via HTTP
  • Access control: Centralized authorization at the catalog level
  • Abstraction: Change the backend (Hive → JDBC → custom) without changing clients
  • Cloud-native: Works naturally with containerized and serverless deployments

REST Catalog Implementations

ImplementationTypeFeatures
Polaris (Snowflake)Open sourceFull-featured, Snowflake-backed
LakekeeperOpen sourceRust-based, lightweight
TabularCommercialManaged service
Unity Catalog (Databricks)Open sourceMulti-format support
AWS GlueManagedAWS-native
GravitinoOpen sourceMulti-catalog federation

Using REST Catalog with RisingWave

CREATE SINK to_iceberg AS SELECT * FROM stream
WITH (
  connector = 'iceberg',
  catalog.type = 'rest',
  catalog.uri = 'http://polaris:8181',
  warehouse.path = 's3://lakehouse/warehouse',
  database.name = 'analytics',
  table.name = 'events'
);

Frequently Asked Questions

Which Iceberg catalog should I use?

REST catalog is recommended for new projects. It provides the most flexibility and interoperability. Use Hive catalog if you have existing Hive Metastore infrastructure. Use JDBC for simple PostgreSQL/MySQL-backed setups.

Does RisingWave support REST catalog?

Yes. RisingWave supports REST, Hive, JDBC, Storage, and AWS S3 Tables catalogs for Iceberg sinks.

Best-in-Class Event Streaming
for Agents, Apps, and Analytics
GitHubXLinkedInSlackYouTube
Sign up for our to stay updated.