Tags • Iceberg
How Apache NiFi 2 Integrates Apache Iceberg
Apache Iceberg presents a unifying solution to structured data storage, and Apache NiFi 2.7 provides an extensible integration approach. Apache Iceberg modules for Java set clear boundaries for the API, core, and feature implementations. Building on this foundation enables Apache NiFi to support current capabilities such as Iceberg REST Catalog with vended credentials, while providing a path for future improvements.
Elephant Below the Waterline: Hadoop Dependencies in Iceberg
Apache Iceberg is an open table format with widespread adoption, but it carries the weight of historical baggage from Apache Hadoop. With Apache Parquet as a popular storage format for Iceberg, tight coupling to Hadoop classes presents maintenance challenges for integration with the Iceberg ecosystem.