Tags • Kubernetes
Bringing Kubernetes Clustering to Apache NiFi
Apache NiFi 2.0.0-M1 introduced extensible leader election, adding first-class support for clustering on Kubernetes using native services, without the need for Apache ZooKeeper. Based on the building blocks of Kubernetes ConfigMaps and Leases, new NiFi clustering capabilities reduce both configuration complexity and operational overhead.
Streamlining Apache NiFi Cluster State Migration
Cluster state tracking in Apache NiFi supports consistent and resilient flow processing across multiple nodes. Apache ZooKeeper provides a common solution for NiFi state tracking, with Redis as an alternative option. NiFi 2.0 adds Kubernetes ConfigMaps as a state tracking provider, and also introduces a simplified approach for migrating from one state provider to another with minimal configuration.