Skip to main content
Version: v1.4.0

Start here

The Konpyūtāika NiFi operator is a Kubernetes operator to automate provisioning, management, autoscaling and operations of Apache NiFi clusters deployed to K8s.

Overview

Apache NiFi is an open-source solution that support powerful and scalable directed graphs of data routing, transformation, and system mediation logic. Some of the high-level capabilities and objectives of Apache NiFi include, and some of the main features of the NiFiKop are:

  • Fine grained node configuration support
  • Graceful rolling upgrade
  • graceful NiFi cluster scaling
  • NiFi cluster auto-scaling
  • Encrypted communication using SSL
  • the provisioning of secure NiFi clusters
  • Advanced Dataflow and user management via CRD

Some of the roadmap features:

  • Automatic reaction and self healing based on alerts (plugin system, with meaningful default alert plugins)
  • graceful NiFi cluster rebalancing

Motivation

There are already some approaches to operating NiFi on Kubernetes, however, we did not find them appropriate for use in a highly dynamic environment, nor capable of meeting our needs.

Finally, our motivation is to build an open source solution and a community which drives the innovation and features of this operator.