Skip to main content

Migrating Apache Flume Flows to Apache NiFi: SYSLOG to KAFKA

Migrating Apache Flume Flows to Apache NiFi:  SYSLOG  to KAFKA

This is a simple use case of being a smart gateway/proxy between SYSLOGand Kafka.   We can do a lot more than that in NiFi.  We can be a Kafka Consumer and Producer as well as read and parse all types of logs including SYSLOG.  We have a GrokReader for converting semistructured logs into manageable tabular style data with schemas.   Log->JSON/CSV/AVRO/PARQUET.  All with No Code.

It is extremely easy to do this in NiFi.

See:  Log Parsing:

Detailed Tutorials