Apache NiFi - Apache Flink - Apache Kafka - Apache Spark - Apache Iceberg @PaaSDev
Each message can be compressed or not, each message is independent with compression information in each message's header