Data In Motion

 Price Comparisons Using Retail REST APIs with Apache NiFi, Kafka and Flink SQL Part 1:   NiFi Rest Part 2:   Kafka - Flink SQL Part 3:  Cloudera Visual Apps Part 4:   Smart Shelf Updates - MiNiFi Agents

  MiNiFi (C++) Version cpp-0.9.0 Release Date:  1  March 2021 Highlights of 0.9.0 release include: Added support for RocksDB-based content repository for better performance Added SQL extension Improved task scheduling Various C2 improvements Bug fixes and improvements to TailFile, ConsumeWindowsEventLog, MergeContent, CompressContent, PublishKafka, InvokeHTTP Implemented RetryFlowFile and smart handling of loopback connections Added a way to encrypt sensitive config properties and the flow configuration Implemented full S3 support Reduced memory footprint when working with many flow files Build Notes: It is advised that you use the bootstrap.sh when not building on windows. https://cwiki.apache.org/confluence/display/MINIFI/Release+Notes#ReleaseNotes-Versioncpp-0.9.0 Download Now As Source or Pre-Build for Your Platform https://nifi.apache.org/minifi/download.html

Kafka Replication with Cloudera Streams Replication Manager Source Code:     https://github.com/tspannhw/EmergingTechnologyDay2020 Source Event:    https://www.cloudera.com/about/events/virtual-events/cloudera-emerging-technology-day.html

Spring Data JPA Against Big Data Sources Download Hive JDBC Driver https://www.cloudera.com/downloads/connectors/hive/jdbc/2-6-5.html References https://docs.cloudera.com/documentation/other/connectors/hive-jdbc/2-6-9.html https://community.cloudera.com/t5/Community-Articles/Writing-Spring-Boot-Microservices-To-Access-Hive/ta-p/247250 https://shalishvj.wordpress.com/2018/06/02/hive-jdbc-spring-boot-restful-webservice-in-pivotal-cloud-foundry/ https://github.com/tspannhw/hive/blob/master/pom.xml https://github.com/firecodeman/Cloudera-Impala-Hive-JDBC-Example/blob/master/src/main/java/com/cloudera/example/ClouderaHiveJdbcExample.java https://docs.cloudera.com/documentation/other/connectors/hive-jdbc/Cloudera-JDBC-Driver-for-Apache-Hive-Release-Notes.txt https://start.spring.io/

 New Features of Apache NiFi 1.13.0 Check it out :    https://twitter.com/pvillard31/status/1361569608327716867?s=27 Download today :   https://nifi.apache.org/download.html Release Note s:   https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.13.0 Migration :  https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance New Features ListenFTP UpdateHiveTable - Hive DDL changes -Hive Update Schema ie Data Drift ie Hive Schema Migration!!!! SampleRecord - different sampling approaches to records ( Interval Sampling,  Probabilistic Sampling,  Reservoir Sampling) CDC Updates Kudu updates AMQP and MQTT Integration Upgrades ConsumeMQTT - readers and writers added HTTP access to NiFi by default is now configured to accept connections to 127.0.0.1/localhost only.  If you want to allow broader access for some reason for HTTP and you understand the security implications you can still control that as always by changing the ' nifi.web.http.host' pr