Skip to main content

Posts

Showing posts with the label nifi 1.11.4

Cloudera Flow Management 101: Let's Build a Simple REST Ingest to Cloud Datawarehouse With LowCode. Powered by Apache NiFi

Use NiFi to call REST API, transform, route and store the data Pick any REST API of your choice, but I have walked through this one to grab a number of weather stations reports.  Weather or not we have good weather, we can query it anyway. We are going to build a GenerateFlowFile to feed our REST calls. [ { " url " : " http://weather.gov/xml/current_obs/CWAV.xml " }, { " url " : " http://weather.gov/xml/current_obs/KTTN.xml " }, { " url " : " http://weather.gov/xml/current_obs/KEWR.xml " }, { " url " : " http://weather.gov/xml/current_obs/KEWR.xml " }, { " url " : " http://weather.gov/xml/current_obs/CWDK.xml " }, { " url " : " http://weather.gov/xml/current_obs/CWDZ.xml " }, { " url " : " http://weather.gov/xml/current_obs/CWFJ.xml " }, { " url " : " http://weather.gov/xml/current_obs/PAEC.xml " }, { " url " : "