Best in Flow Competition: Bring Your Own Data (Public Only)

 Bring Your Own Data (Public Only)

• Data is visible and downloadable to all, make sure it is safe, free, open, public data.

• Public REST Feeds are good

• Wikipedia https://docs.cloudera.com/dataflow/cloud/flow-designer-beginners-guide-readyflow/topics/cdf-flow-designer-getting-started-readyflow.html 

• https://gbfs.citibikenyc.com/gbfs/en/station_status.json

• https://travel.state.gov/_res/rss/TAsTWs.xml 

• https://www.njtransit.com/rss/BusAdvisories_feed.xml 

• https://www.njtransit.com/rss/RailAdvisories_feed.xml

• https://www.njtransit.com/rss/LightRailAdvisories_feed.xml 

• https://www.njtransit.com/rss/CustomerNotices_feed.xml 

• https://w1.weather.gov/xml/current_obs/all_xml.zip 

• https://dailymed.nlm.nih.gov/dailymed/services/v2/spls.json?page=1&pagesize=100 

• https://dailymed.nlm.nih.gov/dailymed/services/v2/drugnames.json?pagesize=100 

• https://dailymed.nlm.nih.gov/dailymed/rss.cfm 

• Generic data files

• https://aws.amazon.com/data-exchange 

• Simulators

• Use external data simulators via REST

• Use GeneralFlowFile see:  https://www.datainmotion.dev/2019/04/integration-testing-for-apache-nifi.html 

• Schemas, Data Sources  and Examples

• https://github.com/tspannhw/FLaNK-AllTheStreams/

• https://github.com/tspannhw/FLaNK-DataFlows

• https://github.com/tspannhw/FLaNK-TravelAdvisory/

• https://github.com/tspannhw/FLiP-Current22-LetsMonitorAllTheThings 

• https://github.com/tspannhw/create-nifi-kafka-flink-apps 

• https://www.datainmotion.dev/2021/01/flank-real-time-transit-information-for.html