FLaNK Weekly 18 December 2023

 

18-December-2023

For new stuff every working day in December: https://github.com/tspannhw/FLaNK-December2023

We will always miss you Shaggy.

img

FLaNK Stack Weekly

Tim Spann @PaaSDev

https://pebble.is/PaaSDev

https://vimeo.com/flankstack

https://www.youtube.com/@FLaNK-Stack

https://www.threads.net/@tspannhw

https://medium.com/@tspann/subscribe

Get your new Apache NiFi for Dummies!

https://www.cloudera.com/campaign/apache-nifi-for-dummies.html

https://ossinsight.io/analyze/tspannhw

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

http://www.meetup.com/futureofdata-princeton/

https://www.meetup.com/futureofdata-newyork/

https://www.meetup.com/futureofdata-philadelphia/

**This is Issue #116 **

https://github.com/tspannhw/FLiPStackWeekly

https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

https://www.cloudera.com/solutions/dim-developer.html

Project News

useful commands

hostnamectl

Articles

https://medium.com/@tspann/streaming-change-events-building-iceberg-s-ddc40d9d5503

https://medium.com/@tspann/ingesting-all-the-medications-in-america-every-7-days-184698578cc6

https://medium.com/@tspann/real-time-flight-analytics-c7ad48e8005f

https://community.cloudera.com/t5/Community-Articles/Processing-real-time-unstructured-data-with-GenAI-using/ta-p/378191

https://towardsdatascience.com/a-guide-on-12-tuning-strategies-for-production-ready-rag-applications-7ca646833439

https://www.decodable.co/blog/checkpoint-chronicle-december-2023?

https://medium.com/@pandey.brajesh/a-java-toolkit-for-apache-iceberg-open-table-format-64c329d6c719

https://medium.com/expedia-group-tech/explore-near-real-time-streaming-data-using-a-web-ui-da116079a74a

Videos

https://youtu.be/iw_F0nGanL0?si=ZMP-sdPvX8jL_ght

https://www.youtube.com/watch?v=6dRYn4FZVmw&t=4s&ab_channel=DatainMotion-HowToBeaStreamingEngineer

https://www.youtube.com/watch?v=psnRObquBfw&t=638s&pp=ygUJVGltIFNwYW5u

https://www.youtube.com/watch?v=FZZmGKENFMI&ab_channel=Cloudera%2CInc.

https://youtube.com/shorts/EJ2J7ip6T-E?si=6HA6SBFyiAD-N7df

https://www.youtube.com/watch?v=K3FJRcNzLds

https://www.youtube.com/watch?v=WQA8G5_cMcQ

https://www.youtube.com/watch?v=iw_F0nGanL0&ab_channel=Conf42

https://www.youtube.com/watch?v=avvG_dXoF8U

Events

On Demand https://events.dzone.com/dzone/Data-Pipelines-Investigating-the-Modern-Day-Stack?utm_bmcr_source=LinkedIn

Open Source Finance Forum. Virtual. https://resources.finos.org/znglist/osff-2023-virtual-presentations/?c=cG9zdDo5OTEzOTk%3D&utm_campaign=OSFF+NYC+2023&utm_content=269713979&utm_medium=social&utm_source=linkedin&hss_channel=lcp-18473937

img

April 2024: XtremeJ 2024. Virtual. https://xtremej.dev/2023/schedule/

Cloudera Events https://www.cloudera.com/about/events.html

More Events: https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

Code

Models

Tools

© 2020-2023 Tim Spann

FLaNK Weekly for 11 December 2023

 

11-December-2023

For new stuff every working day in December: https://github.com/tspannhw/FLaNK-December2023

FLaNK Stack Weekly

Tim Spann @PaaSDev

https://pebble.is/PaaSDev

https://vimeo.com/flankstack

https://www.youtube.com/@FLaNK-Stack

https://www.threads.net/@tspannhw

https://medium.com/@tspann/subscribe

Get your new Apache NiFi for Dummies!

https://www.cloudera.com/campaign/apache-nifi-for-dummies.html

https://ossinsight.io/analyze/tspannhw

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

http://www.meetup.com/futureofdata-princeton/

https://www.meetup.com/futureofdata-newyork/

https://www.meetup.com/futureofdata-philadelphia/

**This is Issue #115 **

https://github.com/tspannhw/FLiPStackWeekly

https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

https://www.cloudera.com/solutions/dim-developer.html

Project News

NiFi 2.0.0-M1 https://nifi.apache.org/project-documentation.html

https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version2.0.0-M1

NiFi 1.24 is out soon with some of the new processors from 2.0.0-M1 and some patches New Features for 1.24.0

ListenOTLP Processor for collecting OpenTelemetry EncryptContentAge and DecryptContentAge Processors supporting age-encryption.org specification YamlTreeReader for YAML as Records PackageFlowFile Processor for writing file streams and attributes as FlowFile Version 3 Migrated from H2 Database Engine to JetBrains Xodus for storing Flow Configuration History

Articles

https://medium.com/@tspann/real-time-flight-analytics-c7ad48e8005f

https://medium.com/@tspann/let-nifi-worry-about-those-stocks-for-you-57d5f16b5e6b

https://medium.com/@tspann/javacv-for-streaming-web-camera-pipelines-9768975bcd38

https://medium.com/cloudera-inc/next-generation-nifi-sneak-peak-e2deb8977adb

https://dzone.com/articles/building-a-real-time-slack-bot-with-generative-ai

https://exceptionfactory.com/posts/2023/12/04/modernizing-streaming-encryption-with-age-in-apache-nifi/

https://hackernoon.com/elevating-enterprise-llms-with-retrieval-augmented-generation-rag-and-vector-database-integration

https://community.cloudera.com/t5/Community-Articles/How-to-setup-Model-Registry-on-Cloudera-Machine-Learning/ta-p/379818

https://www.decodable.co/blog/getting-started-with-pyflink-on-kubernetes

https://www.infoworld.com/article/3711181/dont-make-apache-kafka-your-database.html

https://github.com/polyzos/advent-of-code-flink-paimon

https://media.licdn.com/dms/image/D5622AQGDXKQ67e6B4w/feedshare-shrink_1280/0/1701778966341?e=1704931200&v=beta&t=NrTQhyKKXPdBkLIm4i6N56dmgiNC64AuqR9DgMkp3kQ

https://netflixtechblog.com/2-diving-deeper-into-psyberg-stateless-vs-stateful-data-processing-1d273b3aaefb

https://dipankar-tnt.medium.com/onetable-interoperability-for-apache-hudi-iceberg-delta-lake-bb8b27dd288d

Videos

https://www.youtube.com/watch?v=psnRObquBfw&t=638s&pp=ygUJVGltIFNwYW5u

https://www.youtube.com/watch?v=FZZmGKENFMI&ab_channel=Cloudera%2CInc.

Events

On Demand https://events.dzone.com/dzone/Data-Pipelines-Investigating-the-Modern-Day-Stack?utm_bmcr_source=LinkedIn

Open Source Finance Forum. Virtual. https://resources.finos.org/znglist/osff-2023-virtual-presentations/?c=cG9zdDo5OTEzOTk%3D&utm_campaign=OSFF+NYC+2023&utm_content=269713979&utm_medium=social&utm_source=linkedin&hss_channel=lcp-18473937

December 12-14, 2023: OSACon. Online. https://osacon.io/

December 14, 2023: Flink Fast-Streaming Analytics made easy with SQL Stream Builder. Online. 12PM EST. https://attend.cloudera.com/ssb121423

April 2024: XtremeJ 2024. Virtual. https://xtremej.dev/2023/schedule/

Cloudera Events https://www.cloudera.com/about/events.html

More Events: https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

Code

NiFi Processors

Models

Tools

© 2020-2023 Tim Spann