FLiPN-FLaNK Stack Weekly for March 6, 2023

 https://www.linkedin.com/pulse/flipn-flank-stack-weekly-6-march-2023-tim-spann-/?published=t

FLiPN-FLaNK Stack Weekly

Welcome to the nineth newsletter of 2023.

Tim Spann @PaaSDev

I have rejoined Cloudera as a Principal Developer Advocate to move forward open source streaming with Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Pulsar and more. I will also be showing you some really cool new DataFlow pipelines. This is just the tip of the Iceberg.

https://www.timswarmercabel.com/

https://www.youtube.com/@VMwareTanzu

<iframe width="560" height="315" src="https://www.youtube.com/embed/f2HsqchP2_A" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>

https://youtu.be/f2HsqchP2_A

PODCAST

New podcast coming.

CODE + COMMUNITY

Join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/new-york-city-apache-pulsar-meetup/

https://www.meetup.com/futureofdata-princeton/

This is Issue #73

https://github.com/tspannhw/FLiPStackWeekly

https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

Meetup

http://www.meetup.com/futureofdata-princeton/

https://www.meetup.com/phillyjug/events/291103971/

Videos

https://youtu.be/5lFXI5333mg

Articles

https://community.cloudera.com/t5/What-s-New-Cloudera/Open-Sourcing-Cloudera-s-ML-Runtimes-why-it-matters-to/ba-p/364478

https://community.cloudera.com/t5/Community-Articles/Event-driven-pipelines-in-Azure-with-CDE-Cloudera-Data/ta-p/346903

https://bravenewgeek.com/you-cannot-have-exactly-once-delivery/

https://www.kaggle.com/datasets/crawford/cat-dataset

https://www.kai-waehner.de/blog/2023/03/02/message-broker-and-apache-kafka-trade-offs-integration-migration

https://softwaremill.com/is-it-time-to-exit-the-cloud/

https://dzone.com/articles/high-throughput-vs-low-latency-in-data-writing-a-w

https://medium.com/everything-full-stack/how-to-design-your-event-streams-part-1-ffc5600e81f4

https://medium.com/event-driven-utopia/the-duality-of-streams-and-tables-why-it-matters-ed9bb17e7505

https://missing.csail.mit.edu/2020/shell-tools/

https://dev.java/

https://hubertdulay.substack.com/p/hybrid-transactional-and-analytical

https://www.cloudera.com/campaign/gartner-critical-capabilities-for-cloud-database-management-systems-for-analytical-use-cases-2022.html?es_id=0d70e2dff0

https://techlake.dev/apache-flink-101-understanding-the-architecture

https://mystery.knightlab.com/

https://thenewstack.io/is-webassembly-really-the-future/

Events

March 8, 2023: Cloudera Now: Virtual https://www.cloudera.com/about/events/cloudera-now-cdp.html

March 9, 2023: Hazelcast Unconference: Virtual https://hazelcast.com/lp/unconference/

March 9, 2023: Conf42: Python: Virtual https://www.conf42.com/python2023

https://www.linkedin.com/posts/conf42_conf42-conference-online-activity-7033769299492122624-gsir/?utm_source=share&utm_medium=member_ios

March 15, 2023: Philly JUG Meetup: Philly [https://www.meetup.com/phillyjug/

March 16, 2023: Python Web Conference: Virtual https://2023.pythonwebconf.com/

March 17, 2023: TCF Pro: Trenton, NJ https://princetonacm.acm.org/tcfpro/profiles/timothy-spann.html

March 30, 2023: Pulsar Meetup - Flink: Virtual https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/290459862/

April 4-6, 2023: DevNexus: Atlanta, GA https://devnexus.com/

April 24-26, 2023: Real-Time Analytics Summit: San Francisco, CA https://rtasummit.com/

May 9, 2023: Garden State Java User Group. In-Person. New Jersey https://gsjug.org/

https://www.cloudera.com/about/events.html

More Events: https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

Code

https://github.com/cloudera/ml-runtimes

Tools

https://docs.triggermesh.io/1.24/

https://hackerfm.com/index

https://jemarch.net/poke

https://github.com/bitjson/qr-code

https://qr.bitjson.com/

https://github.com/inqueryio/inquery

https://github.com/matiaskorhonen/paper-age

https://www.cloudquery.io/

https://www.darlinghq.org/

https://vimium.github.io/

https://github.com/quixio/quix-streams

https://github.com/flashohq/flasho

https://github.com/oobabooga/text-generation-webui

https://github.com/openai/openai-python/blob/main/chatml.md

https://github.com/microsoft/unilm/blob/master/edgelm/README.md

https://github.com/jepsen-io/maelstrom

https://memphis.dev/

https://www.iconhunt.site/

https://www.lazarus-ide.org/

https://github.com/tlepple/data_origination_workshop

https://github.com/diffplug/spotless

https://github.com/rajeshroy402/DeepStream-dGPU-Installation/tree/20.04-6.1

https://github.com/danthelion/talksheet

https://wasmedge.org/

https://www.bryanbraun.com/after-dark-css/all/flying-toasters.html

https://wasmer.io/

Streaming Stories vol. 1 with Rayees Pasha of RisingWave Labs and Tim Sp...

FLiP-FLaNK Stack Weekly for 20 February 2023

 

FLiP-FLaNK Stack Weekly 20-February-2023

#apachepulsar#apacheflink#apacenifi#apachekafka

20-February-2023

FLiPN-FLaNK Stack Weekly

Welcome to the seventh newsletter of 2023. Getting closer...

Tim Spann @PaaSDev

Happy President's Day.

The new stuff in NiFi 1.20 is incredible, what is coming is unreal. I got some secret early looks at upcoming stuff and I can't wait to show at some talks in March.

https://www.timswarmercabel.com/

Upcoming talk at Spring / VMWare / Tanzu

https://tanzu.vmware.com/developer/tv/golden-path/6/

https://www.youtube.com/@VMwareTanzu

type="application/x-shockwave-flash"
wmode="transparent" width="425" height="350" />

https://youtu.be/f2HsqchP2_A

PODCAST

New podcast coming.

CODE + COMMUNITY

Join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/new-york-city-apache-pulsar-meetup/

https://www.meetup.com/futureofdata-princeton/

This is Issue #71!!

https://github.com/tspannhw/FLiPStackWeekly

https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

Meetup

http://www.meetup.com/futureofdata-princeton/

https://www.meetup.com/phillyjug/events/291103971/

New

Articles

https://blog.cloudera.com/getting-started-with-cloudera-stream-processing-community-edition/

https://www.kschaul.com/post/2023/02/16/how-the-post-is-replacing-mapbox-with-open-source-solutions/

https://policylab.rutgers.edu/report-release-garden-state-open-data-index/

https://hubertdulay.substack.com/p/stream-processing-vs-real-time-olap

Events

Feb 17, 2023: Spring One: Virtual and VoD
https://tanzu.vmware.com/developer/tv/golden-path/6/

Feb 21, 2023: Summit for Java Dev: Virtual
https://geekle.us/schedule/java23

Feb 23, 2023: Pulsar Meetup - Rising Wave + Pulsar: Virtual
https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/291048765/

March 3, 2023: Spring One: Virtual
https://tanzu.vmware.com/developer/tv/

March 8, 2023: Cloudera Now: Virtual
https://www.cloudera.com/about/events/cloudera-now-cdp.html

March 9, 2023: Hazelcast Unconference: Virtual
https://hazelcast.com/lp/unconference/

March 15, 2023: Philly JUG Meetup: Philly
[https://www.meetup.com/phillyjug/

March 16, 2023: Python Web Conference: Virtual
https://2023.pythonwebconf.com/

March 17, 2023: TCF Pro: Trenton, NJ
https://princetonacm.acm.org/tcfpro/profiles/timothy-spann.html

March 30, 2023: Pulsar Meetup - Flink: Virtual
https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/290459862/

April 4-6, 2023: DevNexus: Atlanta, GA
https://devnexus.com/

April 24-26, 2023: Real-Time Analytics Summit: San Francisco, CA
https://rtasummit.com/

May 24-25, 2023: Infoshare: Gdansk, Poland
https://infoshare.pl/conference

More Events:
https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

Tools

• https://www.screentogif.com/
• https://www.adobe.com/express/feature/video/convert/mp4-to-gif
• https://til.simonwillison.net/macos/sips

Devices

• https://github.com/tspannhw/Flow-SGP30-MLX90640/blob/main/README.md

FLiP Stack Weekly for 13 February 2023

 

13-February-2023

FLiP Stack Weekly

Welcome to the sixth newsletter of 2023. Some exciting news is coming in a few weeks.

Tim Spann @PaaSDev

Happy Super Bowl!

News!

Apache NiFi updated to 1.20! Lots of new features and processors for Box, Google Drive and more.

https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.20.0

New demo will be coming around this site.

https://www.timswarmercabel.com/

Upcoming talk at Spring / VMWare / Tanzu

https://tanzu.vmware.com/developer/tv/golden-path/6/

https://www.youtube.com/@VMwareTanzu

type="application/x-shockwave-flash"
wmode="transparent" width="425" height="350" />

https://youtu.be/f2HsqchP2_A

PODCAST

New podcast coming.

CODE + COMMUNITY

Join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/new-york-city-apache-pulsar-meetup/

https://www.meetup.com/futureofdata-princeton/

This is Issue #70!!

https://github.com/tspannhw/FLiPStackWeekly

https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

Meetup

http://www.meetup.com/futureofdata-princeton/

https://www.meetup.com/phillyjug/events/291103971/

New

Articles

https://dzone.com/articles/migration-from-amazon-sqs-and-kinesis-to-apache-ka

https://dzone.com/articles/top-three-docker-alternatives-to-consider

https://asyncq.com/how-to-make-unique-id-generator-microservice-using-spring-boot

[https://pratikbarjatya.medium.com/building-data-ingestion-system-using-apache-nifi-76e90765ac43])(https://pratikbarjatya.medium.com/building-data-ingestion-system-using-apache-nifi-76e90765ac43_

https://clickhouse.com/docs/en/integrations/nifi-and-clickhouse/

https://medium.com/@wesleynitikromo/open-source-data-tools-will-provide-a-way-out-of-your-overpriced-cloud-tools-4041bc394eb4

https://aiven.io/blog/why-you-should-think-about-moving-analytics-from-batch-to-real-time

https://www.morling.dev/blog/kafka-where-art-thou/

https://yesidays.medium.com/why-parquet-files-are-the-key-to-unlocking-big-data-analytics-fa2cf37b8b82

Events

Feb 15, 2023: Scylla Summit. Virtual
https://www.scylladb.com/scylladb-summit-2023/

Feb 16, 2023: Spring One: Virtual
https://tanzu.vmware.com/developer/tv/golden-path/6/

Feb 21, 2023: Summit for Java Dev: Virtual
https://geekle.us/schedule/java23

Feb 23, 2023: Pulsar Meetup - Rising Wave + Pulsar: Virtual
https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/291048765/

March 3, 2023: Spring One: Virtual
https://tanzu.vmware.com/developer/tv/

March 8, 2023: Cloudera Now: Virtual
https://www.cloudera.com/about/events/cloudera-now-cdp.html

March 13-17, 2023: Python Web Conference: Virtual
https://2023.pythonwebconf.com/

March 15, 2023: Philly JUG Meetup: Philly
[https://www.meetup.com/phillyjug/

March 30, 2023: Pulsar Meetup - Flink: Virtual
https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/290459862/

April 4-6, 2023: DevNexus: Atlanta, GA
https://devnexus.com/

More Events:
https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

Tools

• https://github.com/salesforce/causalai
• https://tornadovm.readthedocs.io/en/latest/introduction.html
• https://github.com/HanSolo/JDKMon
• https://linkis.apache.org/
• https://grep.app/
• http://www.jfugue.org/
• https://filmulator.org/download/
• https://github.com/heatz123/naturalspeech
• https://jaykmody.com/blog/gpt-from-scratch/
• https://www.screenstab.com/editor/
• https://www.photoprism.app/
• https://patrickcurry.com/socials/mastodon/tools/
• https://github.com/piomin/sample-spring-boot-on-kubernetes
• https://github.com/salesforce/LAVIS
• https://github.com/mvdan/sh
• https://blog.jupyter.org/introducing-the-new-jupyterlab-desktop-bca1982bdb23

Devices

• https://github.com/tspannhw/Flow-SGP30-MLX90640/blob/main/README.md

FLiP Stack Weekly for 06-Feb-2023

06-February-2023

FLiP Stack Weekly

Welcome to the fifth newsletter of 2023. Some exciting news is coming in a few weeks.

Tim Spann @PaaSDev

https://youtu.be/17jQIOVeu4s

https://youtu.be/f2HsqchP2_A

CFPs

https://pulsar.apache.org/blog/2023/02/02/pulsar-virtual-summit-europe-2023-cfp/

PODCAST

Take a look at recent podcasts in audio or video format.

https://www.buzzsprout.com/2062659/11463086-messaging-streaming-and-events-101-episode-1-of-crossing-the-streams

https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=embimpwoyt

CODE + COMMUNITY

Join my meetup group NJ/NYC/Philly/Virtual. 

https://www.meetup.com/new-york-city-apache-pulsar-meetup/

https://www.meetup.com/futureofdata-princeton/

This is Issue #69!!

https://github.com/tspannhw/FLiPStackWeekly

https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

Meetup

[https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/291048765/])(https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/291048765/)

New

https://docs.streamnative.io/docs/connect-restapi

https://docs.streamnative.io/docs/functions-overview

Slides

https://www.slideshare.net/bunkertor/building-modern-data-streaming-apps-with-python

Labs / Training

https://www.youtube.com/watch?v=17jQIOVeu4s

https://spring.academy/

DIY

https://hub.docker.com/r/apache/nifi

Articles

https://streamnative.io/blog/announcing-the-streamnative-rest-api

https://streamnative.io/blog/announcing-hudi-sink-connector-for-pulsar?utmcontent=236258176&utmmedium=social&utmsource=twitter&hsschannel=tw-1058828554459205632

https://dzone.com/articles/real-time-stream-processing-with-hazelcast-and-streamnative

https://pulsar.apache.org/blog/2023/02/03/apache-pulsar-hits-its-600th-contributor/

https://www.robinlinacre.com/recommend_sql/

https://www.coinbase.com/blog/soon-for-near-real-time-data-at-coinbase-part-1?utmsource=substack&utmmedium=email

https://thenewstack.io/data-analytics-and-ai-what-will-happen-in-2023/

https://hazelcast.com/blog/real-time-stream-processing-with-hazelcast-and-streamnative/

https://www.datanami.com/2023/01/30/five-drivers-behind-the-rapid-rise-of-apache-flink/

https://medium.com/@lucas.rodriguezz/event-storming-a-technique-to-understand-complex-projects-79bacc54b7b

https://chariotsolutions.com/blog/post/avro-three-ways/

Tools

• https://github.com/MuhammadMoinFaisal/yolov7-segmentation-with-DeepSORT-Tracking
• https://piotrminkowski.com/2023/01/30/useful-unknown-java-libraries/
• https://duckdb.org/
• https://github.com/mpociot/chatgpt-vscode
• https://hubzilla.org//page/hubzilla/hubzilla-project
• https://github.com/localsend/localsend
• https://www.infoq.com/news/2023/01/kubernetes-java-client/
• https://github.com/Darginec05/Yopta-Editor
• https://research.exoticsilicon.com/articles/console_screendumps
• https://markojs.com/
• https://github.com/rinongal/textual_inversion
• https://www.ivpn.net/apps-ios/
• https://github.com/hashicorp-forge/hermes
• https://dekorate.io/docs/get-started/
• https://github.com/benchkram/bob
• https://www.cloudquery.io/docs/quickstart/macOS
• https://github.com/antonmedv/llama
• https://github.com/bootandy/dust
• https://github.com/lucidrains/musiclm-pytorch
• https://just.maciejwalkowiak.com/
• https://www.brow.sh/
• https://maxlab.io/store/edge-ai-camera/
• https://github.com/jomjol/AI-on-the-edge-device
• https://github.com/jmforsythe/Git-Heat-Map
• https://www.arecadata.com/analyzing-imessage-data-with-duckdb/
• https://github.com/arc53/docsgpt
• https://github.com/BurhanUlTayyab/DetectGPT
• https://github.com/mikefarah/yq
• https://github.com/bigscience-workshop/petals
• https://github.com/LAION-AI/Open-Assistant
• https://rolisz.ro/2023/02/02/making-a-loudness-monitor/
• https://www.jinq.org/
• https://github.com/abb128/LiveCaptions

Devices

• https://www.sparkfun.com/products/21231

Tutorials

• https://www.risingwave.dev/docs/current/create-source-pulsar/
• https://serverlessland.com/event-driven-architecture/visuals/message-translator-pattern