Streaming Stories vol. 1 with Rayees Pasha of RisingWave Labs and Tim Sp...

FLiP-FLaNK Stack Weekly for 20 February 2023

 

FLiP-FLaNK Stack Weekly 20-February-2023

#apachepulsar#apacheflink#apacenifi#apachekafka

20-February-2023

FLiPN-FLaNK Stack Weekly

Welcome to the seventh newsletter of 2023. Getting closer...

Tim Spann @PaaSDev

Happy President's Day.

The new stuff in NiFi 1.20 is incredible, what is coming is unreal. I got some secret early looks at upcoming stuff and I can't wait to show at some talks in March.

https://www.timswarmercabel.com/

Upcoming talk at Spring / VMWare / Tanzu

https://tanzu.vmware.com/developer/tv/golden-path/6/

https://www.youtube.com/@VMwareTanzu

type="application/x-shockwave-flash"
wmode="transparent" width="425" height="350" />

https://youtu.be/f2HsqchP2_A

PODCAST

New podcast coming.

CODE + COMMUNITY

Join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/new-york-city-apache-pulsar-meetup/

https://www.meetup.com/futureofdata-princeton/

This is Issue #71!!

https://github.com/tspannhw/FLiPStackWeekly

https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

Meetup

http://www.meetup.com/futureofdata-princeton/

https://www.meetup.com/phillyjug/events/291103971/

New

Articles

https://blog.cloudera.com/getting-started-with-cloudera-stream-processing-community-edition/

https://www.kschaul.com/post/2023/02/16/how-the-post-is-replacing-mapbox-with-open-source-solutions/

https://policylab.rutgers.edu/report-release-garden-state-open-data-index/

https://hubertdulay.substack.com/p/stream-processing-vs-real-time-olap

Events

Feb 17, 2023: Spring One: Virtual and VoD
https://tanzu.vmware.com/developer/tv/golden-path/6/

Feb 21, 2023: Summit for Java Dev: Virtual
https://geekle.us/schedule/java23

Feb 23, 2023: Pulsar Meetup - Rising Wave + Pulsar: Virtual
https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/291048765/

March 3, 2023: Spring One: Virtual
https://tanzu.vmware.com/developer/tv/

March 8, 2023: Cloudera Now: Virtual
https://www.cloudera.com/about/events/cloudera-now-cdp.html

March 9, 2023: Hazelcast Unconference: Virtual
https://hazelcast.com/lp/unconference/

March 15, 2023: Philly JUG Meetup: Philly
[https://www.meetup.com/phillyjug/

March 16, 2023: Python Web Conference: Virtual
https://2023.pythonwebconf.com/

March 17, 2023: TCF Pro: Trenton, NJ
https://princetonacm.acm.org/tcfpro/profiles/timothy-spann.html

March 30, 2023: Pulsar Meetup - Flink: Virtual
https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/290459862/

April 4-6, 2023: DevNexus: Atlanta, GA
https://devnexus.com/

April 24-26, 2023: Real-Time Analytics Summit: San Francisco, CA
https://rtasummit.com/

May 24-25, 2023: Infoshare: Gdansk, Poland
https://infoshare.pl/conference

More Events:
https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

Tools

• https://www.screentogif.com/
• https://www.adobe.com/express/feature/video/convert/mp4-to-gif
• https://til.simonwillison.net/macos/sips

Devices

• https://github.com/tspannhw/Flow-SGP30-MLX90640/blob/main/README.md

FLiP Stack Weekly for 13 February 2023

 

13-February-2023

FLiP Stack Weekly

Welcome to the sixth newsletter of 2023. Some exciting news is coming in a few weeks.

Tim Spann @PaaSDev

Happy Super Bowl!

News!

Apache NiFi updated to 1.20! Lots of new features and processors for Box, Google Drive and more.

https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.20.0

New demo will be coming around this site.

https://www.timswarmercabel.com/

Upcoming talk at Spring / VMWare / Tanzu

https://tanzu.vmware.com/developer/tv/golden-path/6/

https://www.youtube.com/@VMwareTanzu

type="application/x-shockwave-flash"
wmode="transparent" width="425" height="350" />

https://youtu.be/f2HsqchP2_A

PODCAST

New podcast coming.

CODE + COMMUNITY

Join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/new-york-city-apache-pulsar-meetup/

https://www.meetup.com/futureofdata-princeton/

This is Issue #70!!

https://github.com/tspannhw/FLiPStackWeekly

https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

Meetup

http://www.meetup.com/futureofdata-princeton/

https://www.meetup.com/phillyjug/events/291103971/

New

Articles

https://dzone.com/articles/migration-from-amazon-sqs-and-kinesis-to-apache-ka

https://dzone.com/articles/top-three-docker-alternatives-to-consider

https://asyncq.com/how-to-make-unique-id-generator-microservice-using-spring-boot

[https://pratikbarjatya.medium.com/building-data-ingestion-system-using-apache-nifi-76e90765ac43])(https://pratikbarjatya.medium.com/building-data-ingestion-system-using-apache-nifi-76e90765ac43_

https://clickhouse.com/docs/en/integrations/nifi-and-clickhouse/

https://medium.com/@wesleynitikromo/open-source-data-tools-will-provide-a-way-out-of-your-overpriced-cloud-tools-4041bc394eb4

https://aiven.io/blog/why-you-should-think-about-moving-analytics-from-batch-to-real-time

https://www.morling.dev/blog/kafka-where-art-thou/

https://yesidays.medium.com/why-parquet-files-are-the-key-to-unlocking-big-data-analytics-fa2cf37b8b82

Events

Feb 15, 2023: Scylla Summit. Virtual
https://www.scylladb.com/scylladb-summit-2023/

Feb 16, 2023: Spring One: Virtual
https://tanzu.vmware.com/developer/tv/golden-path/6/

Feb 21, 2023: Summit for Java Dev: Virtual
https://geekle.us/schedule/java23

Feb 23, 2023: Pulsar Meetup - Rising Wave + Pulsar: Virtual
https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/291048765/

March 3, 2023: Spring One: Virtual
https://tanzu.vmware.com/developer/tv/

March 8, 2023: Cloudera Now: Virtual
https://www.cloudera.com/about/events/cloudera-now-cdp.html

March 13-17, 2023: Python Web Conference: Virtual
https://2023.pythonwebconf.com/

March 15, 2023: Philly JUG Meetup: Philly
[https://www.meetup.com/phillyjug/

March 30, 2023: Pulsar Meetup - Flink: Virtual
https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/290459862/

April 4-6, 2023: DevNexus: Atlanta, GA
https://devnexus.com/

More Events:
https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

Tools

• https://github.com/salesforce/causalai
• https://tornadovm.readthedocs.io/en/latest/introduction.html
• https://github.com/HanSolo/JDKMon
• https://linkis.apache.org/
• https://grep.app/
• http://www.jfugue.org/
• https://filmulator.org/download/
• https://github.com/heatz123/naturalspeech
• https://jaykmody.com/blog/gpt-from-scratch/
• https://www.screenstab.com/editor/
• https://www.photoprism.app/
• https://patrickcurry.com/socials/mastodon/tools/
• https://github.com/piomin/sample-spring-boot-on-kubernetes
• https://github.com/salesforce/LAVIS
• https://github.com/mvdan/sh
• https://blog.jupyter.org/introducing-the-new-jupyterlab-desktop-bca1982bdb23

Devices

• https://github.com/tspannhw/Flow-SGP30-MLX90640/blob/main/README.md

FLiP Stack Weekly for 06-Feb-2023

06-February-2023

FLiP Stack Weekly

Welcome to the fifth newsletter of 2023. Some exciting news is coming in a few weeks.

Tim Spann @PaaSDev

https://youtu.be/17jQIOVeu4s

https://youtu.be/f2HsqchP2_A

CFPs

https://pulsar.apache.org/blog/2023/02/02/pulsar-virtual-summit-europe-2023-cfp/

PODCAST

Take a look at recent podcasts in audio or video format.

https://www.buzzsprout.com/2062659/11463086-messaging-streaming-and-events-101-episode-1-of-crossing-the-streams

https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=embimpwoyt

CODE + COMMUNITY

Join my meetup group NJ/NYC/Philly/Virtual. 

https://www.meetup.com/new-york-city-apache-pulsar-meetup/

https://www.meetup.com/futureofdata-princeton/

This is Issue #69!!

https://github.com/tspannhw/FLiPStackWeekly

https://www.linkedin.com/pulse/schedule-2023-tim-spann-/

Meetup

[https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/291048765/])(https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/291048765/)

New

https://docs.streamnative.io/docs/connect-restapi

https://docs.streamnative.io/docs/functions-overview

Slides

https://www.slideshare.net/bunkertor/building-modern-data-streaming-apps-with-python

Labs / Training

https://www.youtube.com/watch?v=17jQIOVeu4s

https://spring.academy/

DIY

https://hub.docker.com/r/apache/nifi

Articles

https://streamnative.io/blog/announcing-the-streamnative-rest-api

https://streamnative.io/blog/announcing-hudi-sink-connector-for-pulsar?utmcontent=236258176&utmmedium=social&utmsource=twitter&hsschannel=tw-1058828554459205632

https://dzone.com/articles/real-time-stream-processing-with-hazelcast-and-streamnative

https://pulsar.apache.org/blog/2023/02/03/apache-pulsar-hits-its-600th-contributor/

https://www.robinlinacre.com/recommend_sql/

https://www.coinbase.com/blog/soon-for-near-real-time-data-at-coinbase-part-1?utmsource=substack&utmmedium=email

https://thenewstack.io/data-analytics-and-ai-what-will-happen-in-2023/

https://hazelcast.com/blog/real-time-stream-processing-with-hazelcast-and-streamnative/

https://www.datanami.com/2023/01/30/five-drivers-behind-the-rapid-rise-of-apache-flink/

https://medium.com/@lucas.rodriguezz/event-storming-a-technique-to-understand-complex-projects-79bacc54b7b

https://chariotsolutions.com/blog/post/avro-three-ways/

Tools

• https://github.com/MuhammadMoinFaisal/yolov7-segmentation-with-DeepSORT-Tracking
• https://piotrminkowski.com/2023/01/30/useful-unknown-java-libraries/
• https://duckdb.org/
• https://github.com/mpociot/chatgpt-vscode
• https://hubzilla.org//page/hubzilla/hubzilla-project
• https://github.com/localsend/localsend
• https://www.infoq.com/news/2023/01/kubernetes-java-client/
• https://github.com/Darginec05/Yopta-Editor
• https://research.exoticsilicon.com/articles/console_screendumps
• https://markojs.com/
• https://github.com/rinongal/textual_inversion
• https://www.ivpn.net/apps-ios/
• https://github.com/hashicorp-forge/hermes
• https://dekorate.io/docs/get-started/
• https://github.com/benchkram/bob
• https://www.cloudquery.io/docs/quickstart/macOS
• https://github.com/antonmedv/llama
• https://github.com/bootandy/dust
• https://github.com/lucidrains/musiclm-pytorch
• https://just.maciejwalkowiak.com/
• https://www.brow.sh/
• https://maxlab.io/store/edge-ai-camera/
• https://github.com/jomjol/AI-on-the-edge-device
• https://github.com/jmforsythe/Git-Heat-Map
• https://www.arecadata.com/analyzing-imessage-data-with-duckdb/
• https://github.com/arc53/docsgpt
• https://github.com/BurhanUlTayyab/DetectGPT
• https://github.com/mikefarah/yq
• https://github.com/bigscience-workshop/petals
• https://github.com/LAION-AI/Open-Assistant
• https://rolisz.ro/2023/02/02/making-a-loudness-monitor/
• https://www.jinq.org/
• https://github.com/abb128/LiveCaptions

Devices

• https://www.sparkfun.com/products/21231

Tutorials

• https://www.risingwave.dev/docs/current/create-source-pulsar/
• https://serverlessland.com/event-driven-architecture/visuals/message-translator-pattern

 

FLiP Stack Weekly 28 Jan 2023

FLiP Stack Weekly

Welcome to the fourth newsletter of 2023.

Tim Spann @PaaSDev

Get some training

https://www.eventbrite.com/e/practical-apache-pulsar-application-development-by-streamnative-tickets-522950859097

PODCAST

Take a look at recent podcasts in audio or video format.

https://www.buzzsprout.com/2062659/11463086-messaging-streaming-and-events-101-episode-1-of-crossing-the-streams

https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=emb_imp_woyt

CODE + COMMUNITY

Join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/new-york-city-apache-pulsar-meetup/

This is Issue #68!!

https://github.com/tspannhw/FLiPStackWeekly

https://www.linkedin.com/pulse/2022-schedule-tim-spann

Code

https://github.com/tspannhw/streamnative-rest-stocks

https://github.com/tspannhw/AppsList

https://github.com/tspannhw/create-nifi-pulsar-flink-apps

https://github.com/tspannhw/pulsar-mastodon-sink

https://github.com/tspannhw/FLiPN-Py-Stocks

Slides

https://www.infoq.com/presentations/silo-systems-streaming-data/

https://www.infoq.com/presentations/building-high-fidelity-data-streams

Labs

https://github.com/pdefusco/CML_MLOps_ACE_HOL

Articles

https://dzone.com/articles/real-time-stream-processing-with-hazelcast-and-streamnative

https://medium.com/@tspann/real-time-stream-processing-with-hazelcast-and-apache-pulsar-2d27c8332f87

https://medium.com/@tspann/real-time-stream-processing-with-hazelcast-and-apache-pulsar-2d27c8332f87

https://dzone.com/articles/how-to-create-a-real-time-scalable-streaming-app-u

https://www.jetbrains.com/lp/devecosystem-2022/

https://betterprogramming.pub/pragmatic-event-sourcing-8e929a56997e

https://funnifi.blogspot.com/2023/01/curling-secure-apache-nifi-rest-api.html?spref=tw

https://about.scarf.sh/post/the-open-source-business-metrics-guide

https://www.infoq.com/podcasts/ai-ml-data-engineering-trends-report-2022/

https://blogs.oracle.com/javamagazine/post/java-visrec-api-for-machine-learning

https://medium.com/cloudera-inc/consume-slacks-events-api-with-cloudera-flow-management-49fed7c2a531

https://medium.com/@nifi.notes/building-an-effective-nifi-flow-partitionrecord-b342a8efc50c

Tools

• https://canarytokens.org/generate
• https://vikunja.io/
• https://redpanda.com/blog/what-is-cdc
• https://github.com/brycedrennan/imaginAIry/blob/master/README.md
• https://thenewstack.io/the-architects-guide-to-data-and-file-formats/
• https://github.com/lavie/runlike
• https://offsec.tools/
• https://github.com/DaveJarvis/keenwrite
• https://marp.app/#get-started
• https://github.com/SigNoz/logs-benchmark
• https://github.com/adityaathalye/shite
• https://acronym-generator.com/index.php
• https://www.patterns.app/blog/2023/01/18/crunchbot-sql-analyst-gpt/
• https://open-journey.github.io/
• https://github.com/helloSystem/hello
• https://github.com/automatisch/automatisch
• https://muffinterm.app/
• https://pandoc.org/installing.html
• https://github.com/tinystacks/precloud
• https://github.com/google-research/kubric
• https://github.com/dylanjcastillo/shell-genie
• https://maxbittker.github.io/broider/
• https://github.com/fathyb/carbonyl
• https://github.com/anderspitman/SirTunnel
• https://github.com/benrutter/clamshell

https://medium.com/@tspann/pulsarflip-stack-weekly-28-jan-2023-e7fa331a4ea5