Building Streaming Applications with Cloudera SQL Stream Builder and Apache Pulsar

 Cloudera CSP CE Plus Apache Pulsar

Integration

Once running in docker

http://localhost:18121/ui/login

Login

admin/admin

SQL Testing


CREATE TABLE pulsar_test (
  `city` STRING
) WITH (
  'connector' = 'pulsar',
  'topic' = 'topic82547611',
  'value.format' = 'raw',
  'service-url' = 'pulsar://Timothys-MBP:6650',
  'admin-url' = 'http://Timothys-MBP:8080',
  'scan.startup.mode' = 'earliest',
  'generic' = 'true'
);

CREATE TABLE  `pulsar_table_1670269295` (
  `col_str` STRING,
  `col_int` INT,
  `col_ts` TIMESTAMP(3),
   WATERMARK FOR `col_ts` AS col_ts - INTERVAL '5' SECOND
) WITH (
  'format' = 'json' -- Data format
  -- 'json.encode.decimal-as-plain-number' = 'false' -- Optional flag to specify whether to encode all decimals as plain numbers instead of possible scientific notations, false by default.
  -- 'json.fail-on-missing-field' = 'false' -- Optional flag to specify whether to fail if a field is missing or not, false by default.
  -- 'json.ignore-parse-errors' = 'false' -- Optional flag to skip fields and rows with parse errors instead of failing; fields are set to null in case of errors, false by default.
  -- 'json.map-null-key.literal' = 'null' -- Optional flag to specify string literal for null keys when 'map-null-key.mode' is LITERAL, \"null\" by default.
  -- 'json.map-null-key.mode' = 'FAIL' -- Optional flag to control the handling mode when serializing null key for map data, FAIL by default. Option DROP will drop null key entries for map data. Option LITERAL will use 'map-null-key.literal' as key literal.
  -- 'json.timestamp-format.standard' = 'SQL' -- Optional flag to specify timestamp format, SQL by default. Option ISO-8601 will parse input timestamp in \"yyyy-MM-ddTHH:mm:ss.s{precision}\" format and output timestamp in the same format. Option SQL will parse input timestamp in \"yyyy-MM-dd HH:mm:ss.s{precision}\" format and output timestamp in the same format.
);


CREATE TABLE pulsar_citibikenyc (
	`num_docks_disabled` DOUBLE,
	`eightd_has_available_keys` STRING,
	`station_status` STRING,
	`last_reported` DOUBLE,
	`is_installed` DOUBLE,
	`num_ebikes_available` DOUBLE,
	`num_bikes_available` DOUBLE,
	`station_id` DOUBLE,
	`is_renting` DOUBLE,
	`is_returning` DOUBLE,
	`num_docks_available` DOUBLE,
	`num_bikes_disabled` DOUBLE,
	`legacy_id` DOUBLE,
	`valet` STRING,
	`eightd_active_station_services` STRING,
	`ts` DOUBLE,
	`uuid` STRING
) WITH (
  'connector' = 'pulsar',
  'topic' = 'persistent://public/default/citibikenyc',
  'value.format' = 'json',
  'service-url' = 'pulsar://Timothys-MBP:6650',
  'admin-url' = 'http://Timothys-MBP:8080',
  'scan.startup.mode' = 'earliest',
  'generic' = 'true'
);

CREATE TABLE pulsar_thermalsensors (
  `uuid` STRING NOT NULL,
  `ipaddress` STRING NOT NULL,
  `cputempf` INT NOT NULL,
  `runtime` INT NOT NULL,
  `host` STRING NOT NULL,
  `hostname` STRING NOT NULL,
  `macaddress` STRING NOT NULL,
  `endtime` STRING NOT NULL,
  `te` STRING NOT NULL,
  `cpu` FLOAT NOT NULL,
  `diskusage` STRING NOT NULL,
  `memory` FLOAT NOT NULL,
  `rowid` STRING NOT NULL,
  `systemtime` STRING NOT NULL,
  `ts` INT NOT NULL,
  `starttime` STRING NOT NULL,
  `datetimestamp` STRING NOT NULL,
  `temperature` FLOAT NOT NULL,
  `humidity` FLOAT NOT NULL,
  `co2` FLOAT NOT NULL,
  `totalvocppb` FLOAT NOT NULL,
  `equivalentco2ppm` FLOAT NOT NULL,
  `pressure` FLOAT NOT NULL,
  `temperatureicp` FLOAT NOT NULL
) WITH (

  'connector' = 'pulsar',
  'topic' = 'persistent://public/default/thermalsensors',
  'value.format' = 'json',
  'service-url' = 'pulsar://Timothys-MBP:6650',
  'admin-url' = 'http://Timothys-MBP:8080',
  'scan.startup.mode' = 'earliest',
  'generic' = 'true'
)


CREATE TABLE  fake_data (
city STRING )
WITH (
'connector' = 'faker',
'rows-per-second' = '1',
'fields.city.expression' = '#{Address.city}'
);

insert into pulsar_test
select * from fake_data;


select last_reported, num_bikes_available, station_id, num_docks_available, ts
from 
pulsar_citibikenyc;

select `systemtime`, `cputempf`, `cpu`, `humidity`, `co2`, `temperature`, `totalvocppb`, `equivalentco2ppm`, `pressure`, `temperatureicp`  
from  pulsar_thermalsensors

Create a Materialized View

http://localhost:18131/api/v1/query/5202/thermal?key=c674a39b-921a-4759-a2fb-e599366cfe51

/api/v1/query/5202/thermal?key=c674a39b-921a-4759-a2fb-e599366cfe51

Running SQL Stream Builder (Flink SQL) against Pulsar

image

image

image

image

image

image

image

image

image

image

image

image

image

image

image

image

image

Containers Running Cloudera CSP CE in Docker

image

References

Meetup

https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289674210/

TigerLabs in Princeton on the 2nd floor, walk up and the door will be open. Same that we were using for the old Future of Data - Princeton events 2016-2019. Parking at the school is free. street parking nearby is free. there are meters on some streets and a few blocks away is a paid parking garage. We are joining forces with our friends Cloudera again on a FLiPN amazing journey into Real-Time Streaming Applications with Apache Flink, Apache NiFi, and Apache Pulsar. Discover how to stream data to and from your data lake or data mart using Apache Pulsar™ and Apache NiFi®. Learn how these cloud-native, scalable open-source projects built for streaming data pipelines work together to enable you to quickly build applications with minimal coding.

  • Apache NiFi
  • Apache Pulsar
  • Apache Flink
  • Flink SQL

We will show you how to build apps, so download beforehand to Docker, K8, your Laptop, or the cloud.

|AGENDA|

  • 6:00 - 6:30 PM EST: Food, Drink, and Networking!!!
  • 6:30 - 7:15 PM EST: Presentation - Tim Spann, StreamNative Developer Advocate
  • 7:15 - 8:00 PM EST: Presentation - John Kuchmek, Cloudera Principal Solutions Engineer
  • 8:00 - 8:30 PM EST: Round Table on Real-Time Streaming
  • 8:30 - 9:00 PM EST: Q&A + Networking

|ABOUT THE SPEAKERS|

John Kuchmek is a Principal Solutions Engineer for Cloudera. Before joining Cloudera, John transitioned to the Autonomous Intelligence team where he was in charge of integrating the platforms to allow data scientists to work with various types of data.

Tim Spann is a Developer Advocate for StreamNative. He works with StreamNative Cloud, Apache Pulsar™, Apache Flink®, Flink® SQL, Big Data, the IoT, machine learning, and deep learning. Tim has over a decade of experience with the IoT, big data, distributed computing, messaging, streaming technologies, and Java programming.

See:

December 5, 2022: FLiP Stack Weekly

 


December 5, 2022

FLiP Stack Weekly

A few good talks and some cool stuff for the rest of the year.

Check out our channel:

https://www.youtube.com/@streamnativecommunity8124/featured

New Stuff

https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.19.0

A quick preview of Apache Pulsar + Apache Pinot.

Arch




type="application/x-shockwave-flash"
wmode="transparent" width="425" height="350" />

https://youtu.be/KMbTlmoDXXA

https://github.com/tspannhw/pulsar-thermal-pinot

PODCAST

Take a look at recent podcasts in audio or video format.

https://www.buzzsprout.com/2062659/11463086-messaging-streaming-and-events-101-episode-1-of-crossing-the-streams

https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=emb_imp_woyt

CODE + COMMUNITY

Join my meetup group NJ/NYC/Philly/Virtual. We will have a hybrid event on December 8th.

https://www.meetup.com/new-york-city-apache-pulsar-meetup/

This is Issue #61!!

https://github.com/tspannhw/FLiPStackWeekly

https://www.linkedin.com/pulse/2022-schedule-tim-spann

VIDEOS

https://youtu.be/7Yih40Gcr-w

https://youtu.be/y6kbRZae4TI




type="application/x-shockwave-flash"
wmode="transparent" width="425" height="350" />

https://www.youtube.com/embed/yU3UVhLz1Io




type="application/x-shockwave-flash"
wmode="transparent" width="425" height="350" />

https://www.youtube.com/watch?v=346PAVtrJNE




type="application/x-shockwave-flash"
wmode="transparent" width="425" height="350" />

https://www.youtube.com/watch?v=C684XAivnqg




type="application/x-shockwave-flash"
wmode="transparent" width="425" height="350" />

https://www.youtube.com/watch?v=mAKAP71JfQs




type="application/x-shockwave-flash"
wmode="transparent" width="425" height="350" />

ARTICLES

Cool award winners and friends: Apache Pulsar, Apache Iceberg, Starburst, Cloudera Data Platform, Apache Flink, Nvidia Jetson AGX Orin, Delta Lake, Databricks, Redis.

https://www.hpcwire.com/off-the-wire/bigdatawire-formerly-datanami-reveals-winners-of-2022-readers-and-editors-choice-awards/

https://streamnative.io/blog/community/2022-12-01-pulsar-summit-asia-2022-recap/

https://betterprogramming.pub/going-native-with-spring-boot-3-ga-4e8d91ab21d3

https://github.com/riferrei/devrel-mastodon

https://streamnative.io/blog/engineering/2022-11-29-spring-into-pulsar-part-2-spring-based-microservices-for-multiple-protocols-with-apache-pulsar/

https://www.ververica.com/blog/the-release-of-flink-cdc-2.3

https://inlong.apache.org/docs/quick_start/pulsar_example

TALKS

https://www.slideshare.net/bunkertor/machine-intelligence-guild-build-ml-enhanced-event-streaming-applications-with-java-and-python-microservices

https://www.meetup.com/real-time-analytics-meetup-ny/events/290037437/

TRAINING

Dates are Dec 5 - Dec 8, 2022

Link to register: https://www.eventbrite.com/e/463731161387

Dates are January 17 - 19, 2023 from 2pm - 5pm CET / 8am - 12pm EST
Link to register: https://www.eventbrite.com/e/465055021087

https://streamnative.io/training/

CODE

https://github.com/timeplus-io/pulsar-io-sink

https://github.com/spring-projects/spring-aot-smoke-tests/tree/main/integration/spring-pulsar

https://github.com/streamnative/psat_exercise_code

EVENTS

Dec 8, 2022: Open Source Summit Finance NYC

https://events.linuxfoundation.org/open-source-finance-forum-new-york/

Dec 14, 2022: Manhattan, NYC: Pulsar + Pinot Meetup

https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289817171/

Dec 15, 2022: TigerLabs, Princeton, NJ: Pulsar + NiFi + Flink Meetup

https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289674210/

Data Science Camp Online

https://dscamp.org/

Machine Intelligence Guild

HTAP Summit

Coming soon.

Pinot / Pulsar Meetup

Coming soon.

CockroachDB NYC Meetup

Hazelcast Event

https://docs.hazelcast.com/hazelcast/5.1/integrate/pulsar-connector

TOOLS

TIPS


pip3.9 install 'pulsar-client[all]'

Google Sheet Hack!   Import Any RSS Feed to a Sheet

=ImportFeed("http://example.com/feed")


`

JOBS

https://jobs.lever.co/stream-native/74d75fc1-1ad7-40a0-b907-66d8ac86009a

FLiP Stack Weekly - Nov 28, 2022

 

November 28, 2022

FLiP Stack Weekly

More talks coming this month! Join Tim around the virtual world at various conferences.

A quick preview of Apache Pulsar + Apache Pinot.

Arch

https://youtu.be/KMbTlmoDXXA

https://github.com/tspannhw/pulsar-thermal-pinot

Podcast

Take a look at recent podcasts in audio or video format.

https://www.buzzsprout.com/2062659/11463086-messaging-streaming-and-events-101-episode-1-of-crossing-the-streams

https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=embimpwoyt

CODE + COMMUNITY

Join my meetup group NJ/NYC/Philly/Virtual. We will have a hybrid event on December 8th.

https://www.meetup.com/new-york-city-apache-pulsar-meetup/

This is Issue #60!!

https://github.com/tspannhw/FLiPStackWeekly

https://www.linkedin.com/pulse/2022-schedule-tim-spann

Videos

ARTICLES

https://betterprogramming.pub/going-native-with-spring-boot-3-ga-4e8d91ab21d3

https://github.com/riferrei/devrel-mastodon

TRAINING

Dates are Dec 5 - Dec 8, 2022

Link to register: https://www.eventbrite.com/e/463731161387

Dates are January 17 - 19, 2023 from 2pm - 5pm CET / 8am - 12pm EST Link to register: https://www.eventbrite.com/e/465055021087

https://streamnative.io/training/

EVENTS

Nov 29, 2022: Machine Intelligence Guild Speaker of the Month. Virtual.

Dec 8, 2022: Open Source Summit Finance NYC

https://events.linuxfoundation.org/open-source-finance-forum-new-york/

Dec 14, 2022: Manhattan, NYC: Pulsar + Pinot Meetup

https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289817171/

Dec 15, 2022: TigerLabs, Princeton, NJ: Pulsar + NiFi + Flink Meetup

https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289674210/

Data Science Camp Online

https://dscamp.org/

Machine Intelligence Guild

HTAP Summit

Coming soon.

Pinot / Pulsar Meetup

Coming soon.

CockroachDB NYC Meetup

Hazelcast Event

https://docs.hazelcast.com/hazelcast/5.1/integrate/pulsar-connector

TOOLS

November 15-19, 2022 FLiP Stack Weekly

 # November 15-19, 2022 FLiP Stack Weekly



#### More talks coming this month!   Join Tim around the virtual world at various conferences.   



![MerryChristmas](https://github.com/tspannhw/FLiPStackWeekly/raw/main/images/merrychristmasflipstack.jpg)



### Podcast


Take a look at recent podcasts in audio or video format.


[https://www.buzzsprout.com/2062659/11463086-messaging-streaming-and-events-101-episode-1-of-crossing-the-streams](https://www.buzzsprout.com/2062659/11463086-messaging-streaming-and-events-101-episode-1-of-crossing-the-streams)


[https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=emb_imp_woyt](https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=emb_imp_woyt)


### CODE + COMMUNITY



Join my meetup group NJ/NYC/Philly/Virtual.   We will have a hybrid event on December 8th.


[https://www.meetup.com/new-york-city-apache-pulsar-meetup/](https://www.meetup.com/new-york-city-apache-pulsar-meetup/

)


**This is Issue #58!!**


[https://github.com/tspannhw/FLiPStackWeekly](https://github.com/tspannhw/FLiPStackWeekly)


[https://www.linkedin.com/pulse/2022-schedule-tim-spann](https://www.linkedin.com/pulse/2022-schedule-tim-spann)



#### Upcoming Events


I’ll be speaking at #PulsarSummit Asia 2022! Join the #ApachePulsar community and RSVP for the webinar: https://streamnative.zoom.us/webinar/register/8516668631400/WN_qKibcbEFTxKv6-MszyFeAg.


![Pulsar 101](https://github.com/tspannhw/FLiPStackWeekly/raw/main/images/Timothy%20Spann%20101.jpg)


*.  


![ModernApps](https://github.com/tspannhw/FLiPStackWeekly/raw/main/images/Timothy%20Spann.jpg)




#### Videos


[https://www.youtube.com/watch?v=ehlK_d-ItG0](https://www.youtube.com/watch?v=ehlK_d-ItG0)


<iframe width="560" height="315" src="https://www.youtube.com/embed/ehlK_d-ItG0" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>



[https://www.youtube.com/watch?v=XH0nsTttSY0](https://www.youtube.com/watch?v=XH0nsTttSY0)



[https://www.youtube.com/watch?v=K-I2DJYIkTg&t=6s](https://www.youtube.com/watch?v=K-I2DJYIkTg&t=6s)


<iframe width="560" height="315" src="https://www.youtube.com/embed/K-I2DJYIkTg" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>



#### Spring for Pulsar on Secure Cloud


[https://github.com/spring-projects-experimental/spring-pulsar/wiki/Stream-Native-Cloud](https://github.com/spring-projects-experimental/spring-pulsar/wiki/Stream-Native-Cloud)


[https://spring.io/blog/2022/11/16/spring-framework-6-0-goes-ga](https://spring.io/blog/2022/11/16/spring-framework-6-0-goes-ga)



### CODE


[https://pulsar.apache.org/release-notes/versioned/client-cpp-3.0.0/](https://pulsar.apache.org/release-notes/versioned/client-cpp-3.0.0/)


[https://github.com/tspannhw/spring-pulsar-gtfsrealtime](https://github.com/tspannhw/spring-pulsar-gtfsrealtime)


[https://github.com/tspannhw/FLiPN-FLaNK-KafkaConnectToMoP](https://github.com/tspannhw/FLiPN-FLaNK-KafkaConnectToMoP)


[https://github.com/tspannhw/pulsar-adsb-cockroachdb](https://github.com/tspannhw/pulsar-adsb-cockroachdb)


[https://github.com/tspannhw/pulsar-adsb-function](https://github.com/tspannhw/pulsar-adsb-function)



### ARTICLES


[https://www.mparticle.com/blog/apache-pulsar-migration/](https://www.mparticle.com/blog/apache-pulsar-migration/)


[https://streamnative.io/blog/case/2022-11-15-how-proxima-beta-implemented-cqrs-and-event-sourcing-on-top-of-apache-pulsar-and-scylladb/](https://streamnative.io/blog/case/2022-11-15-how-proxima-beta-implemented-cqrs-and-event-sourcing-on-top-of-apache-pulsar-and-scylladb/)


[https://medium.com/@tspann/gtfs-real-time-feed-ingest-with-java-67e0d324cfc4](https://medium.com/@tspann/gtfs-real-time-feed-ingest-with-java-67e0d324cfc4)


[https://www.immerok.io/blog/apache-flink-newsletter-nov-2022](https://www.immerok.io/blog/apache-flink-newsletter-nov-2022)


[https://nvidianews.nvidia.com/news/nvidia-microsoft-accelerate-cloud-enterprise-ai](https://nvidianews.nvidia.com/news/nvidia-microsoft-accelerate-cloud-enterprise-ai)


[https://verraes.net/2019/05/patterns-for-decoupling-distsys-passage-of-time-event/](https://verraes.net/2019/05/patterns-for-decoupling-distsys-passage-of-time-event/)


[https://streamnative.io/blog/community/2022-11-04-announcing-pulsar-summit-asia-2022-conference-schedule/](https://streamnative.io/blog/community/2022-11-04-announcing-pulsar-summit-asia-2022-conference-schedule/)


[https://dl.acm.org/doi/fullHtml/10.1145/3531146.3533231](https://dl.acm.org/doi/fullHtml/10.1145/3531146.3533231)



### TRAINING


Dates are Dec 5 - Dec 8, 2022


Link to register: [https://www.eventbrite.com/e/463731161387](https://www.eventbrite.com/e/463731161387)



Dates are January 17 - 19, 2023 from 2pm - 5pm CET / 8am - 12pm EST

Link to register: [https://www.eventbrite.com/e/465055021087](https://www.eventbrite.com/e/465055021087)


[https://streamnative.io/training/](https://streamnative.io/training/)




### EVENTS



Nov 20, 2022 9:00 pm. Pulsar Summit Asia. Virtual.


[https://pulsar-summit.org/event/asia-2022/schedule](https://pulsar-summit.org/event/asia-2022/schedule)



Nov 23, 2022: Big Data EU. Virtual.


[https://bigdataconference.eu/timothy-spann/](https://bigdataconference.eu/timothy-spann/)



Nov 29, 2022: Machine Intelligence Guild Speaker of the Month. Virtual.


Coming soon.


Dec 14, 2022: Manhattan, NYC:  Pulsar + Pinot Meetup



Dec 15, 2022: TigerLabs, Princeton, NJ: Pulsar + NiFi + Flink Meetup


[https://www.meetup.com/technologysolutionshub/events/289756167/](https://www.meetup.com/technologysolutionshub/events/289756167/)


**HTAP Summit**


Coming soon.


**Pinot / Pulsar Meetup**


Coming soon.


**CockroachDB NYC Meetup**



**Hazelcast Event**


[https://docs.hazelcast.com/hazelcast/5.1/integrate/pulsar-connector](https://docs.hazelcast.com/hazelcast/5.1/integrate/pulsar-connector)



### TOOLS


* [https://github-business-card.vercel.app/](https://github-business-card.vercel.app/)


* [https://github.com/Eugeny/tabby/releases/tag/v1.0.186](https://github.com/Eugeny/tabby/releases/tag/v1.0.186)

 

* [https://tabby.sh/](https://tabby.sh/)

 

* [https://github.com/aleixrodriala/wa-tunnel](https://github.com/aleixrodriala/wa-tunnel)

 

* [https://github.com/awslabs/deequ](https://github.com/awslabs/deequ)

 

* [https://github.com/MonitorControl/MonitorControl](https://github.com/MonitorControl/MonitorControl)


* [https://github.com/sibprogrammer/xq](https://github.com/sibprogrammer/xq)


* [https://github.com/danielgatis/rembg](https://github.com/danielgatis/rembg)


* [https://pomochat.com/](https://pomochat.com/)


* [https://github.com/enso-org/enso](https://github.com/enso-org/enso)


* [https://github.com/streamnative/pulsar-io-cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage)


* [https://github.com/FusionAuth/java-http](https://github.com/FusionAuth/java-http)


* [https://github.com/containers/podman-desktop](https://github.com/containers/podman-desktop)


* [https://github.com/cachix/devenv](https://github.com/cachix/devenv)


* [https://devenv.sh/](https://devenv.sh/)


* [https://teropa.info/musicmouse/](https://teropa.info/musicmouse/)



#### Blast from the Past


[https://www.youtube.com/watch?v=tnWq8opMI6s](https://www.youtube.com/watch?v=tnWq8opMI6s)




#### QUICK SCRIPTS



curl http://localhost:8080/admin/v2/clusters/standalone




December 2022 - In Person Meetup - Princeton, NJ

Learn how to use Apache Pulsar, Apache Flink, and Apache NiFi Details Location: TigerLabs in Princeton on the 2nd floor, walk up and the door will be open. Same that we were using for the old Future of Data - Princeton events 2016-2019. Parking at the school is free. street parking nearby is free. there are meters on some streets and a few blocks away is a paid parking garage. We are joining forces with our friends Cloudera again on a FLiPN amazing journey into Real-Time Streaming Applications with Apache Flink, Apache NiFi, and Apache Pulsar. Learn how to use Apache Pulsar, Apache Flink, and Apache NiFi Discover how to stream data to and from your data lake or data mart using Apache Pulsar™ and Apache NiFi®. Learn how these cloud-native, scalable open-source projects built for streaming data pipelines work together to enable you to quickly build applications with minimal coding. |WHAT THE SESSION WILL COVER| Apache NiFi Apache Pulsar Apache Flink Flink SQL We will show you how to build apps, so download beforehand to Docker, K8, your Laptop, or the cloud. Cloudera CSP Setup Getting Started with Cloudera Stream Processing Community Edition You may download CSP-CE here: Cloudera Stream Processing Community Edition The Cloudera CDP User's page: CDP Resources Page Apache Pulsar https://pulsar.apache.org/docs/getting-started-standalone/ or https://streamnative.io/free-cloud/ Cloudera + Pulsar https://community.cloudera.com/t5/Cloudera-Stream-Processing-Forum/Using-Apache-Pulsar-with-SQL-Stream-Builder/m-p/349917 https://community.cloudera.com/t5/Community-Articles/Using-Apache-NiFi-with-Apache-Pulsar-for-Streaming/ta-p/337891 —------------------------ |AGENDA| 6:00 - 6:30 PM EST: Food, Drink, and Networking!!! 6:30 - 7:15 PM EST: Presentation - Tim Spann, StreamNative Developer Advocate 7:15 - 8:00 PM EST: Presentation - John Kuchmek, Cloudera Principal Solutions Engineer 8:00 - 8:30 PM EST: Round Table on Real-Time Streaming 8:30 - 9:00 PM EST: Q&A + Networking —------------------------ |ABOUT THE SPEAKERS| John Kuchmek is a Principal Solutions Engineer for Cloudera. Before joining Cloudera, John transitioned to the Autonomous Intelligence team where he was in charge of integrating the platforms to allow data scientists to work with various types of data. Tim Spann is a Developer Advocate for StreamNative. He works with StreamNative Cloud, Apache Pulsar™, Apache Flink®, Flink® SQL, Big Data, the IoT, machine learning, and deep learning. Tim has over a decade of experience with the IoT, big data, distributed computing, messaging, streaming technologies, and Java programming. Previously, he was a Principal DataFlow Field Engineer at Cloudera, a Senior Solutions Engineer at Hortonworks, a Senior Solutions Architect at AirisData, a Senior Field Engineer at Pivotal, and a Team Leader at HPE. He blogs for DZone, where he is the Big Data Zone leader, and runs a popular meetup in Princeton on Big Data, Cloud, IoT, deep learning, streaming, NiFi, the blockchain, and Spark. Tim is a frequent speaker at conferences such as ApacheCon, DeveloperWeek, Pulsar Summit, and many more. He holds a BS and MS in computer science. He is currently working on a book about the FLiP Stack. See: https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/283837865/ https://github.com/tspannhw/SpeakerProfile https://www.meetup.com/futureofdata-newyork/ https://github.com/tspannhw/pulsar-transit-function https://github.com/tspannhw/FLiP-Current22-LetsMonitorAllTheThings https://www.meetup.com/futureofdata-princeton/ Details: https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289674210/

November - Month of Talks

https://www.linkedin.com/pulse/november-month-talks-tim-spann-/ #ApachePulsar #ApacheFlink #Spring #DeltaLake #CDC #SQL #OpenSource #ApacheBookeeper #ApacheCon #Containers #K8 #Kubernetes #Cloud #FLiPNStack #NovemberConferences #AllDayDevops #AIDevWorldExpo It was an interesting Halloween week, with lots of cool conference talks and more to come. They have added handles to Youtube, so here is one of my Youtube sites: Apache Pulsar 2.10.2 is out! Read the notes. It was great speaking at the Aerospike Real-Time Forum. The food, tech, speakers, attendees, and venue were amazing. A big thanks to Aerospike, Databricks, Starburst Data, and StreamNative for making this happen. Add alt text No alt text provided for this image Photo by Nick (Aerospike) Please subscribe to your favorite podcast channel. Matt Yonkovit. CODE + COMMUNITY Join my meetup group NJ/NYC/Philly/Virtual: This is Issue #56!! RELEASES CODE TALKS ARTICLES EVENTS Nov 10, 2022 at 1:30PM EST: AllDayDevops. Virtual. Nov 15, 2022. OSA Con. Virtual. Nov 16-18, 2022. PASS Data Community Conference. Virtual. Nov 20, 2022 9:00 pm. Pulsar Summit Asia. Virtual. Nov 23, 2022: Big Data EU. Virtual. Nov 29, 2022: Machine Intelligence Guild Speaker of the Month. Virtual. Dec 6-8, 2022: Spring One: San Francisco Dec 7, 2022: 3:00 pm Dec 7, 2022: 4:00 pm December: LakeFS Meetup: San Francisco Pinot / Pulsar Meetup Hazelcast TOOLS