Skip to main content

Posts

Own Your Tracks... MQTT to Pulsar from Phones

OwnTracks to Apache Pulsar OwnTracks is a cool and open source app for iphone and android phones for sending out location data to a server of your request.  You can send HTTP or MQTT.   Let's pick MQTT and send it to our Pulsar server. For a no code ingest of Location Data Maps of Travel   Configure MQTT Settings       Runs "persistent://public/default/owntracks%2Fuser%2FB692CBD1-57AF-47EE-BD04-5CB3CBC20755" root@pulsar1:/opt/demo/apache-pulsar-2.9.1# bin/pulsar-client consume "persistent://public/default/owntracks%2Fuser%2FB692CBD1-57AF-47EE-BD04-5CB3CBC20755" -s "owntrax" -n 0 2022-03-09T19:02:43,397-0500 [pulsar-client-io-1-1] INFO org.apache.pulsar.client.impl.ConnectionPool - [[id: 0xe2958283, L:/127.0.0.1:37880 - R:localhost/127.0.0.1:6650]] Connected to server 2022-03-09T19:02:43,574-0500 [pulsar-client-io-1-1] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Starting Pulsar consumer status recorder with config: {"topicName

Five Sensors Real-Time with Pulsar and Python on a Pi (FLiP-Py-Pi-BreakoutGarden)

FLiP-Pi-BreakoutGarden FLiP-Py The easy way to build Python streaming applications from the edge to cloud. Code :   https://github.com/tspannhw/FLiP-Pi-BreakoutGarden Gear / Hardware Raspberry Pi 3 Model B Rev 1.2, Bullseye Raspian, armv71 Pimoroni Breakout Garden Hat 1.12" Mono OLED Breakout 128x128 White/Black Screen BME680 Air Quality, Temperature, Pressure, Humidity Sensor LWM303D 6D0F Motion Sensor (X, Y, Z Axes) BH1745 Luminance and Color Sensor LTR-559 Light and Proximity Sensor 0.01 lux to 64,000 lux VL53L1X Time of Flight (TOF) Sensor Software / Libraries Python 3.9 Pulsar Python Client 2.10 (avro) pip3 install pulsar-client[avro] Python Breakout Garden Python PSUTIL  https://pypi.org/project/psutil/ Python LUMA OLED pip3 install --upgrade luma.oled Libraries sudo apt-get install python3 python3-pip python3-pil libjpeg-dev zlib1g-dev libfreetype6-dev liblcms2-dev libopenjp2-7 libtiff5 -y StreamOps bin/pulsar-admin topics create "persistent://public/default/pi-sensors

March 7, 2022 - This Week in Streaming

  A lot going on this upcoming week including a cool meetup. https://www.linkedin.com/pulse/march-7-2022-tim-spann/?trackingId=z6Gm4tXmQGCAiwKJuspXzw%3D%3D Postponed  due to war: TRAINING ๐Ÿš€Last chance to start your #ApachePulsar Operations Training next week! ๐Ÿ—“️March 8-10 daily, tune your clusters with StreamNative experts. RSVP now  EVENTS Coming up next week, John and I have an interesting application reading NFTs and streaming them through Apache Pulsar to Apache NiFi to Apache Kudu. ARTICLES RECENT EVENTS ElasticCC: Ingesting Data at Scale into Elasticsearch with Apache Pulsar CODE COOL PROJECTS IDE For Pytorch!??! Thank you. I am looking at PyTorch + Pulsar Python Functions for coolness. Project Updates