AIM Weekly for 10 June 2024

 

10-June-2024

Tim Spann @PaaSDev

Milvus - Towhee - Attu - Feder - GPTCache - VectorDB Bench

Important Poll:

https://www.linkedin.com/posts/timothyspann_now-that-i-am-doing-a-lot-of-cool-ai-and-activity-7201995051491635200-olsD?utm_source=share&utm_medium=member_desktop

AIM Weekly

Towhee - Attu - Milvus (Tim-Tam)

FLaNK - FLiPN

https://github.com/milvus-io/milvus

https://pebble.is/PaaSDev

https://vimeo.com/flankstack

https://www.youtube.com/@FLaNK-Stack

https://www.threads.net/@tspannhw

https://medium.com/@tspann/subscribe

https://ossinsight.io/analyze/tspannhw

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/unstructured-data-meetup-new-york/

This is Issue #141

New Releases

Milvus Lite 2.4.3 - Local Python

Upcoming

There's time to join today's meetup in San Francisco June 10 https://lu.ma/0yw4coyr

These last couple were amazing.

YouTube videos of all 3 most recent events. June 3rd hosted by Chris https://www.youtube.com/watch?v=UobR3czXqSo&list=PLPg7_faNDlT7SC3HxWShxKT-t-u7uKr--

May 22nd hosted by Chris https://www.youtube.com/watch?v=6pjObdJdyFs&list=PLPg7_faNDlT7SC3HxWShxKT-t-u7uKr--&index=2

May 21st hosted by Christy https://www.youtube.com/watch?v=VEK3_e-DbWI&list=PLPg7_faNDlT7SC3HxWShxKT-t-u7uKr--&index=3

Summary of the Last Awesome Meetup https://www.linkedin.com/feed/update/urn:li:activity:7202803256891248640/

Articles

There's a lot of cool stuff with Milvus and new models, techniques, libraries and use cases.

https://medium.com/@tspann/unstructured-street-data-in-new-york-8d3cde0a1e5b

https://medium.com/@tspann/tech-week-soft-meetup-debut-june-2024-fc4cdf79342d

https://medium.com/@tspann/shining-some-light-on-the-new-milvus-lite-5a0565eb5dd9

https://zilliz.com/blog/why-i-joined-zilliz-tim-spann

https://www.tiktok.com/@tim_the_nifi_guy/video/7374753137074212142

https://milvus.io/docs/multi_tenancy.md#Partition-oriented-multi-tenancy

https://zilliz.com/blog/improve-behavior-science-experiments-with-llm-and-milvus

https://platform.openai.com/docs/guides/embeddings/what-are-embeddings

https://llava-vl.github.io/

https://huggingface.co/google/efficientnet-b4

https://towardsdatascience.com/understanding-masked-language-models-mlm-and-causal-language-models-clm-in-nlp-194c15f56a5

https://jina.ai/news/implementing-a-chat-history-rag-with-jina-ai-and-milvus-lite/

https://zilliz.com/blog/elevating-user-experience-with-image-based-fashion-recommendations

https://medium.com/aiguys/yolov10-object-detection-king-is-back-739eaaab134d

https://medium.com/follower-booster-hub/sqlcoder-70b-becomes-the-leading-ai-sql-model-b2911920f594

https://medium.com/@learn-simplified/why-entire-ai-field-is-headed-towards-ai-agents-a268ac9661ed

https://medium.com/@zilliz_learn/advanced-retrieval-augmented-generation-rag-apps-with-llamaindex-ffc966390332

https://pub.towardsai.net/llama-3-llama-cpp-is-the-local-ai-heaven-4f8fe7f119be

https://medium.com/@basics.machinelearning/discover-docllm-the-new-llm-from-jpmorgan-for-working-with-complex-documents-5f54ea287d52

https://medium.com/@igorvgorbenko/harmony-in-data-the-music-recommendation-system-with-milvus-c9711609ed36

https://www.pythonmorsels.com/cli-tools/

https://medium.com/vector-database/introducing-pymilvus-integration-with-embedding-models-a82f10d516ea

https://zilliz.com/blog/praticial-tips-and-tricks-for-developers-building-rag-applications

https://genai-handbook.github.io/?utm_source=substack&utm_medium=email

https://zilliz.com/learn/everything-you-should-know-about-vector-embeddings

https://medium.com/@zilliz_learn/milvus-reference-architectures-e30a27c9f3c2

https://medium.com/@batuhansenerr/yolov10-custom-object-detection-bd7298ddbfd3

https://medium.com/enterprise-rag/kickstart-your-genai-applications-with-milvus-lite-and-whyhow-ais-open-source-rule-based-retrieval-70873c7576f1

https://www.phoronix.com/news/AMD-Peano-LLVM-Ryzen-AI

https://stackoverflow.blog/2024/06/06/breaking-up-is-hard-to-do-chunking-in-rag-applications/

https://zilliz.com/event/knowledge-graphs-in-rag-with-whyhow-ai/success?utm_campaign=2024-06-06_webinar_whyhow-ai_zilliz&utm_medium=email&_hsenc=p2ANqtz-96dlzr_6fS86ImdAwqhcJ2xxKs_qMoRGbBajbhRxZImTPovcR_9BulWcj7EJ-sJMGJ68UUkR9Sbe1VZs8TZ7z5u-hbuQ&_hsmi=310626886&utm_source=singleoffer

https://medium.com/aiguys/prompt-engineering-is-dead-dspy-is-new-paradigm-for-prompting-c80ba3fc4896

https://medium.com/sourcescribes/trending-open-source-ai-research-projects-171fef330219

https://medium.com/@zilliz_learn/are-cpus-enough-a-review-of-vector-search-running-on-novel-hardware-2c5eb16d25dd

Videos

Street Cams + Milvus https://medium.com/@tspann/unstructured-street-data-in-new-york-8d3cde0a1e5b

Conf42: ML: Emerging GenAI https://youtu.be/ktVVdJB306U?feature=shared

Generative AI with Milvus https://www.youtube.com/watch?v=IfWIzKsoHnA

SF Unstructured Meetup - 03 June 2024 https://www.youtube.com/watch?v=UobR3czXqSo&ab_channel=Zilliz

Slides

https://www.slideshare.net/slideshow/generative-ai-on-enterprise-cloud-with-nifi-and-milvus/267678399

https://www.slideshare.net/slideshow/06-04-2024-nyc-tech-week-discussion-on-vector-databases-unstructured-data-and-ai/269523214

Events

June 12, 2024: Budapest Data + ML Forum. Virtual.  https://budapestml.hu/2024/en/speakers/

June 13-14, 2024: Data Science Summit ML Edition 2024 | 13.06.2024 - 14.06.2024 https://ml.dssconf.pl/#agenda

June 18, 2024: Princeton Meetup https://www.meetup.com/applied-generative-artificial-intelligence-applications/events/301336510/ https://www.startupgrind.com/events/details/startup-grind-princeton-presents-genai-gathering/

June 20, 2024: AI Camp Meetup. NYC. https://www.meetup.com/unstructured-data-meetup-new-york/events/301383476/

Sept 24, 2024: JConf.Dev. Dallas. https://2024.jconf.dev/session/598816

Nov 5-7, 10-12, 2024: CloudX. Online/Santa Clara. https://www.developerweek.com/cloudx/

Nov 19, 2024: XtremePython. Online. https://xtremepython.dev/2024/

Code

• https://github.com/tspannhw/FLaNK-python-processors
• https://github.com/tspannhw/AIM-MilvusLite
• https://github.com/tspannhw/AIM-NYCStreetCams

Models

• https://huggingface.co/mistralai/Codestral-22B-v0.1
• https://huggingface.co/defog/sqlcoder-7b-2
• https://huggingface.co/docs/transformers/en/model_doc/seamless_m4t_v2
• https://github.com/QwenLM/Qwen

Tools

• https://github.com/Upsonic/Tiger
• https://jsonformatter.org/yaml-validator
• https://github.com/AllenDowney/ThinkDSP
• https://github.com/aamini/introtodeeplearning
• http://introtodeeplearning.com/
• https://github.com/indi4u/LLM/
• https://github.com/andyk/ht
• https://github.com/defog-ai/sqlcoder/
• https://github.com/igorgorbenko/songs_recommendation/blob/main/data_preparation.ipynb
• https://rosaenlg.org/rosaenlg/4.3.0/index.html
• https://github.com/apparebit/prettypretty
• https://github.com/2noise/ChatTTS
• https://github.com/Shubhamsaboo/awesome-llm-apps
• https://github.com/lllyasviel/Omost
• https://github.com/xonsh/xonsh
• https://github.com/aws/event-ruler
• https://github.com/Huy1711/AI-beat-maker
• https://memalign.github.io/m/pceimage/index.html
• https://www.gifcii.fun/
• https://oxo.ostorlab.co/
• https://github.com/danvergara/dblab
• http://www.findu.com/
• https://www.udio.com/
• https://kpiss.fm/about/
• https://www.weewx.com/
• https://github.com/HumanAIGC/AnimateAnyone
• https://github.com/ventoy/Ventoy
• https://github.com/Vaibhavs10/insanely-fast-whisper
• https://github.com/SilasMarvin/lsp-ai

Cool

This is a cool Raspberry Pi Pico + ESP copter https://www.kickstarter.com/projects/sb-gajendra/piwings-soar-into-stem-with-the-ultimate-pi-powered-drone?ref=checkout_rewards_page

ASCII Movies https://ascii.theater/

More ASCII Fun https://meatfighter.com/ascii-silhouettify/

© 2020-2024 Tim Spann https://www.youtube.com/@FLaNK-Stack FLaNK-AIM with LLAMA 3

🎥 Playlist:  Unstructured Data Meetup  [https://www.meetup.com/unstructured-data-bay-area/events/](https://www.meetup.com/unstructured-data-bay-area/events/)
🖥️ Website:  [https://www.youtube.com/@MilvusVectorDatabase/videos](https://www.youtube.com/@MilvusVectorDatabase/videos)
X Twitter -   / milvusio  [https://x.com/milvusio](https://x.com/milvusio)
🔗 Linkedin:  / zilliz  [https://www.linkedin.com/company/zilliz/](https://www.linkedin.com/company/zilliz/)
😺 GitHub: [https://github.com/milvus-io/milvus](https://github.com/milvus-io/milvus)
🦾 Invitation to join discord:   / discord  [https://discord.com/invite/FjCMmaJng6](https://discord.com/invite/FjCMmaJng6)

FLaNK AI Weekly 18 March 2024

 

18-March-2024

FLaNK Stack Weekly

Tim Spann @PaaSDev

https://pebble.is/PaaSDev

https://vimeo.com/flankstack

https://www.youtube.com/@FLaNK-Stack

https://www.threads.net/@tspannhw

https://medium.com/@tspann/subscribe

https://www.cloudera.com/campaign/apache-nifi-for-dummies.html

https://ossinsight.io/analyze/tspannhw

Congrats to my wife for being the youngest Leader of our local Elks!

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

http://www.meetup.com/futureofdata-princeton/

https://www.meetup.com/futureofdata-newyork/

https://www.meetup.com/futureofdata-philadelphia/

**This is Issue #129 **

https://github.com/tspannhw/FLiPStackWeekly

https://www.cloudera.com/solutions/dim-developer.html

New Releases

https://cldr-steven-matison.github.io//blog/CEM-2.1.2-Release/

Articles

Image Processing with Custom Python and Apache NiFi 2.0 https://medium.com/@tspann/image-processing-with-custom-python-and-nifi-2-0-06eadc62c03c

Mixtral Deep Dive https://dzone.com/articles/mixtral-generative-sparse-mixture-of-experts-in-da

AI Augmented DevRel part 1 https://medium.com/@tspann/ai-augmented-devrel-part-1-4058af905a89

Next Level Flink with Nussknacker https://medium.com/@tspann/next-level-flink-with-nussknacker-fe7294e2ef21

Mixtral Generative Sparse Mixture of Experts in DataFlows https://medium.com/@tspann/mixtral-generative-sparse-mixture-of-experts-in-dataflows-59744f7d28a9

https://news.mit.edu/2024/researchers-enhance-peripheral-vision-ai-models-0308

https://medium.com/@1709deepesh/connecting-apache-nifi-to-microsoft-graph-reading-emails-with-invokehttp-processors-6d84db9fa157

https://community.cloudera.com/t5/Community-Articles/How-to-call-a-CML-Deployed-Model-From-Apache-NiFi-in-10/ta-p/374853

https://www.infoq.com/news/2024/03/java-22-so-far/

https://www.infoq.com/news/2024/03/lapce-rust-editor

https://www.infoq.com/news/2024/03/mistral-ai-aws/

https://www.infoq.com/news/2024/03/anthropic-claude-ai/

https://www.quantamagazine.org/new-breakthrough-brings-matrix-multiplication-closer-to-ideal-20240307/

https://venturebeat.com/ai/hugging-face-is-launching-an-open-source-robotics-project-led-by-former-tesla-scientist/?

https://dbos-project.github.io/

https://www.datanami.com/2024/03/07/cloudera-unveils-next-phase-of-open-data-lakehouse-to-unlock-enterprise-ai/?

https://www.decodable.co/blog/taxonomy-of-data-change-events

https://www.europarl.europa.eu/news/en/press-room/20240308IPR19015/artificial-intelligence-act-meps-adopt-landmark-law

https://medium.com/plain-simple-software/the-llm-app-stack-2024-eac28b9dc1e7

https://www.slideshare.net/JulienSIMON5/an-introduction-to-computer-vision-with-hugging-face

https://huggingface.co/learn/nlp-course/chapter1/2?fw=pt

https://huggingface.co/timm

https://github.com/huggingface/pytorch-image-models

https://www.slideshare.net/JulienSIMON5/an-introduction-to-computer-vision-with-hugging-face

https://www.infoq.com/news/2024/03/azure-openai-your-data-ga/

https://developers.redhat.com/articles/2024/03/13/kafka-tiered-storage-deep-dive?

https://community.cloudera.com/t5/What-s-New-Cloudera/Cloudera-DataFlow-adds-Change-Data-Capture-processors-flow/ba-p/381727

Videos

Streaming Traffic Cameras https://www.youtube.com/watch?v=85ECRGJBEQU&ab_channel=DatainMotion-HowToBeaStreamingEngineer

Python Processor https://www.youtube.com/watch?v=jF5FSY0xFiQ&t=9s&ab_channel=DatainMotion-HowToBeaStreamingEngineer

Preview of TCF Pro Talk https://youtu.be/ce9lhtbp48M?si=Svjb2-bIIPXLwXD1

Feb 22, 2024 NYC Meetup

https://www.slideshare.net/slideshows/2024-feb-ai-meetup-nyc-genaillmsmldata-codeless-generative-ai-pipelines/266444687

Feb 28, 2024 NYC Flink Meetup

https://www.slideshare.net/slideshows/2024-february-28-nyc-meetup-unlocking-financial-data-with-realtime-pipelines/266539528

Feb 29, 2024 Conf42 Python 2024

https://www.slideshare.net/slideshows/conf42python-using-apache-nifi-apache-kafka-risingwave-and-apache-iceberg-with-stock-data-and-llm/266521940

https://www.slideshare.net/slideshows/conf42pythonbuilding-apache-nifi-20-python-processors/266522007

https://www.youtube.com/watch?v=awxzG7laWx4&ab_channel=Conf42

https://www.youtube.com/watch?v=FD16_oZ65Ug&ab_channel=Conf42

March 11, 2024 Princeton 23 Orchard Event

https://www.slideshare.net/slideshows/2024-build-generative-ai-for-nonprofits/266748822

march 15, 2024 Trenton TCF

https://www.slideshare.net/slideshows/tcfpro24-building-realtime-generative-ai-pipelines/266807785

Events

March 27, 2024: Startup Grind. Jersey City https://www.startupgrind.com/events/details/startup-grind-princeton-presents-startup-grind-princeton-amp-nj-big-data-alliance-generative-ai-reverse-pitch/

March 28, 2024: Pinot + NiFi + Flink + Kafka Meetup NYC https://www.meetup.com/real-time-analytics-meetup-ny/events/299290822/

April 2, 2024: XtremeJ 2024. Virtual. https://xtremej.dev/2023/schedule/

April 8-11, 2024: NLIT Summit. Seattle. https://www.fbcinc.com/e/nlit/default.aspx 

April 11, 2024: Conf42 LLM. Virtual. https://www.conf42.com/llms2024

April 12, 2024: AI Max Conference. 23 Orchard Princeton https://www.startupgrind.com/events/details/startup-grind-princeton-presents-startup-grind-hosts-ai-max-summit/

April 2024: AI Meetup NJ https://www.meetup.com/nj-gai/

May 8-9, 2024: Data Summit 2024. Boston, MA. https://www.dbta.com/DataSummit/2024/default.aspx

Cloudera Events https://www.cloudera.com/about/events.html

More Events: https://www.linkedin.com/pulse/schedule-2024-tim-spann--y4coe

Code

• https://github.com/tspannhw/FLaNK-python-processors

Models

• https://github.com/urchade/GLiNER
• https://github.com/deepseek-ai/DeepSeek-VL
• https://github.com/sieve-community/fast-asd
• https://arxiv.org/abs/2403.09611
• https://github.com/xai-org/grok-1

Datasets

• https://hf.co/datasets

Tools

• https://github.com/echasnovski/mini.nvim/blob/main/readmes/mini-indentscope.md
• https://datavolo.io/2024/03/data-engineering-for-advanced-rag-small-to-big-with-pinecone-langchain-and-datavolo/
• https://docs.pinecone.io/docs/metadata-filtering
• https://python.langchain.com/docs/modules/data_connection/retrievers/parent_document_retriever
• https://docs.pinecone.io/reference/list
• https://colab.research.google.com/drive/1AvPpRvzLvGPMG3vVgcRDOvSdar_lsTks
• https://github.com/pi-ra/beesy-issue-tracker
• https://palindromicity.blogspot.com/2020/06/dotifi-generating-dot-files-from-apache.html
• https://github.com/flxzt/rnote
• https://github.com/teableio/teable
• https://localsend.org/#/
• https://github.com/leobeeson/llm_benchmarks
• https://www.cognition-labs.com/blog
• https://github.com/openvinotoolkit/openvino_notebooks/tree/recipes/recipes/defect_detection_anomalib
• https://brave.com/
• https://github.com/PeerDB-io/peerdb
• https://osm2pgsql.org/
• https://arc.net/
• https://github.com/truera/trulens
• https://github.com/has2k1/plotnine
• https://github.com/altair-viz/altair
• https://github.com/quarto-dev/quarto-cli
• https://github.com/tobymao/sqlglot
• https://github.com/quarkiverse/quarkus-langchain4j
• https://github.com/ELLA-Diffusion/ELLA
• https://github.com/skills-cogrammar/C7-Lecture-Backpack
• https://github.com/LucasPickering/slumber
• https://webhook.site/
• https://github.com/paveldedik/ludic
• https://github.com/bananaml/fructose
• https://github.com/betwixt-labs/bebop
• https://github.com/jafioti/luminal
• https://github.com/soorajshankar/logScreen
• https://github.com/flydelabs/flyde
• https://lite.ip2location.com/ip2location-lite
• https://github.com/getindata/flink-http-connector
• https://github.com/phospho-app/phospho
• https://github.com/phospho-app/fastassert
• https://github.com/developersdigest/llm-answer-engine
• https://docs.litellm.ai/docs/proxy/quick_start
• https://letsbuild.ai/
• https://github.com/albertan017/LLM4Decompile
• https://vector.dev/
• https://github.com/ArroyoSystems/arroyo
• https://github.com/stanfordnlp/pyvene
• https://www.mewho.com/titan/
• https://radicle.xyz/
• https://github.com/ianand/spreadsheets-are-all-you-need

Tips

https://www.datainmotion.dev/2020/05/one-minute-nifi-tip-calcite-sql-notes.html

Cool Tool

These are amazing diagrams and graphics.
https://drawify.com/templates/341/personal-user-manual

© 2020-2024 Tim Spann