Showing posts with label milvus. Show all posts
Showing posts with label milvus. Show all posts

AIM Weekly for 01-July-2024

 Tim Spann @PaaSDev Milvus - Towhee - Attu - Feder - GPTCache - VectorDB Bench

AIM Weekly (Towhee - Attu - Milvus (Tim-Tam))

https://github.com/milvus-io/milvus?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

https://www.youtube.com/@FLaNK-Stack

https://medium.com/@tspann/subscribe

https://ossinsight.io/analyze/tspannhw

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/unstructured-data-meetup-new-york/?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

This is Issue #144

Join me:

July 25, 2024 5:30 to 8:30 PM in NYC @ Cloudera 101 5th Ave · New York, NY Cloudera office - 8th Floor https://www.meetup.com/unstructured-data-meetup-new-york/events/301720478/?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

New Releases

Zilliz Cloud https://docs.zilliz.com/docs/release-notes-290

Unity Catalog https://github.com/unitycatalog/unitycatalog/

Hardware

Necklace AI? https://basedhardware.com/

Upcoming

July 25 - Meetup @ Cloudera NYC August 13 - Meetup @ Hudson Yards NYC

Cool Stuff

Hardware coming... Transformer enhancement... Sohu

I wonder if this will supercharge Vector Databases?

https://www.etched.com/

Tip

Milvus Lite is for only one vector per collection. As of current version in 2.4.

Articles

There's a lot of cool stuff with Milvus and new models, techniques, libraries and use cases.

Edge AI with Milvus Lite https://medium.com/@tspann/edgeai-edge-vector-database-6a9b5238bffb

Quantization!?!?!? https://medium.com/@tspann/how-good-is-quantization-in-milvus-6d224b5160b0

Vector Embeddings https://zilliz.com/learn/everything-you-should-know-about-vector-embeddings?utm_source=tim

Milvus Lite with LangChain and LLaMaIndex https://medium.com/@zilliz_learn/how-to-connect-to-milvus-lite-using-langchain-and-llamaindex-69ed139c7e4b

Choosing the Right Embedding Model for Your Data https://zilliz.com/blog/choosing-the-right-embedding-model-for-your-data

How Delivery Hero Implemented Safety System for AI https://zilliz.com/blog/how-delivery-hero-implemented-safety-system-for-ai-generated-images?utm_source https://www.slideshare.net/slideshow/i-see-eyes-in-my-soup-how-delivery-hero-implemented-the-safety-system-for-ai-generated-images/267924072

Local Agentic RAG with Langraph and LLAMA3 https://zilliz.com/blog/local-agentic-rag-with-langraph-and-llama3?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

Mastering LLM techniques https://developer.nvidia.com/blog/mastering-llm-techniques-inference-optimization/#in-flight_batching

Milvus Performance Benchmark for Vector Databases https://zilliz.com/resources/whitepaper/milvus-performance-benchmark

Vector Search and RAG Balancing Accuracy https://zilliz.com/blog/vector-search-and-rag-balancing-accuracy-and-context?utm_source=li

Promethean Wager AI Vector Databases https://severalnines.com/podcast/promethean-wager-ai-vector-databases-and-data-sovereignty

AI https://news.ycombinator.com/item?id=40789353

Attention Explained https://ai-explained.yoko.dev/1-attention-explained

Polyfill Chain Attack https://sansec.io/research/polyfill-supply-chain-attack

What we learned from Pinterests Text to SQL Solution https://blog.getwren.ai/what-we-learned-from-pinterests-text-to-sql-solution-840fa5840635

The Ultimate Guide to Run Any LLM Locally https://programming.earthonline.us/an-ultimate-guide-to-run-any-llm-locally-eb1a43052053

Drop of a Hat Model https://universe.roboflow.com/test-y7opj/drop-of-a-a-hat/model/2 https://dropofahat.zone/

Structured Output From LLMs https://www.boundaryml.com/blog/structured-output-from-llms

The Death of NYC Congestion Pricing https://www.apricitas.io/p/the-death-of-nyc-congestion-pricing

Finding GPT4S Mistakes with GPT-4 https://openai.com/index/finding-gpt4s-mistakes-with-gpt-4/

Finetuning https://mlops.systems/posts/2024-06-25-evaluation-finetuning-manual-dataset.html

Enterprise RAG at Scale https://medium.com/@dialoglk/asimov-leveraging-rag-models-for-enhanced-efficiency-in-the-telecommunications-engineering-domain-f220fc405571

Try Milvus 2.4 on Zilliz https://www.linkedin.com/pulse/try-milvus-24-features-zilliz-cloud-learn-vector-embeddings-check-b9fyc/

All the Free AI Education https://zilliz.com/learn

Multimodal Embeddings with Fifty One and Milvus https://zilliz.com/blog/exploring-multimodal-embeddings-with-fiftyone-and-milvus

https://github.com/milvus-io/bootcamp/blob/master/bootcamp/OpenAIAssistants/custom_RAG_workflow.ipynb

https://zilliz.com/blog/use-vector-search-to-better-understand-computer-vision-data?utm_source=linkedin&utm_medium=social%20&utm_campaign=2024-06-26_social_linkedin-newsletter_zilliz

Elevating User Experience with Image Based Fashion Recommendations https://zilliz.com/blog/elevating-user-experience-with-image-based-fashion-recommendations?utm_source=linkedin&utm_medium=social%20&utm_campaign=2024-06-26_social_linkedin-newsletter_zilliz

Training State of the Art General Text Embedding https://www.slideshare.net/slideshow/training-stateoftheart-general-text-embedding/267310506

Fine Tune Florence 2 https://huggingface.co/blog/finetune-florence2

AI Data Infrastructure https://www.felicis.com/insight/ai-data-infrastructure

RAG with Small Language Models https://medium.com/data-science-at-microsoft/evaluating-rag-capabilities-of-small-language-models-e7531b3a5061

Synthetic Data Generation https://blogs.nvidia.com/blog/nemotron-4-synthetic-data-generation-llm-training/

Deep Dive into RAG https://towardsdatascience.com/17-advanced-rag-techniques-to-turn-your-rag-app-prototype-into-a-production-ready-solution-5a048e36cdc8

Videos

Live Fun Friday with Unstructed Data Preview https://www.youtube.com/watch?v=_jQB62uPsvc

Running the NVIDIA Milvus Lite Demo https://www.youtube.com/watch?v=7kdYbaw2LSQ

RAG in Production https://www.youtube.com/watch?v=_MpqlnN-TtE

Unstructured Meetup https://www.youtube.com/watch?v=ntiA36Skdrw

Princeton AI Meetup 18-June-2024 Report

https://www.yourtowntube.com/video/16798/ai-startup-grind-princeton-meetup-somerset-entire-opening-screen-presentation

https://www.yourtowntube.com/video/16793/ai-meetup-event-somerset-innovation-and-technology-center-some-clips

https://www.yourtowntube.com/video/16799/ai-startupgrind-princeton-meetup-somerset-individual-interviews-briana

AI Camp NYC - 20-June-2024 - Tim Speaks -With Slides https://www.youtube.com/watch?v=2YQiJzwA6BE

AI Camp NYC - 20-June-2024 - Tim Speaks - Raw video feed https://www.youtube.com/watch?v=wYEtg4UuvPM

Unstructured Data Processing with RPI 5 AI Kit https://www.youtube.com/watch?v=tZFJ1DDkD1Q

Using JSON Fields with Milvus https://www.youtube.com/watch?v=HP5L3Hr6Mt8

DSS ML Talk https://www.youtube.com/watch?v=t17Ga4l5gvo

Webinar https://zilliz.com/event/asimov-enterprise-rag-at-dialog-axiata?

Slides

https://www.slideshare.net/slideshow/06-20-2024-ai-camp-meetup-unstructured-data-and-vector-databases/269789268

https://www.slideshare.net/slideshow/06-18-2024-princeton-meetup-introduction-to-milvus/269765983

https://www.slideshare.net/slideshow/06-12-2024-budapestdataforum-buildingreal-timepipelineswithflank-aim/269645846

Events

Oct 27 - 29, Raleigh, NC - All Things Open https://2024.allthingsopen.org/speakers/timothy-spann

image

Nov 5-7, 10-12, 2024: CloudX. Online/Santa Clara. https://www.developerweek.com/cloudx/

Nov 19, 2024: XtremePython. Online. https://xtremepython.dev/2024/

Webinars

Building an Agentic RAG locally with Milvus, Ollama and LangGraph July 11, 2024 | 9:00 AM PT/12:00PM ET | Stephen Batifol, Zilliz Get hands-on and learn how to:

RAG Evaluation with Ragas July 18 | 9:00 AM PT/12:00PM ET | Christy Bergman, Zilliz

Hands-On Demo: Building and Scaling Vector Search Apps with Zilliz Cloud July 25, 2023 | 9:00 AM PT/12:00PM ET | Frank Liu, Zilliz Learn how to build and scale vector search applications with live examples. Walk through the following:

Code

Models

Tools

© 2020-2024 Tim Spann https://www.youtube.com/@FLaNK-Stack

AIM Weekly for 17 June 2024

 

17-June-2024

Tim Spann @PaaSDev

Milvus - Towhee - Attu - Feder - GPTCache - VectorDB Bench

Happy Father's Day To All! Also Happy Flag Day to Those in the United States.

image

AIM Weekly

Towhee - Attu - Milvus (Tim-Tam)

FLaNK - FLiPN

With a name like that I am not sure how I don't add that to my group.

SPANN: Highly-efficient Billion-scale Approximate Nearest Neighborhood Search https://proceedings.neurips.cc/paper/2021/hash/299dc35e747eb77177d9cea10a802da2-Abstract.html

Congrats to Milvus https://www.dbta.com/Editorial/Trends-and-Applications/DBTA-100-2024-The-Companies-That-Matter-Most-in-Data-164289.aspx

https://github.com/milvus-io/milvus

https://pebble.is/PaaSDev

https://vimeo.com/flankstack

https://www.youtube.com/@FLaNK-Stack

https://www.threads.net/@tspannhw

https://medium.com/@tspann/subscribe

https://ossinsight.io/analyze/tspannhw

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/unstructured-data-meetup-new-york/

This is Issue #142

New Releases

Milvus Release 2.4.4

https://milvus.io/docs/release_notes.md

Release date: May 31, 2024

It includes a critical bug fix, so if you use bulk insert definitely upgrade now. Also some compilation updates for other platforms.

https://github.com/milvus-io/milvus/releases/tag/v2.4.4

Hardware

https://www.seeedstudio.com/BeagleYr-AI-beagleboard-orgr-4-TOPS-AI-Acceleration-powered-by-TI-AM67A.html

Upcoming

Summary of the Last Awesome Meetup https://www.linkedin.com/feed/update/urn:li:activity:7202803256891248640/

Cool Stuff

TIMM (Pytorch Image Models) https://timm.fast.ai/

Ben has gone deep on this article on the Future of Vector Search linking to some of Milvus & Zilliz' scalability and horizontal scalability deep description and highlighting a lot of interesting things going on.

https://gradientflow.substack.com/p/the-future-of-vector-search

See: https://zilliz.com/learn/scaling-vector-databases-to-meet-enterprise-demands?utm_source=tim

Articles

There's a lot of cool stuff with Milvus and new models, techniques, libraries and use cases.

https://medium.com/@tspann/not-every-field-is-just-text-numbers-or-vectors-976231e90e4d

https://medium.com/@tspann/unstructured-street-data-in-new-york-8d3cde0a1e5b

https://medium.com/@tspann/tech-week-soft-meetup-debut-june-2024-fc4cdf79342d

https://medium.com/@tspann/shining-some-light-on-the-new-milvus-lite-5a0565eb5dd9

https://medium.com/@zilliz_learn/using-vector-search-to-better-understand-computer-vision-data-08e137df9c6c

https://www.infoq.com/presentations/ai-monopoly/

https://python.plainenglish.io/claude-3-the-king-of-data-extraction-f06ad161aabf

https://towardsdatascience.com/rag-vs-finetuning-which-is-the-best-tool-to-boost-your-llm-application-94654b1eaba7

https://medium.com/@zilliz_learn/using-vector-search-to-better-understand-computer-vision-data-08e137df9c6c

https://zilliz.com/blog/exploring-multimodal-embeddings-with-fiftyone-and-milvus

https://medium.com/aiguys/yolov9-new-object-detection-king-6fc97b93dc9a

https://www.linkedin.com/pulse/nifi-retrieval-augmented-generation-chris-gambino-gfsec/?trackingId=OliHLynzQEKic3SgAznO5w%3D%3D

https://ml.dssconf.pl/

https://medium.com/@zilliz_learn/milvus-reference-architectures-e30a27c9f3c2

https://docs.openlit.io/latest/integrations/milvus

https://builtin.com/articles/real-time-data-ai

https://medium.com/@zilliz_learn/image-embeddings-for-enhanced-image-search-an-in-depth-explainer-6831859bedf0

https://medium.com/@zilliz_learn/semantic-search-with-milvus-and-openai-32573de80307

https://medium.com/@zilliz_learn/how-to-detect-and-correct-logical-fallacies-from-genai-models-3e4a9852d2ef

https://gradientflow.substack.com/p/the-future-of-vector-search

https://medium.com/vector-database/introducing-pymilvus-integration-with-embedding-models-a82f10d516ea

https://medium.com/@zilliz_learn/local-agentic-rag-with-langgraph-and-llama-3-6c962979821f

https://blogs.nvidia.com/blog/nemotron-4-synthetic-data-generation-llm-training/?utm_source=tim

https://medium.com/walmartglobaltech/reliably-processing-trillions-of-kafka-messages-per-day-23494f553ef9

https://jack-vanlightly.com/blog/2024/6/10/a-cost-analysis-of-replication-vs-s3-express-one-zone-in-transactional-data-systems?utm_source=tim

DSPy - Getting interesting https://medium.com/@sandyeep70/the-decline-of-traditional-prompt-engineering-and-the-rise-of-dspy-b27b9a5adc45

Why How + Milvus Lite https://medium.com/enterprise-rag/kickstart-your-genai-applications-with-milvus-lite-and-whyhow-ais-open-source-rule-based-retrieval-70873c7576f1

Videos

Using JSON Fields with Milvus https://www.youtube.com/watch?v=HP5L3Hr6Mt8

Street Cams + Milvus https://medium.com/@tspann/unstructured-street-data-in-new-york-8d3cde0a1e5b

Conf42: ML: Emerging GenAI https://youtu.be/ktVVdJB306U?feature=shared

Generative AI with Milvus https://www.youtube.com/watch?v=IfWIzKsoHnA

SF Unstructured Meetup - 03 June 2024 https://www.youtube.com/watch?v=UobR3czXqSo&ab_channel=Zilliz

Fueling AI with Airbyte https://zilliz.com/event/fueling-ai-with-great-data-airbyte?utm_campaign=2024-06-13_webinar_Airbyte-fueling-ai-with-great-data_zilliz&utm_medium=tim

Milvus Webinar https://www.youtube.com/watch?v=IowBdkeKi_M

AI Generated Videos https://youtu.be/5tJDBSDrKLQ https://www.youtube.com/watch?v=YNh-WNFLe98

Voyage AI Embeddings and Rerankers for Search and RAG https://medium.com/@zilliz_learn/voyage-ai-embeddings-and-rerankers-for-search-and-rag-587d9bfff877

Evaluate RAG Apps https://medium.com/@zilliz_learn/how-to-evaluate-rag-applications-e2936c1275f9

Slides

https://www.slideshare.net/slideshow/generative-ai-on-enterprise-cloud-with-nifi-and-milvus/267678399

https://www.slideshare.net/slideshow/06-04-2024-nyc-tech-week-discussion-on-vector-databases-unstructured-data-and-ai/269523214

https://ml.dssconf.pl/user.html#!/lecture/DSSML24-041a/rate

https://www.slideshare.net/slideshow/dssml24_tspann_codelessgenerativeaipipelines/269634571

https://www.slideshare.net/slideshow/06-12-2024-budapestdataforum-buildingreal-timepipelineswithflank-aim/269645846

Events

June 18, 2024: Princeton Meetup https://www.meetup.com/applied-generative-artificial-intelligence-applications/events/301336510/ https://www.startupgrind.com/events/details/startup-grind-princeton-presents-genai-gathering/

June 20, 2024: AI Camp Meetup. NYC. https://www.meetup.com/unstructured-data-meetup-new-york/events/301383476/

Nov 5-7, 10-12, 2024: CloudX. Online/Santa Clara. https://www.developerweek.com/cloudx/

Nov 19, 2024: XtremePython. Online. https://xtremepython.dev/2024/

Code

Models

Tools

Cool

Let's do the Time Sync Again https://github.com/milvus-io/milvus/blob/master/docs/design_docs/20211215-milvus_timesync.md

© 2020-2024 Tim Spann https://www.youtube.com/@FLaNK-Stack 


🎥 Playlist:  Unstructured Data Meetup  https://zilliz.com/community/unstructured-data-meetup
🖥️ Website:  [(https://www.youtube.com/@MilvusVectorDatabase/videos
X Twitter -   / milvusio  https://x.com/milvusio
🔗 Linkedin:  / zilliz  https://www.linkedin.com/company/zilliz/
😺 GitHub: https://github.com/milvus-io/milvus
🦾 Invitation to join discord:   / discord https://discord.com/invite/FjCMmaJng6