All Data and AI Weekly #193 - June 9, 2025

 

All Data and AI Weekly

( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, Unstructured Data )

#193 - June 9, 2025

https://bsky.app/profile/paasdev.bsky.social

NiFi + AI + AI Data Cloud + Iceberg. 

 my cat + Google AI Whisk

https://www.reddit.com/r/DataEngineeringForAI/hot/

https://github.com/sfc-gh-tspann/DataAIDemos/blob/main/airquality.sql

https://www.slideshare.net/slideshow/14may2025_tspann_fromairqualityunstructureddata-pdf/277680861

https://medium.com/@tim.spann_50517/populating-an-open-lakehouse-with-codeless-data-streams-9395a30a2d4f

https://medium.com/@tim.spann_50517/real-time-enrichment-of-air-quality-data-26564464b2a5

https://www.youtube.com/watch?v=YJhRcXFNv2M

Monthly NYC and Youtube Events

https://lu.ma/PINSAI

Join Hex and I in New York City for a hands-on hackathon with food, AI and prizes.

https://lu.ma/prjumowa

❄️ Snowflake Summit 2025 Breakdown ❄️

There is so much amazing new stuff! Data, Open Source, AI, Automation, Devops, Streaming, containers and so much more.

❄️ Snowflake OpenFlow - Super charged Apache NiFi for all data movement needs ❄️ Snowpipe Streaming - massive updates and speed improvements. Tied with OpenFlow ❄️ dbt projects running and edited natively in Snowflake ❄️ Dynamic Tables with external Iceberg tables ❄️ Delta Direct ❄️ Snowflake Intelligence ❄️ Cortex Agent API ❄️ Data Science Agent ❄️ CrunchyData - Postgres ❄️ Snowpark Container Services update ❄️ LLM Observability ❄️ Adaptive Compute Warehouses ❄️ Tag-based budgets ❄️ More visibility into snowflake ❄️ Snowflake joins FinOps Foundation ❄️ Trust Center Extensions for 3rd party ❄️ MFA Updates, Passkey ❄️ Snapshot backups ❄️ Event Logs for AI ❄️ Cortex AI SQL ❄️ Semantic Views ❄️ SnowConvert AI for Greenplum and more ❄️ Cortex Knowledge Extensions ❄️ Egress Cost Optimizer for region sharing ❄️ Organization Profiles ❄️ Organization Accounts ❄️ Snowflake Workspacces for single UI ❄️ Agents Marketplace ❄️ Adaptive Compute

https://www.snowflake.com/en/blog/platform-announcements-summit-2025/

https://medium.com/snowflake/snowflake-intelligence-next-ai-generation-fffadaa3e50e

https://github.com/sfc-gh-tspann/SnowflakeSummit2025

Other AI, Data and Snowflake News!!!

https://help.tableau.com/current/online/en-us/snowflake_oauth_idp.htm

https://medium.com/@prithvirajindi/agentic-ai-field-systems-assistant-transforming-pharma-field-operations-with-snowflake-cortex-ai-c6fc4294a132

https://medium.com/sdg-group/snowflake-security-using-diferential-privay-policy-c76a8511bf16

https://docs.snowflake.com/en/user-guide/snowflake-cortex/cortex-analyst/semantic-model-spec

https://github.com/Snowflake-Labs/whoop-agentic-analytics-demo

https://docs.snowflake.com/en/user-guide/tables-iceberg

https://github.com/Snowflake-Labs/toyota-data-mesh-demo

https://medium.com/snowflake/practical-implementation-of-federated-architecture-with-snowflake-features-154af30792a7

https://docs.snowflake.com/LIMITEDACCESS/snowflake-cortex/open_ai_sdk

https://github.com/openai/simple-evals

https://github.com/vllm-project/vllm

https://github.com/deepspeedai/DeepSpeed

https://www.snowflake.com/en/blog/startup-challenge-2025-winner/

https://github.com/yuuki/tcpulse

https://www.kai-waehner.de/blog/2025/06/09/how-openai-uses-apache-kafka-and-flink-for-genai

https://snowflakechronicles.medium.com/turbocharge-snowpark-workloads-resource-constraint-for-optimized-warehouses-is-now-ga-08d5a162cd0a

https://medium.com/@sajidkhan.sjic/simple-guide-snowflakes-core-architecture-01adafc5f4ba

https://medium.com/snowflake/automating-financial-processes-using-snowflake-a5aaf0816584

https://mkulakowski2-73849.medium.com/mastering-xml-shredding-in-snowflake-4e4552e485b5

https://medium.com/tech-with-abhishek/building-analytical-apps-with-snowflake-postgres-and-snowsight-workspaces-ef94aac63732

https://adrianleexinhan.medium.com/unlocking-engine-interoperability-writing-and-querying-apache-iceberg-tables-in-snowflake-open-c6e7b6963fa5

https://medium.com/snowflake/transform-documents-into-data-with-snowflake-document-ai-220fdbb67adf

https://medium.com/tech-with-abhishek/%EF%B8%8F-mastering-dbt-and-snowflake-integration-challenges-best-practices-and-real-world-solutions-in-04e83628c5a0

https://medium.com/@goutam.karthikchandra/comprehensive-data-governance-in-snowflake-integrating-roles-masking-and-row-level-security-526a59f26cc3

https://stackoverflow.blog/2025/06/03/stack-exchange-knowledge-is-for-everyone-and-now-available-on-snowflake-marketplace

https://jules.google/

https://snowflake.com/en/developers/solutions-center/how-to-build-an-mcp-server-for-cortex-agents/?clear-cache=39uu2f

https://medium.com/@rahul.reddy.ai/your-step-by-step-practical-guide-to-setting-up-snowflake-openflow-on-aws-byoc-07e5b7be5056

https://medium.com/snowflake/model-context-protocol-claude-and-snowflake-9f1e37775d80

https://medium.com/tech-with-abhishek/prompt-driven-workflows-with-snowflake-copilot-and-genai-10d0901101d8

https://adrianleexinhan.medium.com/from-data-lake-to-dialogue-talking-to-your-s3-iceberg-tables-with-snowflake-intelligence-c0d0484dd7f4

https://snowflake.com/en/engineering-blog/apache-polaris-supports-iceberg-delta-lake/?utm_campaign=linkedin&utm_content=1749493967&utm_medium=DBX+Summit+Compete&utm_source=Snowflake+Developers

New Models

❄️ https://www.snowflake.com/en/blog/anthropic-claude-3-7-sonnet-cortex/

Tutorials

❄️ https://github.com/Snowflake-Labs/sfguide-build-data-agents-using-snowflake-cortex-ai

Marketplace

⚡️ https://app.snowflake.com/marketplace/listing/GZSYZ10SV6W/matillion-matillion-data-productivity-cloud?search=matillion

Upcoming Events, Conferences, Meetups, Webinars and More

May 28 - Transforming Text https://www.snowflake.com/webinar/virtual-hands-on-labs/transforming-text-with-snowflake-cortex-building-intelligent-applications-apac-20250528/

June 19 - Northstar Intro to Snowflake Data Engineering https://www.snowflake.com/webinars/northstar-virtual-2025-06-19/

June 21 - Hybrid Tables for Real-Time https://www.snowflake.com/webinars/product-demo/harnessing-real-time-data-with-snowflake-hybrid-tables-101-2025-05-21

June 24 - AI https://www.snowflake.com/webinars/virtual-hands-on-labs/vhol-build-an-llm-powered-gen-ai-app-in-10-min-with-snowflake-cortex-ai-2025-06-24/

June 25 - Build data engineering pipelines https://www.snowflake.com/webinars/virtual-hands-on-labs/build-data-engineering-pipelines-using-snowpark-in-snowflake-notebooks-2025-06-25/

June 26 - Build a GenAI App https://www.snowflake.com/webinars/virtual-hands-on-labs/build-a-gen-ai-app-in-10-min-with-snowflake-2025-06-26/

In-Person

📊 June 2 -5 Snowflake Summit - SF https://www.snowflake.com/en/summit/?utm_cta=website-events-featured

Details: 🔹 Hex + Snowflake Hackathon: Solving NYC’s Biggest Data Challenges 📅 Date: July 15, 2025 🕘 Time: 9:00 AM – 1:00 PM 📍 Location: 44 W 18th St, New York

https://sessionize.com/tspann

https://github.com/timothyspann

© 2020-2025 Tim Spann https://www.youtube.com/@FLaNK-Stack