All Data and AI Weekly #204: 25-Aug-2025
https://bsky.app/profile/paasdev.bsky.social
NiFi + AI + AI Data Cloud + Iceberg.
https://www.reddit.com/r/DataEngineeringForAI/hot/
Monthly NYC and Youtube Events
AWS New York Summit https://github.com/tspannhw/conferences/tree/main/2025/awsny
Hex + Snowflake Hackathon https://github.com/tspannhw/hackathons/tree/main/2025-07-15
Apache NiFi + AI Agents + Cortex AI + Snowflake AISQL
https://github.com/tspannhw/TrafficAI/tree/main/Agents
https://github.com/tspannhw/transit-ridership
https://github.com/tspannhw/conferences
https://github.com/tspannhw/hackathons/tree/main/2025-07-15
Welcome to this week's edition of All Data and AI, your go-to source for the latest news, insights, and resources in the world of data. This week, we're diving deep into Snowflake, exploring new AI tools, and highlighting some can't-miss events. Join me at Community over Code in September and the World Tour in New York in October. I am speaking at both events.
- How a Terminal Diagnosis Inspired a New Ethical AI System: A thought-provoking piece on the intersection of personal experience and technological innovation in AI ethics.
- Climate Volatility and Financial Services: Learn how financial services are leveraging data to navigate the challenges of climate change.
- AI and Customer Analytics for Competitive Advantage: Discover how AI-powered customer analytics can give your business a competitive edge.
- Top 10 MCP Server Frameworks: A comprehensive overview of the best frameworks for building MCP servers.
- Sanitizing Unstructured Data with Snowflake AI: A practical guide to cleaning and preparing your unstructured data for analysis.
- Claude Code: Sub-agents: Explore the capabilities of sub-agents in Anthropic's Claude for more complex coding tasks.
- How We Built the Library Powering Streamlit in Snowflake Apps: A behind-the-scenes look at the development of the library that brings Streamlit's power to Snowflake.
- Star vs. Snowflake Schema in BigQuery: Understand the practical differences and use cases for these two popular data warehousing schemas.
- Cortex Model Showdown: A/B Testing for Performance: Learn how to use A/B testing to find the best performing models in Snowflake Cortex.
- Unlocking Snowflake's Synthetic Data Generator: A guide to leveraging synthetic data for testing and development in Snowflake.
- The Last Mile: Bridging the Gap with Snowflake's Native Semantic Layer: Discover how the new semantic layer in Snowflake simplifies data interpretation and access.
- Using RESULTS Explicitly with RESULT_SCAN: A technical dive into a powerful function for working with query results in Snowflake.
- Deploying GPT-SoVITS on Jetson: A step-by-step guide for deploying this text-to-speech model on NVIDIA Jetson devices.
- dbt Models in Snowflake: Best Practices: Learn the best practices for structuring your dbt models for optimal performance and maintainability.
- Getting Started with dbt and Snowflake: A beginner-friendly guide to setting up your first data pipeline with dbt and Snowflake.
- Building with dbt inside Snowflake: A Guide to the Native Integration: Explore the benefits and how-to of using the native dbt integration within Snowflake.
- BeyondTrust Entitle for Snowflake: What I Learned: Insights from working on a complex integration for managing entitlements in Snowflake.
- Programmatically Accessing Snowflake Model Inference Endpoints: Learn about the simplified methods for programmatically interacting with your deployed models.
- Snowflake Snapshots Explained: A clear explanation of how to use snapshots for data protection and recovery.
- OpenFlow: Troubleshooting Snowflake Connectivity: A guide to diagnosing and resolving connectivity issues with Snowflake.
- OpenFlow: Troubleshooting PostgreSQL Connectivity: Tips and tricks for ensuring a smooth connection between OpenFlow and PostgreSQL.
- dbt ❤️ Snowflake: An article exploring the powerful combination of dbt and Snowflake.
- Never Search Snowflake Documentation Again: Discover a more efficient way to find the information you need.
- The General-Purpose Snowflake MCP Server: Learn how to interact with your data using natural language queries.
- Code MCPs: An exploration of the concept and application of Code MCPs.
- EY Snowflake Alliance Data Migration Report: A report on best practices and strategies for migrating your data to Snowflake.
- SQLMesh Documentation: The official documentation for the SQLMesh data transformation framework.
- The Data Engineer's 2025 Upskilling Guide: A guide to the skills you need to succeed as a Snowflake Data Engineer.
- Snowflake Native CI/CD Master Class: Learn how to implement continuous integration and delivery within your Snowflake environment.
- Snowflake Utilities: Codelab Markdown → Snowflake Notebook Converter: A handy tool for converting Codelab Markdown files into Snowflake Notebooks.
- Anubis: An open-source project worth exploring.
- gemma3:270m on Ollama: A new model available on the Ollama platform.
- Zed: A high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.
- Codigram: A new application for developers.
- Snowflake AI Demo: A demonstration of AI capabilities within Snowflake.
- Cursor CLI: The command-line interface for the Cursor code editor.
- Snowflake Labs: MCP: The official repository for the Snowflake MCP project.
- Emerging Solutions Toolbox: A Streamlit app showcasing a collection of tools and solutions.
- Emerging Solutions Toolbox: Iceberg Migrator Helper: A tool to assist with migrating to Apache Iceberg.
- Emerging Solutions Toolbox: Snowflake Table Crawler: A guide and tool for crawling and cataloging your Snowflake tables.
- Emerging Solutions Toolbox: Snowflake Installation Wizard: A wizard to simplify the installation of various Snowflake solutions.
- Emerging Solutions Toolbox: Secure Views to Dynamic Tables Helper: A helper script for converting secure views to dynamic tables.
- Emerging Solutions Toolbox: Share Iceberger Helper: A tool for sharing Iceberg tables.
- Emerging Solutions Toolbox: Non-Tasks to Dynamic Tables Helper: A script to help migrate from non-task-based workflows to dynamic tables.
- Build and Deploy Snowpark ML Models using Streamlit and Snowflake Notebooks: A comprehensive guide with code examples.
- Emerging Solutions Toolbox: Alert Hub: A centralized hub for managing alerts in Snowflake.
- Emerging Solutions Toolbox: Application Control Framework: A framework for managing and controlling your Snowflake applications.
- Emerging Solutions Toolbox: Data Model Mapper: A tool for visualizing and mapping your data models.
- Orchestration Framework: A framework for orchestrating complex data pipelines in Snowflake.
- Cost Breakdown Streamlit Application: A Streamlit app for analyzing your Snowflake costs.
- Snowflake Intelligence Agent Migrate: A tool for migrating to the new Snowflake Intelligence Agent.
- Qwen-Image-Edit on Hugging Face: A powerful image editing model.
- UI-TARS-desktop by Bytedance: A desktop UI automation framework.
- pg_parquet by CrunchyData: A PostgreSQL extension for reading Parquet files.
- Plutoprint: A tool for printing Pluto notebooks.
- TernaryMoralLogic: An exploration of a new approach to moral logic in AI.
- Whispering in Epicenter: An application leveraging speech-to-text technology.
- Sampler: A tool for sampling data.
- Weather Snowflake: A project demonstrating how to work with weather data in Snowflake.
- Snowflake Intelligence Quickstart
- Data and AI Leadership Forum: Join industry leaders to discuss the future of data and AI.
- Bloomberg Technology Summit London 2025: A premier event for technology leaders and innovators.
- Financial Services Builders Series EMEA: A webinar series for developers in the financial services industry.
- Effortless Data Integration for AI: A Technical Deep Dive of Snowflake OpenFlow: A webinar on leveraging OpenFlow for your AI data integration needs.
- Building Cortex Agents On Snowflake: Why It Matters And Best Practices: Building Cortex Agents On Snowflake: Why It Matters And Best Practices
You could fit a lot of IoT, Image, Video, LLM Data, Models and training data on that:
The OWC Express 1M2 80G offers users the choice between DIY “build your own” and ready-to-run solutions, both of which are easily upgradable to higher capacities and compatible with Macs, PCs, iPad Pro, Chromebooks, and Surface devices featuring Thunderbolt 4, Thunderbolt 5, or USB4 connectivity. A solid aluminum, heatsink-like finned design ensures silent, throttle-free heat dissipation to support real-world peak speeds over 6000MB/s. The OWC Express 1M2 80G is available as a 0GB enclosure and in capacities up to 8TB. https://www.owc.com/solutions/express-1m2-80g
https://github.com/timothyspann
© 2020-2025 Tim Spann https://www.youtube.com/@FLaNK-Stack
