Get 50% off Databricks certifications this month

Databricks is currently offering a 50% discount on certification exams for participants who complete any self-paced learning pathway during the Virtual Learning Festival, which runs from October 10 to 31, 2025. Eligible users will receive their voucher and can also enjoy 20% off an annual Databricks Academy Labs subscription. This initiative is an excellent opportunity to boost data engineering, analytics, or machine learning skills at a reduced cost.

Exploring MLflow Experiments in Databricks 🚀 Today, I ran my first complete MLflow experiment in Databricks — and it really helped me understand how the end-to-end model lifecycle works in practice. Here’s what I observed 👇 🔹 Step 1: I trained a machine learning model using my dataset while MLflow automatically tracked parameters, metrics, and artifacts. 🔹 Step 2: After achieving the desired accuracy, I registered the best model in the Databricks Model Registry. 🔹 Step 3: The registered model can then be deployed in Databricks Apps (or through endpoints) to answer real-time user data queries. It’s fascinating to see how Databricks and MLflow work together — from experiment tracking → model registration → real-time inference — all within one platform. Every experiment teaches something new, and this one made me appreciate how seamless the MLOps workflow can be in Databricks. 💡 #Databricks #MLflow #MLOps #MachineLearning #DataEngineering #DataScience #LearningJourney

One of my favorite parts about working in data science and machine learning is learning new skills. Last week I attended the MLOps Denver meetup where Elliot Sequeira gave a great overview of the state of MLOps and Brent Hyman shared his knowledge of running PySpark on Amazon EMR. I came away from the event with a list of new skills and technologies to explore. Next month’s meetup is October 23rd where I’ll be sharing some of the lessons I’ve learned from 8+ years working in tech.

Strong start yesterday — great mix of Datacolor AI engineers, UTD students, and AWS/Informatica mentors diving deep into what Agentic AI really means at an enterprise scale. We spent the day iterating on technical patterns, how to build multi-agent orchestration pipelines ,use AWS Bedrock, Claude, and LangGraph, while linking to Informatica’s metadata and data-governance APIs for trusted, context-aware execution. Students from The University of Texas at Dallas brought serious curiosity — some experimenting with the Model Context Protocol (MCP) runtime to connect agents to real business systems For us, this hackathon isn’t about demos — it’s about giving back: sharing frameworks, mentoring students, and helping build the next generation of AI engineers who understand both the model and the system.

The list of Databricks connectors is growing daily. Is #LakeflowConnect worth the cost? I always wondered why Databricks didn't build these connectors earlier. Whatever the reason, they are here. I always recommend that clients use native Databricks features as opposed to a third party tool. Why? Future compatibility and knowing that these tools will get better very quickly. Databricks has proven this to all of us. In this regard the cost is absolutely worth it. However, one conversation I have had with multiple clients now is that the cost of using Lakeflow Connect can be prohibitive. This is because an ingestion gateway can only connect to one source at a time. Even if the client doesn't need live mirroring, the ingestion gateway stays on to not lose logs. The DBUs can add up over time. For some very specific use cases, we at Tempered AI have developed a low cost method of using lakeflow connect. We want our clients to use the newest Databricks feature, and we make the cost works for them. If you are using #LakeflowConnect and want to know how to save on costs, you know where to find us.

🚀 It’s almost end of 2025, and Databricks just made learning Data & AI completely FREE! Whether you're a beginner or a seasoned data professional, you can now explore Databricks tools, technologies, and hands-on labs — all at zero cost. Here are 4 key resources to get started 👇 1️⃣ Databricks Free Edition The next evolution of Community Edition — a fully featured, serverless workspace with no setup, no credit card, and no time limit. 👉 Start building: https://lnkd.in/gpcwSpv8 2️⃣ Free Academy Courses Access self-paced training across the full Data & AI lifecycle — from Lakehouse fundamentals to GenAI. 📘 Explore courses: https://lnkd.in/gwHF7iCq 3️⃣ DB Demos & Hands-On Projects Learn by doing with 35+ ready-to-use demo projects — complete with sample data, notebooks, and guided walkthroughs. 🧠 Try them out: https://lnkd.in/gBAvA3FG 4️⃣ Free Accreditations Earn official Databricks credentials — including Fundamentals, GenAI, and Platform Admin — absolutely free. 🏅 Get started: https://lnkd.in/g45zyJv5 🎉 Bonus: A Learning Festival is coming soon — with new resources and 50% off vouchers for paid certifications! 🔗 More details: https://lnkd.in/gjsNFuWY 🎥 Check out our Databricks YouTube courses for structured learning: 1. Data Engineering with Databricks: https://lnkd.in/g9stjg3M 2. Databricks Certified Associate Developer: https://lnkd.in/g9PjRhFw 3. Databricks Certified Machine Learning Engineer – Associate: https://lnkd.in/gPF2uDxN 💡 If you’ve been waiting to start your Databricks or AI journey — this is the perfect time! #Databricks #DataEngineering #MachineLearning #AI #FreeLearning #DataScience #GenAI #DatabricksCommunity #TheDataChannel

🎉 I'm Kicking Off #30DaysOfDatabricks – Databricks Deconstructed! I’m currently upskilling in Databricks and thought, why not share my learnings with the community? I’ll be diving deep into Databricks and sharing one concept, insight, or hands-on tip every day. Some posts will cover foundational ideas, while others will explore advanced techniques - all designed to help you master data engineering, analytics, and AI on the lakehouse platform. Over the 30 days, we’ll explore: - 𝗔𝗿𝗰𝗵𝗶𝘁𝗲𝗰𝘁𝘂𝗿𝗲 & 𝗚𝗼𝘃𝗲𝗿𝗻𝗮𝗻𝗰𝗲: Understanding the Lakehouse, Delta Lake, and Unity Catalog - 𝗗𝗮𝘁𝗮 𝗪𝗼𝗿𝗸𝗳𝗹𝗼𝘄𝘀: ETL with PySpark, streaming, and Delta Live Tables - 𝗠𝗮𝗰𝗵𝗶𝗻𝗲 𝗟𝗲𝗮𝗿𝗻𝗶𝗻𝗴 & 𝗔𝗜: MLflow, Feature Store, and large-scale model deployment - 𝗢𝗽𝘁𝗶𝗺𝗶𝘇𝗮𝘁𝗶𝗼𝗻 & 𝗜𝗻𝘁𝗲𝗴𝗿𝗮𝘁𝗶𝗼𝗻: Performance tuning, BI connections, and best practices Whether you’re looking to level up your Databricks skills or see how data powers business decisions, this series is for you. Follow along and transform the way you work with data. By the way, Day 01 of #30DaysOfDatabricks is here! Inspired the all the way from SanthanaLakshmi Ponnurasan (let’s see if I can keep up your consistency!) #Databricks #DatabricksDeconstructed #DataEngineering #Analytics #Lakehouse

🚀 It’s almost end of 2025, and Databricks just made learning Data & AI completely FREE! Whether you're a beginner or a seasoned data professional, you can now explore Databricks tools, technologies, and hands-on labs — all at zero cost. Here are 4 key resources to get started 👇 1️⃣ Databricks Free Edition The next evolution of Community Edition — a fully featured, serverless workspace with no setup, no credit card, and no time limit. 👉 Start building: https://lnkd.in/gpcwSpv8 2️⃣ Free Academy Courses Access self-paced training across the full Data & AI lifecycle — from Lakehouse fundamentals to GenAI. 📘 Explore courses: https://lnkd.in/gwHF7iCq 3️⃣ DB Demos & Hands-On Projects Learn by doing with 35+ ready-to-use demo projects — complete with sample data, notebooks, and guided walkthroughs. 🧠 Try them out: https://lnkd.in/gBAvA3FG 4️⃣ Free Accreditations Earn official Databricks credentials — including Fundamentals, GenAI, and Platform Admin — absolutely free. 🏅 Get started: https://lnkd.in/g45zyJv5 🎉 Bonus: A Learning Festival is coming soon — with new resources and 50% off vouchers for paid certifications! 🔗 More details: https://lnkd.in/gjsNFuWY 🎥 Check out our Databricks YouTube courses for structured learning: 1. Data Engineering with Databricks: https://lnkd.in/g9stjg3M 2. Databricks Certified Associate Developer: https://lnkd.in/g9PjRhFw 3. Databricks Certified Machine Learning Engineer – Associate: https://lnkd.in/gPF2uDxN 💡 If you’ve been waiting to start your Databricks or AI journey — this is the perfect time! #Databricks #DataEngineering #MachineLearning #AI #FreeLearning #DataScience #GenAI #DatabricksCommunity #TheDataChannel

We just announced the OpenAI models launched on Databricks… but Databricks on OpenAI’s data?! Super cool video from OpenAI themselves explaining how they leverage data internally (using Databricks!) to help business and finance teams! https://lnkd.in/g5qY9raV

Ever wondered how a data engineer with zero ML background can get started with machine learning?   In this article, our Tech Lead Stefan Mihajlovic shared his step-by-step journey: using Microsoft Fabric and Azure ML Studio to go from raw data to a functional model predicting delivery times. Along the way, he applied the medallion architecture, tested different approaches (from minimal preprocessing to heavy feature engineering), and discovered that sometimes the simplest path delivers the best results.   Check it out if you’re curious about: ✔️ What AutoML looks like in practice ✔️ How Fabric and ML Studio work together ✔️ Setting up real-time endpoints and retraining pipelines   Read the full story and on our website and see if these tools are really ready to bring ML into everyday data engineering! The link is here: https://lnkd.in/dF489Wcp