Power Query functions are the backbone of efficient and reusable transformations in Power BI.

In this hands-on post, we’ll explore three practical examples, from simple text cleanup to a dynamic pivot and automatic INR currency conversion.

Wanting some accountability for studying for your Fabric certification exam.  Read on for details on how to join a study group.

When you start building a report on Power BI platform, you can quickly see lines connecting tables in the Model View. It looks very simple but behind those lines lies the secret of how Power BI understands your data. What do these actually mean?

The Translytical Task Flow feature marks a significant evolution in Power BI, From a read-only analytics tool to an interactive, action-oriented platform. By combining Fabric UDFs with new UI elements like Text and List Slicers, you can now build seamless workflows that empower users to act on insights instantly.

If you are exploring Power BI, you might already have come across the Drill Down and Drill Through options. At first, both look similar in this way they help you explore data in detail. But in real time, they work differently and are used for different purposes.

This post demonstrates how to build a synthetic, large-scale EdTech dropout prediction pipeline using Microsoft Fabric’s Data Engineering and Machine Learning workloads.
It implements the Medallion Architecture (Bronze → Silver → Gold) to produce ML-ready features that predict student dropout risk.

As a Fabric User, I've witnessed the evolution of data platforms. We've all managed the chaos: a data lake here, a data warehouse there, and a labyrinth of ETL pipelines connecting them. It's complex, costly, and slows us down.

Microsoft Fabric introduces a feature that fundamentally changes this paradigm: OneLake.

The full live schedule for Fabric Data Days. Sessions also available on-demand. Read on for more details.

For years, Power BI developers lived with a limitation: version control was never truly part of the workflow.

Certification exam discounts, live training sessions, Learn challenges and more. Read on for more details.

¡Conoce al Campeón Mundial de Power BI de México y Panamá! Habrá sesiones en vivo, competiciones y un montón de otras oportunidades. Sigue leyendo para enterarte de todo.

Conheça o Campeão Mundial de Power BI - do Brasil! Sessões ao vivo, competições e outras oportunidades. Continue lendo para mais detalhes.

 Live sessions, contests and other opportunities for students and those early in their career. Read on for more details.

While your Moodle LMS data provides a complete snapshot of daily users, course enrollments, and activity statuses, it obscures the vital story educators, administrators, and analysts really care about: what changes occurred since yesterday?

In my previous blog I explained about Bootstrapped data loading and in this blog I am going to explain how you can automate partition refreshes using a tool developed using python. Please read that blog before checking this.

Automating Partition Refreshes with Python
To simplify the process, I developed a Python-based tool that automates partition refreshes.

Download link is in the bottom

It comes in two versions:

Version 1: Runs from a local machine

Version 2: Runs from a Microsoft Fabric Notebook using the Semantic Link library

Both versions use the Enhanced Refresh API to refresh partitions efficiently.

Version 1: Local Python Tool
This version includes three key files:

• config.py
• utils.py
• main.py

Requirements:

• Service Principal ID, Secret, and Tenant ID
• Dataset ID and Workspace ID

Configuration Steps:

Open config.py and provide the required values. Adjust parameters such as delay, batch size, maximum parallelism, retry count, and timeout based on your environment.

2. In main.py, specify the table name and incremental refresh policy details.

3. Execute main.py script.

How It Works:

• The tool automatically calculates partition names based on the policy.
• It divides partitions into batches as per the defined batch size.
• It checks if any refresh is in progress, then triggers batch refreshes sequentially.
• Each batch executes only after the previous one completes successfully.

You can monitor progress through Power BI Service refresh history

or verify partition data in SSMS by expanding the table’s Partitions node.

After completing all the batches, it will stop the execution like below

All the partitions are loaded successfully

You might have observed, the first batch started at 8:26 AM and last batch completed at 11:00 AM. The whole process took 2.5 hours and the script did the whole job on its own. 🙂

Version 2: Microsoft Fabric Notebook
The second version is a Microsoft Fabric Notebook (Bootstrapped Data Load.ipynb) and leverages the Semantic Link library.

It does not require a Service Principal since it uses the current user’s identity. The user running the notebook must have appropriate permissions in the workspace hosting the semantic model.

Provide the necessary configuration values in the designated notebook cell and execute it. Similar to Version 1, it refreshes partitions sequentially in batches.

Points to Remember

• The automation tool supports Task 2 only refreshing partitions in batches.
• Parameters such as maxParallelism, batchSize, delay, timeout, and retryCount should be tuned according to your environment.
• The tool refreshes one table at a time. For models with multiple fact tables using incremental refresh, run the process separately for each table.
• In Version 1, verify that the automatically generated partition names match your model configuration before triggering the refresh.
• In Version 1, bearer token expiry has been handled which means even when the bearer token expires during the batch processing it will regenerate a token on its own.
• In Version 2, note that the Fabric notebook remains active during execution, which can increase compute consumption. If Fabric workloads are restricted in your organization, use Version 1 instead.
• You might have observed that the intermediate log messages shows the current refresh status as ‘Unknown’, it is an expected behavior with Enhanced Refresh APIs

Conclusion
The Bootstrapped Initial Refresh technique is an effective way to overcome the limitations of the initial full load in Power BI incremental refresh. By first creating an empty table and then refreshing partitions in controlled batches, you can establish your model structure without encountering timeout, memory, or workload management issues.

This method ensures a smooth onboarding of large datasets into Power BI while maintaining optimal resource usage and performance.

You can download the tool from my git repository. I am not an expert in python, please feel free to correct my code or suggest any enhancements.

Hope you learned something new from this blog, do share your thoughts in the comments section.

Happy Learning!!!