DP-700 training: Choose between query acceleration for OneLake shortcuts and standard OneLake shortcuts in Real-Time Intelligence

A three-line title that promises a lot! So let's try to simplify this a bit. In essence, this blog will cover how to make OneLake data quicker in an Eventhouse using shortcuts. The process, at a high level, is quite simple. In your eventhouse, create a shortcut to a Lakehouse, for instance. Enable query acceleration, … Continue reading DP-700 training: Choose between query acceleration for OneLake shortcuts and standard OneLake shortcuts in Real-Time Intelligence

DP-700 training: Configure Dataflow Gen2 workspace settings (Apache Airflow)

Welcome to another instalment in the DP-700 learn series. This time we're going to talk about Apache Airflow settings. It's a little bit of a misnomer in the header, maybe, but we have to follow the titles Microsoft offers in the official curriculum. Now, before we dig into the fun techy stuff, let's familiarise ourselves … Continue reading DP-700 training: Configure Dataflow Gen2 workspace settings (Apache Airflow)

DP-800: First Microsoft Learn experiences

The DP-800 training is new and was released to GA a few weeks ago. It now sits in the same family as DP-600 (Data Analytics using Microsoft Fabric), 700 (Data Engineering using Microsoft Fabric) and 750 (Data Engineering using Databricks). The full name of this training is "Develop AI-Enabled Database Solutions". This one sparked my … Continue reading DP-800: First Microsoft Learn experiences

DP-700 training: Workspace logging

Let's dig into something that's quite simple to implement: workspace monitoring. Whenever someone calls out that "something is simple to implement", your first response should be "Oh really?". Because simplicity is always in the eyes of the beholder. And sometimes the easiest solutions carry the most consequences. Or cost. Or both. Wording can be complicated, … Continue reading DP-700 training: Workspace logging

DP-700 training: Implement mirroring

If you come from an SQL Server background, mirroring will be familiar to you. It may be good or bad, but hopefully not at a nightmare level. Whatever your association with database mirroring, it is also available within Microsoft Fabric. What is mirroring If you're not coming from a SQL Server background, or any data … Continue reading DP-700 training: Implement mirroring

DP-700 training: create and manage shortcuts to data

Storage is cheap, so we don't have to worry about data storage costs. Though this might be true, at some point, a lot of data will start to cost a lot of money. And, like many of you, dear readers who are in business intelligence, we like to duplicate data. A lot. We ingest it, … Continue reading DP-700 training: create and manage shortcuts to data

DP-700 Training: Monitor hub

When we create a data solution for our company or clients, we create the best, right? Sure, we do. But still, monitoring the solution is something you should never forget. Your solution can be stable, but the data usually isn't. And it just feels good to know all the data has been processed correctly. So, … Continue reading DP-700 Training: Monitor hub

DP-700 training: Item Level Access

In the previous blog post, I wrote about workspace-level Access. With the four levels of access that can be defined, this wasn't too hard. Let's make it a little harder and see if we can prevent mishaps in the different items within our workspace. In other words, let's regulate access to the different items because … Continue reading DP-700 training: Item Level Access

DP-700 training: Workspace access level controls

When you're working with Microsoft Fabric, some people are allowed to do everything in your workspace, other people are less privileged and should have less permissions. There are a lot of ways to make sure people don't ruin your weekend, the best one being no access at all. But that also means that you're always … Continue reading DP-700 training: Workspace access level controls

DP-700 training: data masking

Data security is the most important part of our job as data engineers and data architects. There are very few use cases where people need to see all the data in full detail. I know, customers take a different view on this but in reality, do they really need every single detail? No, they do … Continue reading DP-700 training: data masking