"tap tap tap". Your attention please, we're going to orchestrate our ETL/ELT process! Yes, it's time to unleash your inner Herbert von Karajan and make sure your BI orchestra performs at its best. Why? Well, unless you enjoy waking up every night to start your Extract-Transform-Load (ETL) process and manually running each process to do … Continue reading DP-700 training: Orchestration
Some of you might recognise database projects from either Synapse Analytics or SQL Server. Yay for the latter ;). A long story, very short, database projects are a way to develop and deploy your databases using a CI/CD (Continuous Integration/Continuous Development) approach. For each database, the code you've written is saved in a specific project … Continue reading DP-700 training: implement database projects
Let's dig into something that's quite simple to implement: workspace monitoring. Whenever someone calls out that "something is simple to implement", your first response should be "Oh really?". Because simplicity is always in the eyes of the beholder. And sometimes the easiest solutions carry the most consequences. Or cost. Or both. Wording can be complicated, … Continue reading DP-700 training: Workspace logging
If you come from an SQL Server background, mirroring will be familiar to you. It may be good or bad, but hopefully not at a nightmare level. Whatever your association with database mirroring, it is also available within Microsoft Fabric. What is mirroring If you're not coming from a SQL Server background, or any data … Continue reading DP-700 training: Implement mirroring
Storage is cheap, so we don't have to worry about data storage costs. Though this might be true, at some point, a lot of data will start to cost a lot of money. And, like many of you, dear readers who are in business intelligence, we like to duplicate data. A lot. We ingest it, … Continue reading DP-700 training: create and manage shortcuts to data
When we create a data solution for our company or clients, we create the best, right? Sure, we do. But still, monitoring the solution is something you should never forget. Your solution can be stable, but the data usually isn't. And it just feels good to know all the data has been processed correctly. So, … Continue reading DP-700 Training: Monitor hub
In the previous blog post, I wrote about workspace-level Access. With the four levels of access that can be defined, this wasn't too hard. Let's make it a little harder and see if we can prevent mishaps in the different items within our workspace. In other words, let's regulate access to the different items because … Continue reading DP-700 training: Item Level Access
When you're working with Microsoft Fabric, some people are allowed to do everything in your workspace, other people are less privileged and should have less permissions. There are a lot of ways to make sure people don't ruin your weekend, the best one being no access at all. But that also means that you're always … Continue reading DP-700 training: Workspace access level controls
Data security is the most important part of our job as data engineers and data architects. There are very few use cases where people need to see all the data in full detail. I know, customers take a different view on this but in reality, do they really need every single detail? No, they do … Continue reading DP-700 training: data masking
The best place to store your data is in a SQL Server database that no living being can ever access. The end. No, I'm kidding, of course. But there's an atom of truth in this joke. Because for years we, in the structured data industry, have always been convinced that a database is the best … Continue reading DP-700 Training: Choose an appropriate data store
Reitse's blog 