"tap tap tap". Your attention please, we're going to orchestrate our ETL/ELT process! Yes, it's time to unleash your inner Herbert von Karajan and make sure your BI orchestra performs at its best. Why? Well, unless you enjoy waking up every night to start your Extract-Transform-Load (ETL) process and manually running each process to do … Continue reading DP-700 training: Orchestration
Some of you might recognise database projects from either Synapse Analytics or SQL Server. Yay for the latter ;). A long story, very short, database projects are a way to develop and deploy your databases using a CI/CD (Continuous Integration/Continuous Development) approach. For each database, the code you've written is saved in a specific project … Continue reading DP-700 training: implement database projects
Let's dig into something that's quite simple to implement: workspace monitoring. Whenever someone calls out that "something is simple to implement", your first response should be "Oh really?". Because simplicity is always in the eyes of the beholder. And sometimes the easiest solutions carry the most consequences. Or cost. Or both. Wording can be complicated, … Continue reading DP-700 training: Workspace logging
If you come from an SQL Server background, mirroring will be familiar to you. It may be good or bad, but hopefully not at a nightmare level. Whatever your association with database mirroring, it is also available within Microsoft Fabric. What is mirroring If you're not coming from a SQL Server background, or any data … Continue reading DP-700 training: Implement mirroring
When we create a data solution for our company or clients, we create the best, right? Sure, we do. But still, monitoring the solution is something you should never forget. Your solution can be stable, but the data usually isn't. And it just feels good to know all the data has been processed correctly. So, … Continue reading DP-700 Training: Monitor hub
When you're working with Microsoft Fabric, some people are allowed to do everything in your workspace, other people are less privileged and should have less permissions. There are a lot of ways to make sure people don't ruin your weekend, the best one being no access at all. But that also means that you're always … Continue reading DP-700 training: Workspace access level controls
Data security is the most important part of our job as data engineers and data architects. There are very few use cases where people need to see all the data in full detail. I know, customers take a different view on this but in reality, do they really need every single detail? No, they do … Continue reading DP-700 training: data masking
The best place to store your data is in a SQL Server database that no living being can ever access. The end. No, I'm kidding, of course. But there's an atom of truth in this joke. Because for years we, in the structured data industry, have always been convinced that a database is the best … Continue reading DP-700 Training: Choose an appropriate data store
Welcome to my Ted Talk, data transformation is done in T-SQL. Thank you. Well, yes once upon a time, maybe. Nowadays there are many more ways that lead to the dark side (also known as data vault) and the happy side (also known as the star schema or dimensional model). Did I lose you yet? … Continue reading DP-700 Training: Data transformation options
This post can come as a shock if you're used to writing T-SQL. Because not only is there more than one useful language to process data, realtime data in this case, but it also has enough similarities to SQL to look familiar and is different enough to leave you flustered. Now, to get a complete … Continue reading DP-700 Training: Process data using KQL
Reitse's blog 