"tap tap tap". Your attention please, we're going to orchestrate our ETL/ELT process! Yes, it's time to unleash your inner Herbert von Karajan and make sure your BI orchestra performs at its best. Why? Well, unless you enjoy waking up every night to start your Extract-Transform-Load (ETL) process and manually running each process to do … Continue reading DP-700 training: Orchestration
Some of you might recognise database projects from either Synapse Analytics or SQL Server. Yay for the latter ;). A long story, very short, database projects are a way to develop and deploy your databases using a CI/CD (Continuous Integration/Continuous Development) approach. For each database, the code you've written is saved in a specific project … Continue reading DP-700 training: implement database projects
Let's dig into something that's quite simple to implement: workspace monitoring. Whenever someone calls out that "something is simple to implement", your first response should be "Oh really?". Because simplicity is always in the eyes of the beholder. And sometimes the easiest solutions carry the most consequences. Or cost. Or both. Wording can be complicated, … Continue reading DP-700 training: Workspace logging
Storage is cheap, so we don't have to worry about data storage costs. Though this might be true, at some point, a lot of data will start to cost a lot of money. And, like many of you, dear readers who are in business intelligence, we like to duplicate data. A lot. We ingest it, … Continue reading DP-700 training: create and manage shortcuts to data
When we create a data solution for our company or clients, we create the best, right? Sure, we do. But still, monitoring the solution is something you should never forget. Your solution can be stable, but the data usually isn't. And it just feels good to know all the data has been processed correctly. So, … Continue reading DP-700 Training: Monitor hub
When you're working with Microsoft Fabric, some people are allowed to do everything in your workspace, other people are less privileged and should have less permissions. There are a lot of ways to make sure people don't ruin your weekend, the best one being no access at all. But that also means that you're always … Continue reading DP-700 training: Workspace access level controls
Data security is the most important part of our job as data engineers and data architects. There are very few use cases where people need to see all the data in full detail. I know, customers take a different view on this but in reality, do they really need every single detail? No, they do … Continue reading DP-700 training: data masking
The best place to store your data is in a SQL Server database that no living being can ever access. The end. No, I'm kidding, of course. But there's an atom of truth in this joke. Because for years we, in the structured data industry, have always been convinced that a database is the best … Continue reading DP-700 Training: Choose an appropriate data store
This post can come as a shock if you're used to writing T-SQL. Because not only is there more than one useful language to process data, realtime data in this case, but it also has enough similarities to SQL to look familiar and is different enough to leave you flustered. Now, to get a complete … Continue reading DP-700 Training: Process data using KQL
In one of the earlier blogs, the topic revolved around everything Git. Git is a version control system where you can leverage CI/CD. I love Git, even though it has a habit of biting me severely in the parts I use to sit on. If you're not well versed in Git or have no option … Continue reading DP-700 training: Create and configure deployment pipelines
Reitse's blog 