In my previous blog, I wrote about some first impression working with Fabric and mostly following the Lakehouse tutorial provided by Microsoft. Well structured as this one may be, the sizes are not like the sizes I'm seeing in the wild. So I decided to give Fabric a bit more of a challenge by letting … Continue reading Microsoft Fabric, fooling around with TPC-H data
Category: ETL
Learning ADF Part 6
It's been some time since my last post on Azure Data Factory, but I had some fun this week and wanted to share the learnings. This blog will cover how I read files from an sFTP site, use the copy activity if the file hasn't been processed yet and write some data into a table … Continue reading Learning ADF Part 6
Fooling around with TPC-H data, ADF and Hyperscale Serverless
In one of my last blogs, I wrote about my first encounter with the Azure Hyperscale Serverless offering. Now it's time to dig a bit deeper and what it's up to. Disclaimer. Azure Hyperscale Serverless is in preview and one of the things that isn't active yet, is the auto shutdown. This means that it … Continue reading Fooling around with TPC-H data, ADF and Hyperscale Serverless
Azure Hyperscale Serverless, first impressions
As some of you know, I've written a series of blog posts on Azure SQL Databases and there's an accompanying session that I had the honour of presenting a number of times. Now Azure keeps developing new offers and one of these went in public preview February 15th. An offer I hadn't seen coming. You … Continue reading Azure Hyperscale Serverless, first impressions
T-SQL Tuesday #159 – What’s Your New Favourite Feature?
This month Deepthi Goguri invites us (the community) to write about two topics: our favourite new feature of SQL Server 2022 and your new years resolutions. You can find her blog here, her LinkedIn profile here and she's also on Twitter here. Favourite new SQL Server 2022 feature Most of my work is in data … Continue reading T-SQL Tuesday #159 – What’s Your New Favourite Feature?
Azure Data Factory and Soap, an opera?
Getting data from an API can be hard, especially when you're trying to get data from a so-called Soap interface. This is a bit of an antique way to distribute data to online applications and has a lot of challenges. I've read a few blogs on this subject but funnily enough, they're all using the … Continue reading Azure Data Factory and Soap, an opera?
Fun ROWNUM() case, get n’th row from dataset.
Last week, one of my coworkers had a nice case. From a dataset, he needed the third row based on an indicator and a timestamp. That sounded a bit vague so I started out with creating a table that contained some records with the columns he'd have to filter on. CREATE TABLE dbo.demo ( id … Continue reading Fun ROWNUM() case, get n’th row from dataset.
Azure SQL Database Performance comparison part 0 of 9: setup
This is the starting point of a series of blogs regarding Azure SQL DB performance. This blog contains the setup and links to all the different database SKU's I've tested so you won't have to scroll endlessly to the part that is of interest to you. I hope you'll find this useful! Click here for … Continue reading Azure SQL Database Performance comparison part 0 of 9: setup
Increase network performance between your VM and Azure SQL Database
For a few weeks I'm facing an issue where an application on an Azure VM has a slow network connection to an Azure SQL database. I've tried different tiers and SKU's but the speed is just not there. When the application is running, it can push about 250 to 500 kb/s to the database. As … Continue reading Increase network performance between your VM and Azure SQL Database
Solving an issue with Always Encrypted
A short blog on how to get Always Encrypted to work in your app and in the ODBC connection.