Recently, we had to be creative to design a lock system in Azure Data Factory to prevent concurrent pipeline execution. There are actually two different approaches to this challenge! This blog post will describe the first approach and is co-authored…
Out of the box, Azure Data Lake Storage Gen2 provides redundant storage. Therefore, the data in your Data Lake(house) is resilient to transient hardware failures within a datacenter through automated replicas. This ensures durability and high availability. In this blog…
I am a fan of using semantic versioning (a.k.a. SemVer) for data solutions, following the v1.0.0 pattern. It helps in the communication between team members and stakeholders, by limiting ambiguity and misunderstandings related to the version of your solution's releases.…
If you're working with multiple Azure Databricks workspaces at the same time it can be very hard to keep those workspaces apart. Personally I struggled to keep track of the dev / tst / acc / prd workspaces. Luckily, Henko…
In addition to adding a Service Principal to all Power BI workspaces, it is also useful to have a script for removing, right 😃? Check out the RemoveServicePrincipalFromPowerBIWorkspaces.ps1 gist on GitHub. It's also framed below (same script). Script details This…
The Microsoft Ignite 2020 virtual conference is starting today! It is online and free to attend. If you have not registered, do it quickly! As there are over 800 sessions, it can be overwhelming to build your schedule and find…
I've created a PowerShell script that will add a given Service Principal to all (configured) Power BI workspaces. This can be useful or even required for all kinds of scenarios, but I recently needed such a script for my BPAA…
Ever since the XMLA endpoint came available for data models in the Power BI service, I've been thinking about a way to use the Best Practice Analyzer of Tabular Editor to check all the existing data models in the Service…
Every now and then I need to draw a diagram for a solution or platform architecture, and enjoy doing that! I usually spend more time on them then planned 🙄. There are lots of tools to create these diagrams, and…
This is part 3 of my series on 'Automatic TeslaCam And Sentry Mode Video Processing In Azure'. Check out the overview post, or the 2nd post about how to configure the Azure resources. In this post, I describe how to…