Recreating a Power BI GIT Repos in Azure DevOps

In a previous blog, I showed how to shrink a GIT repos using git commands and the opensource bfg-cleaner to remove history of large PBIX files.https://prodata.ie/2021/10/23/shrinking-azure-repos-bloat-due-to-powerbi/ Sometimes the patient is just to sick and its too messy to clean-up, so we nuke from orbit. Essentially creating a fresh repos and getting developers to re-clone. Sure … Continue reading Recreating a Power BI GIT Repos in Azure DevOps

Enabling Managed Identity Authentication on Azure Functions in Data Factory

This blog shows you how to enable Managed Identity on an Azure Function call from ADF, this can help secure the Function by adding a second authentication method on top of the API Key. Enabling these options enforces https on all function calls, ADF handles authentication and so no custom headers, tokens or keys are … Continue reading Enabling Managed Identity Authentication on Azure Functions in Data Factory

SQL Storage Fundamentals for Azure VMs

Thx to anyone looking at my session at #SsqlBits on SQL Storage fundamentals for Azure VMs. Here is a copy of my slide deck if you want to see any of the links or content.

Meta data Automation at SqlBits 2022

The absolute key to getting agility and extensibility in a data warehouse project is a good meta data based automation framework and tools, regardless of whether you are using TSQL, Pool, Databricks and/or Python. If you are coming to SqlBits 2022, then there are a few sessions touching on this subjects. Full Schedule on this … Continue reading Meta data Automation at SqlBits 2022

Power BI- Data Connectivity Modes

Import Data This connection means that Power BI will cache the data meaning Pulling data from Data Source and into Power BI Desktop File. Advantages: Caching the data makes you take full advantage of Vertipaq Engine. Report Performance will be better using Import. Able to Use full capabilities of Power BI using relationship types, M … Continue reading Power BI- Data Connectivity Modes

Azure SQL Performance Testing on ESv5 v DSv2

In a previous blog I talked about the new Esv5 Azure VM Types that looked very promising for SQL Server and data warehousing , perhaps unseating the older DSv2 that we had been recommending. https://prodata.ie/2021/11/03/the-new-king-vm-type-for-sql-has-arrived/ Now that we have upgraded a couple of customers from the 8 or 16 core DS to the equivalent Esv5 … Continue reading Azure SQL Performance Testing on ESv5 v DSv2

EDW Automation Architecture

This blog explores a universal architecture for EDW automation. I’m, attempting to be technology agnostic, so little mention of specifics here. Albeit those who know me, know I am a SQL centric fan boy with a software engineering and Finance background. There are many different technologies for building data warehouses. Currently I see three emerging … Continue reading EDW Automation Architecture

Loading…

Something went wrong. Please refresh the page and/or try again.

Subscribe to Prodata Blog

Get new content delivered directly to your inbox.