Azure SQL Performance Testing on ESv5 v DSv2

In a previous blog I talked about the new Esv5 Azure VM Types that looked very promising for SQL Server and data warehousing , perhaps unseating the older DSv2 that we had been recommending. https://prodata.ie/2021/11/03/the-new-king-vm-type-for-sql-has-arrived/ Now that we have upgraded a couple of customers from the 8 or 16 core DS to the equivalent Esv5 … Continue reading Azure SQL Performance Testing on ESv5 v DSv2

EDW Automation Architecture

This blog explores a universal architecture for EDW automation. I’m, attempting to be technology agnostic, so little mention of specifics here. Albeit those who know me, know I am a SQL centric fan boy with a software engineering and Finance background. There are many different technologies for building data warehouses. Currently I see three emerging … Continue reading EDW Automation Architecture

DW Automation demo for Synapse SQL Pools (3/3)

This is the third blog in a series looking at the need for DW Automation focusing on Synapse SQL Pools (dedicated). In the first blog we looked at why we need DW Automation tools and what they look like:https://prodata.ie/2021/09/14/the-need-for-dw-automation-1-3/ In the second blog we looked at a maturity model for DW automation with six levels … Continue reading DW Automation demo for Synapse SQL Pools (3/3)

A DW Automation Maturity Model (2/3)

In a previous blog I talked about the need for DW Automation in order to achieve that holy grail of Agility, Extensibility and perhaps Robustness with our data architecture. This blog is now focusing on some different levels of maturity. What’s different about this maturity model and other ones is that its not necessary better … Continue reading A DW Automation Maturity Model (2/3)

The need for DW Automation (1/3)

Many folks build star schema data warehouses and the supporting ecosystem of Semantic Models, Business Intelligence and/or ML Analytics. This is a quick note on how to assess how you are with automation, regardless of what tools you are using: SSIS,ADF, SQL, data bricks, Synapse, or non Microsoft tools. I recently ran a twitter thread … Continue reading The need for DW Automation (1/3)

Finding Outdated and Missing Stats in Synapse SQL Pools

One recent realization for myself working with Synapse Dedicated SQL Pools is that while they have auto create stats, there is no auto update stats. So statistics will become stale faster than your bread left in the toaster. Rather than updating every 20% or so like traditional SQL Server. In additon, if you create an … Continue reading Finding Outdated and Missing Stats in Synapse SQL Pools

Loading…

Something went wrong. Please refresh the page and/or try again.

Subscribe to Prodata Blog

Get new content delivered directly to your inbox.