Import Json using SQL Dedicated Pool in Azure Synapse Analytics (SQLDW)
This blog shows how to easily Extract Json and XML objects and Arrays into SQDW using COPY INTO SQLDW is a bit behind other vendors like snowflake when it comes to being able to query Json natively off a data lake as they have native support. To get around this we simply load the Json … Continue reading Import Json using SQL Dedicated Pool in Azure Synapse Analytics (SQLDW)
Bob Duffy – User Group and Event Sessions for 2022
If you are running a SQL/Data User group or event I’m always happy to do a 50-60 minute virtual talk. Let me know bob@prodata.ie or @bob_duffy on twitter. 2022 Session Options 01. SqlPool Maintenance Fundamentals SQL Pools now support auto create status. But they do not support auto update stats and don’t quite have the … Continue reading Bob Duffy – User Group and Event Sessions for 2022
SQL Storage Fundamentals for Azure VMs
Thx to anyone looking at my session at #SsqlBits on SQL Storage fundamentals for Azure VMs. Here is a copy of my slide deck if you want to see any of the links or content.
Meta data Automation at SqlBits 2022
The absolute key to getting agility and extensibility in a data warehouse project is a good meta data based automation framework and tools, regardless of whether you are using TSQL, Pool, Databricks and/or Python. If you are coming to SqlBits 2022, then there are a few sessions touching on this subjects. Full Schedule on this … Continue reading Meta data Automation at SqlBits 2022
Selecting the right Azure VM for SQL
When looking for the right VM for SQL we need to look at a lot of factors, but mainly these four factors Throughput of VM (Cached and Uncached) Cores Available VM Memory GN Cost per month (compute and SQL license) This can be difficult to do as may current tools to pick a VM don’t … Continue reading Selecting the right Azure VM for SQL
Power BI- Data Connectivity Modes
Import Data This connection means that Power BI will cache the data meaning Pulling data from Data Source and into Power BI Desktop File. Advantages: Caching the data makes you take full advantage of Vertipaq Engine. Report Performance will be better using Import. Able to Use full capabilities of Power BI using relationship types, M … Continue reading Power BI- Data Connectivity Modes
Azure SQL Performance Testing on ESv5 v DSv2
In a previous blog I talked about the new Esv5 Azure VM Types that looked very promising for SQL Server and data warehousing , perhaps unseating the older DSv2 that we had been recommending. https://prodata.ie/2021/11/03/the-new-king-vm-type-for-sql-has-arrived/ Now that we have upgraded a couple of customers from the 8 or 16 core DS to the equivalent Esv5 … Continue reading Azure SQL Performance Testing on ESv5 v DSv2
EDW Automation Architecture
This blog explores a universal architecture for EDW automation. I’m, attempting to be technology agnostic, so little mention of specifics here. Albeit those who know me, know I am a SQL centric fan boy with a software engineering and Finance background. There are many different technologies for building data warehouses. Currently I see three emerging … Continue reading EDW Automation Architecture
The new King VM Type for SQL has arrived!
Hot of the announcements at Microsoft Ignite conference is the arrival of some new Memory Optimised VM Types. For those of you configuring SQL workloads on VMs, the DSv2 series has always been the “goto” VM Type for 8 and 16 core workloads, due to the higher RAM to core and IOPS to core ratios. … Continue reading The new King VM Type for SQL has arrived!
DW Automation demo for Synapse SQL Pools (3/3)
This is the third blog in a series looking at the need for DW Automation focusing on Synapse SQL Pools (dedicated). In the first blog we looked at why we need DW Automation tools and what they look like:https://prodata.ie/2021/09/14/the-need-for-dw-automation-1-3/ In the second blog we looked at a maturity model for DW automation with six levels … Continue reading DW Automation demo for Synapse SQL Pools (3/3)
Shrinking Azure Repos Bloat due to PowerBI
The world of source control for PowerBI is kinda in conflict On one side we need to use Source control and even Microsoft tools like Power BI deployment pipelines or your own CI/CD put PBIX files in GIT. On the orther side GIT has clear guidelines not to store large/binary files. If you have put … Continue reading Shrinking Azure Repos Bloat due to PowerBI
A DW Automation Maturity Model (2/3)
In a previous blog I talked about the need for DW Automation in order to achieve that holy grail of Agility, Extensibility and perhaps Robustness with our data architecture. This blog is now focusing on some different levels of maturity. What’s different about this maturity model and other ones is that its not necessary better … Continue reading A DW Automation Maturity Model (2/3)
Loading…
Something went wrong. Please refresh the page and/or try again.
always on Azure backups Cloud consolidation Cube DW EDW ERP Events Featured Finance Financial Reporting Irish Economic Crisis Licencing Load Test Maestro Many to Many MasterClass MCM mdx Modelling MOLAP OLAP Partitioning Performance Personal Power BI PowerPivot Power View scom SQL SQLBits sqldw SQL IO SQL Saturday SQL Server SSAS SSIS storage Syanpse Synapse Tabular TSQL Virtualization
Subscribe to Prodata Blog
Get new content delivered directly to your inbox.