Real move on Data Lake using Rest API on ADF
There are many times where I’ve needed to move a file using Azure’s Data Factory and found it weird that the only native option provided is to copy the file, then delete it. Many reading know that disk level renames … Continue reading Real move on Data Lake using Rest API on ADF
Recreating a Power BI GIT Repos in Azure DevOps
In a previous blog, I showed how to shrink a GIT repos using git commands and the opensource bfg-cleaner to remove history of large PBIX files.https://prodata.ie/2021/10/23/shrinking-azure-repos-bloat-due-to-powerbi/ Sometimes the patient is just to sick and its too messy to clean-up, so … Continue reading Recreating a Power BI GIT Repos in Azure DevOps
Bug – Synapse SqlPool Language and dates
We found this interesting bug on Dedicated SQL Pool when working with British style language. If you use Dynamic SQL to change the language, then selects on the date fail with a conversion error, but prints work. Weird… An example … Continue reading Bug – Synapse SqlPool Language and dates
SqlDW / Synapse – TABLE Variable Compatibility
Azure Synapse SQL does not support the the use of TABLE variable. Therefore a workaround is to use Temporary Tables in SqlDW. If we run the below statement in Synapse SQL then it willa throw syntax error as below: Alternative … Continue reading SqlDW / Synapse – TABLE Variable Compatibility
Enabling Managed Identity Authentication on Azure Functions in Data Factory
This blog shows you how to enable Managed Identity on an Azure Function call from ADF, this can help secure the Function by adding a second authentication method on top of the API Key. Enabling these options enforces https on … Continue reading Enabling Managed Identity Authentication on Azure Functions in Data Factory
Import Json using SQL Dedicated Pool in Azure Synapse Analytics (SQLDW)
This blog shows how to easily Extract Json and XML objects and Arrays into SQDW using COPY INTO SQLDW is a bit behind other vendors like snowflake when it comes to being able to query Json natively off a data … Continue reading Import Json using SQL Dedicated Pool in Azure Synapse Analytics (SQLDW)
Bob Duffy – User Group and Event Sessions for 2022
If you are running a SQL/Data User group or event I’m always happy to do a 50-60 minute virtual talk. Let me know bob@prodata.ie or @bob_duffy on twitter. 2022 Session Options 01. SqlPool Maintenance Fundamentals SQL Pools now support auto … Continue reading Bob Duffy – User Group and Event Sessions for 2022
SQL Storage Fundamentals for Azure VMs
Thx to anyone looking at my session at #SsqlBits on SQL Storage fundamentals for Azure VMs. Here is a copy of my slide deck if you want to see any of the links or content.
Meta data Automation at SqlBits 2022
The absolute key to getting agility and extensibility in a data warehouse project is a good meta data based automation framework and tools, regardless of whether you are using TSQL, Pool, Databricks and/or Python. If you are coming to SqlBits … Continue reading Meta data Automation at SqlBits 2022
Selecting the right Azure VM for SQL
When looking for the right VM for SQL we need to look at a lot of factors, but mainly these four factors Throughput of VM (Cached and Uncached) Cores Available VM Memory GN Cost per month (compute and SQL license) … Continue reading Selecting the right Azure VM for SQL
Power BI- Data Connectivity Modes
Import Data This connection means that Power BI will cache the data meaning Pulling data from Data Source and into Power BI Desktop File. Advantages: Caching the data makes you take full advantage of Vertipaq Engine. Report Performance will be … Continue reading Power BI- Data Connectivity Modes
Azure SQL Performance Testing on ESv5 v DSv2
In a previous blog I talked about the new Esv5 Azure VM Types that looked very promising for SQL Server and data warehousing , perhaps unseating the older DSv2 that we had been recommending. https://prodata.ie/2021/11/03/the-new-king-vm-type-for-sql-has-arrived/ Now that we have upgraded … Continue reading Azure SQL Performance Testing on ESv5 v DSv2
Loading…
Something went wrong. Please refresh the page and/or try again.