The need for DW Automation (1/3)

Many folks build star schema data warehouses and the supporting ecosystem of Semantic Models, Business Intelligence and/or ML Analytics. This is a quick note on how to assess how you are with automation, regardless of what tools you are using: SSIS,ADF, SQL, data bricks, Synapse, or non Microsoft tools. I recently ran a twitter thread … Continue reading The need for DW Automation (1/3)

CI/CD for Azure Synapse Analytics – Part 1

Do you also wonder how to do continuous integration (CI) and continuous deployment (CD) for Synapse Analytics? ┬áBut first, lets talk about basic, what is CI/CD is simple terms. CI/CD is one of the best practices of agile methodology and it enables development teams to deploy stable and tested code changes more frequently. ┬áThis practice … Continue reading CI/CD for Azure Synapse Analytics – Part 1

Standalone or Integrated flavour of your Dedicated Pool (sqldw)

Now that MSFT have released Synapse as an Integrated framework of tools for Data Engineering we have two different ways to provision our enterprise data warehouse in a dedicated sql pool. Which is the best one to use ? Firstly we can use the new Integrated experience with the dedicated pool owned by Synapse Workspace. … Continue reading Standalone or Integrated flavour of your Dedicated Pool (sqldw)

Data Lake Storage to Synapse Analytics using Managed Service Identity (MSI) – COPY INTO and PolyBase

Why to use MSI? Easy to authenticate any Azure Active Directory supported service Provides limited visibility of the credentials More secured than SQL authentication and less susceptible to hacking Configuration steps Create a storage account and enable Hierarchical namespace for Data Lake Storage Gen2. Within storage account, create a container for file system . Navigate … Continue reading Data Lake Storage to Synapse Analytics using Managed Service Identity (MSI) – COPY INTO and PolyBase

Loading…

Something went wrong. Please refresh the page and/or try again.

Subscribe to Prodata Blog

Get new content delivered directly to your inbox.