Data Engineering on Microsoft Azure - Azure for DE: 45 - Azure Synapse Dedicated SQL Pool - extra features

Hey data engineers! Imagine we’ve designed our Dedicated SQL Pool using a star schema and allowed users to query it. But now we’re getting complaints that it’s incredibly slow, and users have to wait too long for the data. How can we handle concurrent workloads in a Dedicated SQL Pool? How can we prioritize important queries to ensure they are processed first? How can we reserve resources to ensure those queries are executed efficiently? This is where workload management comes into play. Join me in the 45th episode of my free DP-203 course, where I cover these topics. Additionally, I discuss other cool features like partitioning and result set caching. Enjoy! ▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬ My LinkedIn profile: https://www.linkedin.com/in/piotr-tybulewicz-81a8793/ GitHub with my drawings: https://github.com/TybulOnAzure/DP-203 Workload management: https://learn.microsoft.com/en-us/azure/synapse-analytics/sql-data-warehouse/sql-data-warehouse-workload-management Concurrency maximums for workload groups: https://learn.microsoft.com/en-us/azure/synapse-analytics/sql-data-warehouse/memory-concurrency-limits#concurrency-maximums-for-workload-groups Result set caching: https://learn.microsoft.com/en-us/azure/synapse-analytics/sql-data-warehouse/performance-tuning-result-set-caching Partitioning: https://learn.microsoft.com/en-us/azure/synapse-analytics/sql-data-warehouse/sql-data-warehouse-tables-partition?context=%2Fazure%2Fsynapse-analytics%2Fcontext%2Fcontext IDENTITY: https://learn.microsoft.com/en-us/azure/synapse-analytics/sql-data-warehouse/sql-data-warehouse-tables-identity PIVOT: https://learn.microsoft.com/en-us/sql/t-sql/queries/from-using-pivot-and-unpivot?toc=%2Fazure%2Fsynapse-analytics%2Fsql-data-warehouse%2Ftoc.json&bc=%2Fazure%2Fsynapse-analytics%2Fsql-data-warehouse%2Fbreadcrumb%2Ftoc.json&view=azure-sqldw-latest&preserve-view=true DBCC PDW_SHOWSPACEUSED: https://learn.microsoft.com/en-us/sql/t-sql/database-console-commands/dbcc-pdw-showspaceused-transact-sql?view=aps-pdw-2016-au7 ▬▬▬▬▬▬ MEMBERSHIP ▬▬▬▬▬▬ Join this channel to get access to perks: https://www.youtube.com/channel/UCLnXq-Fr-6rAsCitq9nYiGg/join ▬▬▬▬▬▬ CHAPTERS ▬▬▬▬▬▬ 00:00 Introduction 00:23 Workload management 24:47 Result set caching 32:40 Partitioning 54:04 PIVOT/UNPIVOT 57:22 IDENTITY 59:48 Detecting data skew 1:01:44 Summary