Azure Data Engineering: End-to-End Cloud ETL & Analytics Course
Master Azure Data Engineering: From Ingestion to Analytics with Real-World Projects
4.0(16)
144 learners
What you'll learn
Design and implement a data ingestion pipeline using Azure Data Factory
Apply security and access controls to an Azure Data Lake Storage account
Transform raw data into a modeled structure using Azure Databricks or Synapse Spark
Deploy and manage Azure Data Factory pipelines using CI/CD practices
This course includes
48.5 hours of video
Certificate of completion
Access on mobile and TV
Course content
1 modules
• 56 lessons
• 48.5 hours of video
Azure Data Engineering: End-to-End Cloud ETL & Analytics Course
56 lessons
• 48.5 hours
▶
Azure for DE: 01 - Introduction26:45
Azure for DE: 02 - Brief history of data architectures48:45
Azure for DE: 03 - Storage account overview01:09:39
Azure for DE: 04 - Storage account redundancy40:33
Azure for DE: 05 - Storage account access tiers40:55
Azure for DE: 06 - Common file types (CSV, XML, JSON)52:40
Azure for DE: 07 - Common file types (PARQUET)44:12
Azure for DE: 08 - Common file types (Delta lake)59:17
Azure for DE: 09 - Data lake structure - Raw layer47:52
Azure for DE: 10 - Introduction to Azure Data Factory50:02
Azure for DE: 11 - Dynamic Azure Data Factory57:28
Azure for DE: 12 - Azure Data Factory integration runtimes (part 1)45:55
Azure for DE: 13 - Azure Data Factory integration runtimes (part 2)34:58
Azure for DE: 14 - Error handling in Azure Data Factory01:18:42
Azure for DE: 15 - Questions to ask about new data source46:41
Azure for DE: 16 - Executing ADF pipelines57:20
Azure for DE: 17 - Azure data lake security - anonymous access, access keys45:17
Azure for DE: 18 - Azure data lake security - Azure Key Vault and managed identity47:47
Azure for DE: 19 - Azure data lake security - Shared Access Signature (SAS)47:40
Azure for DE: 20 - Azure data lake security - Role-Based Access Control (RBAC)51:45
Azure for DE: 21 - Azure data lake security - Access Control Lists (ACL)42:43
Azure for DE: 22 - ARM-based CI/CD for Azure Data Factory (part 1)59:21
Azure for DE: 23 - ARM-based CI/CD for Azure Data Factory (part 2)55:22
Azure for DE: 24 - Selective CI/CD for Azure Data Factory with ADF Tools (part 1)49:38
Azure for DE: 25 - Selective CI/CD for Azure Data Factory with ADF Tools (part 2)49:44
Azure for DE: 26 - Introduction to Azure Logic Apps46:53
Azure for DE: 27 - Azure Synapse Analytics: Overview, Pipelines01:07:55
Azure for DE: 28 - 1st milestone (ingest phase recapped + challenge)39:04
Channel membership announcement11:18
Azure for DE: 29 - Introduction to dimensional modeling55:35
Azure for DE: 30 - Slowly changing dimensions, data lake structure48:59
Azure for DE: 31 - Introduction to Azure Databricks01:06:25
Azure for DE: 32 - A closer look at Databricks notebooks01:14:59
Azure for DE: 33 - Connecting to ADLSg2 from Azure Databricks59:34
Azure for DE: 34 - Common data transformations01:05:14
Azure for DE: 35 - Writing data to ADLSg2 from Azure Databricks47:14
Azure for DE: 36 - Automating the process with Azure Databricks Autoloader45:05
Azure for DE: 37 - Orchestrating Databricks notebooks01:02:49
Azure for DE: 38 - Transforming data with dbt47:13
Azure for DE: 39 - Azure Synapse Analytics - Spark Pools53:17
Azure for DE: 40 - Extra features in Azure Synapse Analytics Spark Pools58:52
Azure for DE: 41 - Transforming data with Data Flows58:42
Azure for DE: 42 - 2nd milestone - transform phase recapped31:46
Azure for DE: 43 - Azure Synapse Dedicated SQL Pool - Architecture and overview01:13:35
Azure for DE: 44 - Loading data to Dedicated SQL Pool01:20:36
Azure for DE: 45 - Azure Synapse Dedicated SQL Pool - extra features01:02:39
Azure for DE: 46 - Dedicated SQL Pool security49:57
Azure for DE: 47 - Azure Synapse Analytics - Serverless SQL Pool59:39
Azure for DE: 48 - 3rd milestone - Serve phase recapped32:14
Azure for DE: 49 - Introduction to streaming, Event Hubs49:44
Azure for DE: 50 - Azure Stream Analytics overview01:36:46
Azure for DE: 51 - Handling time & performance in Azure Stream Analytics50:26
Azure for DE: 52 - Data governance with Microsoft Purview55:09
Azure for DE: 53 - 4th milestone - Streaming and data governance recapped30:29
Azure for DE: 54 - Exam overview and course summary38:06
Azure for DE: The universal pattern for incremental data processing39:34
