Data Engineering on Microsoft Azure - Azure for DE: 03 - Storage account overview

Master Azure Data Engineering: From Ingestion to Analytics with Real-World Projects

4.0 (5)

45 learners

What you'll learn

Design and implement a data ingestion pipeline using Azure Data Factory
Apply security and access controls to an Azure Data Lake Storage account
Transform raw data into a modeled structure using Azure Databricks or Synapse Spark
Deploy and manage Azure Data Factory pipelines using CI/CD practices

This course includes

49.5 hours of video
Certificate of completion
Access on mobile and TV

Summary

Keywords

Azure Azure data engineer DP-203 DP 203 data lake storage account blob service table service queue service file service ETL ELT

Full Transcript

We already know that data lake is a cool thing that is present in Data Lakehouse and Modern Data Warehouse architectures. But what features should it have? And which Azure service could we use to provision one? This video covers those topics. ▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬ My LinkedIn profile: https://www.linkedin.com/in/piotr-tybulewicz-81a8793/ GitHub with my drawings: https://github.com/TybulOnAzure/DP-203 ▬▬▬▬▬▬ SUPPORTING MY CHANNEL ▬▬▬▬▬▬ Buy me a coffee (or beer): https://buymeacoffee.com/piotrv Join this channel to get access to perks: https://www.youtube.com/channel/UCLnXq-Fr-6rAsCitq9nYiGg/join ▬▬▬▬▬▬ CHAPTERS ▬▬▬▬▬▬ 00:00 Introduction 00:27 Data lake revisited 11:24 Data lake features 19:54 Storage account 21:00 Blob service 31:44 Table service 42:53 Queue service 49:35 File service 57:26 ADLSg2 1:08:43 Summary