Course Hive
Search

Welcome

Sign in or create your account

Continue with Google
or
Azure for DE: 33 - Connecting to ADLSg2 from Azure Databricks
Play lesson

Data Engineering on Microsoft Azure - Azure for DE: 33 - Connecting to ADLSg2 from Azure Databricks

Master Azure Data Engineering: From Ingestion to Analytics with Real-World Projects

4.0 (5)
45 learners

What you'll learn

Design and implement a data ingestion pipeline using Azure Data Factory
Apply security and access controls to an Azure Data Lake Storage account
Transform raw data into a modeled structure using Azure Databricks or Synapse Spark
Deploy and manage Azure Data Factory pipelines using CI/CD practices

This course includes

  • 49.5 hours of video
  • Certificate of completion
  • Access on mobile and TV

Summary

Keywords

Full Transcript

Hey data engineers! Although there are multiple methods to connect to ADLSg2, I made the unfortunate choice when accessing it from Azure Databricks as I used the worst one. However, there's no need to fret – there's a better way. Join me in the 33rd episode of my free DP-203 course, where I discuss the method recommended by Databricks, as well as legacy and deprecated options. Additionally, you'll learn why I sometimes opt for the latter ones. Enjoy! ▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬ My LinkedIn profile: https://www.linkedin.com/in/piotr-tybulewicz-81a8793/ GitHub with my drawings: https://github.com/TybulOnAzure/DP-203 Documentation: https://learn.microsoft.com/en-us/azure/databricks/connect/storage/azure-storage Mount points: https://learn.microsoft.com/en-us/azure/databricks/dbfs/mounts?source=recommendations AAD credentials passthrough: https://learn.microsoft.com/en-us/azure/databricks/archive/credential-passthrough/adls-passthrough ▬▬▬▬▬▬ MEMBERSHIP ▬▬▬▬▬▬ Join this channel to get access to perks: https://www.youtube.com/channel/UCLnXq-Fr-6rAsCitq9nYiGg/join ▬▬▬▬▬▬ CHAPTERS ▬▬▬▬▬▬ 00:00 Introduction 00:24 Our scenario 02:19 Unity Catalog 04:23 Access via account key 05:23 Access via service principal 18:04 Access via SAS token 21:16 Secret scopes 36:07 Access via mount points 48:24 Access via AAD credentials passthrough 58:46 Summary

Course Hive

Continue this lesson in the app

Install CourseHive on Android or iOS to keep learning while you move.

Related Courses

FAQs

Course Hive
Download CourseHive
Keep learning anywhere