Data Engineering on Microsoft Azure - Azure for DE: 23 - ARM-based CI/CD for Azure Data Factory (part 2)

Hey data engineers! Do you think that it is difficult to set up ADF CI/CD process that I presented it my last video? Not at all - if you use plug and play templates provided by Adam Marczak. Don't you believe me? Well, just join me in the 23rd episode of my free DP-203 course where I set it up from scratch within just 60 minutes. ▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬ My LinkedIn profile: https://www.linkedin.com/in/piotr-tybulewicz-81a8793/ GitHub with my drawings: https://github.com/TybulOnAzure/DP-203 Adam's GitHub repo: https://github.com/MarczakIO/azure-enterprise-templates CI/CD documentation for ADF: https://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery ADF parametrization: https://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-resource-manager-custom-parameters ▬▬▬▬▬▬ MEMBERSHIP ▬▬▬▬▬▬ Join this channel to get access to perks: https://www.youtube.com/channel/UCLnXq-Fr-6rAsCitq9nYiGg/join ▬▬▬▬▬▬ CHAPTERS ▬▬▬▬▬▬ 00:00 Introduction 00:22 Setup overview 03:49 Git configuration in ADF 07:08 Include global parameters in ARM 07:49 Add package.json file 09:21 Add adf-build-job.yml file 11:36 Create Azure DevOps pipeline 18:40 Add adf-deploy-job-yml file 19:29 Add Service connections 30:48 Create Azure DevOps Environments 33:00 Create Variable Groups 39:23 Add deployment stage to our CICD pipelin 52:50 Summary