Summary
Keywords
Full Transcript
#adf #azuredataengineer #azuredatafactory #dataengineering #databricks In this video, I discussed about Slowly changing Dimension Type1 using mapping data flows in azure data factory we have done SCD Type 1 Project using azure data factory Want more similar videos- hit like, comment, share and subscribe ❤️Do Like, Share and Comment ❤️ ❤️ Like Aim 5000 likes! ❤️ ➖➖➖➖➖➖➖➖➖➖➖➖➖ Please like & share the video. ➖➖➖➖➖➖➖➖➖➖➖➖➖ Chapters: 0:00 Introduction 1:40 SCD Type 1 4:50 dataset 6:13 azure data factory project ➖➖➖➖➖➖➖➖➖➖➖➖➖ SQL script: ➖➖➖➖ CREATE TABLE employee ( employee_id INT, FirstName NVARCHAR(128), salary INT, location NVARCHAR(128) ) INSERT INTO EMPLOYEE VALUES(1,'manish',10000,'india') INSERT INTO EMPLOYEE VALUES(2,'NEHA',5000,'india') INSERT INTO EMPLOYEE VALUES(4,'SURYA',5000,'UK') CSV dataset : ➖➖➖➖ emp_id,name,salary,loc 1,manish,20000,india 5,hari,5000,UK 3,rahul,10000,india ➖➖➖➖➖➖➖➖➖➖➖➖➖ AWS DATA ENGINEER : https://www.youtube.com/playlist?list=PLOlK8ytA0MghpdMjb0m9zu1v9s_qbRP0q Azure data engineer playlist : https://youtube.com/playlist?list=PLOlK8ytA0MghBrzu0i6WlTBdoO1WdwV_e SQL PLAYLIST : https://www.youtube.com/playlist?list=PLOlK8ytA0MggGXIKmbfZ-_Xqcos3JKdV- PYSPARK PLAYLIST - https://www.youtube.com/playlist?list=PLOlK8ytA0MgjvOpd-088NRU_vTYw_aryH ➖➖➖➖➖➖➖➖➖➖➖➖➖ 📣Want to connect with me? Check out these links:📣 Join telegram to discuss https://t.me/+Cb98j1_fnZs3OTA1 ➖➖➖➖➖➖➖➖➖➖➖➖➖ what we have covered in this video: Welcome to our Azure Data Factory project tutorial! In this comprehensive guide, we'll walk you through the implementation of Slowly Changing Dimension (SCD) Type 1 methodology using Azure Data Factory. Learn how to efficiently manage changes to your data, ensuring accuracy and consistency throughout your pipelines. Follow along step-by-step as we demonstrate best practices, tips, and tricks for seamless data management in the cloud. Whether you're a beginner or an experienced data engineer, this tutorial will equip you with the skills needed to tackle real-world data challenges with confidence. Let's dive in and harness the power of Azure Data Factory for effective data management!" ➖➖➖➖➖➖➖➖➖➖➖➖➖ Hope you liked this video and learned something new :) See you in next video, until then Bye-Bye! ➖➖➖➖➖➖➖➖➖➖➖➖➖ Tags: Azure Data Factory Data Management Slowly Changing Dimension (SCD) ETL (Extract, Transform, Load) Data Integration Cloud Data Warehousing Data Pipelines Data Transformation Azure Services Big Data Processing Data Engineering Data Migration Business Intelligence (BI) Data Warehousing Azure Synapse Analytics Azure Data Engineer Data Engineering Azure Data Platform ETL (Extract, Transform, Load) Data Integration Data Pipelines Big Data Processing Data Warehousing SQL Server Integration Services (SSIS) Azure Data Factory Azure Synapse Analytics Data Lake Azure Databricks Data Modeling Data Governance
Continue this lesson in the app
Install CourseHive on Android or iOS to keep learning while you move.
