Summary
Keywords
Full Transcript
Video explains - How to use Data Quality in DLT Pipelines? How to use Expectations in DLT? What are different Actions in Expectations? How to monitor a DLT pipeline? How to monitor a DLT pipeline using SQL queries? How to define data quality rules in DLT pipelines? Chapters 00:00 - Introduction 00:18 - What are Expectations in Databricks DLT? 01:19 - How to define rules for Expectations in DLT? 03:30 - Expectation action - Warning 08:56 - Expectation action - Fail 10:25 - Expectation action - Drop 14:36 - How to Monitor DLT pipelines or Observability? Databricks Website: www.databricks.com Delta Live Tables - https://learn.microsoft.com/en-us/azure/databricks/delta-live-tables/ Monitor DLT pipelines - https://learn.microsoft.com/en-us/azure/databricks/delta-live-tables/observability DLT Expectations and Data Quality - https://learn.microsoft.com/en-us/azure/databricks/delta-live-tables/expectations The series provides a step-by-step guide to learning Databricks, a popular unified Data Intelligence Platform. New video in every 3 days ❤️ Disclaimer: This series is meant only to learning and teaching purpose. The host/tutor can not be held responsible for any misuse or any comments. #databricks #dataengineering #dlt
Continue this lesson in the app
Install CourseHive on Android or iOS to keep learning while you move.
