Data Engineering on Microsoft Azure - Azure for DE: 51 - Handling time & performance in Azure Stream Analytics

Hey data engineers! Did you know that time management is crucial in streaming solutions? Have you ever faced the challenge of dealing with events that arrive out of order or with significant latency? And how can you be sure your solution is performing optimally? It’s better to address these issues proactively before they impact your users. Join me in the 51st episode of my free DP-203 course, where I dive into these important topics. Enjoy! ▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬ My LinkedIn profile: https://www.linkedin.com/in/piotr-tybulewicz-81a8793/ GitHub with my drawings: https://github.com/TybulOnAzure/DP-203 Event ordering overview: https://learn.microsoft.com/en-us/azure/stream-analytics/event-ordering Time management overview: https://learn.microsoft.com/en-us/stream-analytics-query/time-management-azure-stream-analytics ▬▬▬▬▬▬ MEMBERSHIP ▬▬▬▬▬▬ Join this channel to get access to perks: https://www.youtube.com/channel/UCLnXq-Fr-6rAsCitq9nYiGg/join ▬▬▬▬▬▬ CHAPTERS ▬▬▬▬▬▬ 00:00 Introduction 00:44 Time in streaming 03:44 Issues with time 17:35 Late arrival policy 26:45 Out-of-order policy 29:31 Performance 33:24 Embarassingly parallel jobs 47:06 Visual editor 48:45 Summary