09 Sorting data, Union and Aggregation in Spark | Difference in Union and UnionAll | Having Clause

PySpark - Zero to Hero | PySpark Tutorial 2025 | Spark Tutorial 2025 | Learn from Basics to Advanced Performance Optimization - 09 Sorting data, Union and Aggregation in Spark | Difference in Union and UnionAll | Having Clause

4.0 (1)

18 learners

What you'll learn

This course includes

9 hours of video
Certificate of completion
Access on mobile and TV

Summary

Keywords

Spark PySpark PySPark Series Spark Series Data Engineering Data Analysis Data Science DataFrame ETL ELT Delta Lake Introduction to Spark

Full Transcript

Video explains - How to sort data in Spark ? How to Union two DataFrames in Spark ? How to Aggregate data in Spark DataFrame ? What is difference between Union and Union All ? How to use unionByName in Spark? Chapters 00:00 - Introduction 00:24 - Data Preparation 01:34 - Union and UnionAll 03:11 - How to Sort data in Spark? 04:30 - How to Aggregate Data in Spark ? 06:49 - Having Clause in Spark Aggregation 08:32 - Bonus Tip Local PySpark Jupyter Lab setup - https://youtu.be/WhxljT3IfdM Python Basics - https://www.learnpython.org/ GitHub URL for code - https://github.com/subhamkharwal/pyspark-zero-to-hero/blob/master/05_sort_union_aggregation.ipynb The series provides a step-by-step guide to learning PySpark, a popular open-source distributed computing framework that is used for big data processing. New video in every 3 days ❤️ #spark #pyspark #python #dataengineering

Continue this lesson in the app

Install CourseHive on Android or iOS to keep learning while you move.

Related Courses

Big Data Analytics Spring 2021

Dive into the World of Big Data: Unleash the Power of Analytics, Hadoop, Spark & More!

⭐ 5.0

3 ratings

25.3 hours

Databricks and PySpark | Full Course |

⭐ 4.0

4 ratings

35.5 hours

Google Cloud End to End Data Engineering Projects

Master End-to-End Data Engineering: Real-Time Streaming, AI Integrations, and High-Performance Systems! Dive into hands-on projects, expert-guided tutorials, and cutting-edge technologies for a standout career in data engineering.