Summary
Keywords
Full Transcript
Video explains - How to get unique data in Spark ? How to use Window Functions in Spark ? How to write Window Functions in PySpark? How to use Databricks Community Cloud ? Chapters 00:00 - Introduction 00:55 - How to get Unique data in Spark? 02:08 - How to use Window Functions in Spark? 04:47 - Second Highest Salary 07:12 - Window Functions using Spark expr 08:22 - Bonus Tip - Databricks Community Cloud Local PySpark Jupyter Lab setup - https://youtu.be/WhxljT3IfdM Python Basics - https://www.learnpython.org/ GitHub URL for code - https://github.com/subhamkharwal/pyspark-zero-to-hero/blob/master/06_unique_data_and_window.ipynb Databricks Community Cloud - https://community.cloud.databricks.com/login.html The series provides a step-by-step guide to learning PySpark, a popular open-source distributed computing framework that is used for big data processing. New video in every 3 days ❤️ #spark #pyspark #python #dataengineering
