PySpark - Zero to Hero | PySpark Tutorial 2025 | Spark Tutorial 2025 | Learn from Basics to Advanced Performance Optimization - 08 Working with Strings, Dates and Null | Regex Replace | Convert string to date | Transform NULL

Video explains - How to use Case When in Spark ? How to manipulate String data in Spark DataFrames? How to cast dates in Spark ? How to extract date portions in Spark ? How to work with NULL data in Spark ? Chapters 00:00 - Introduction 01:08 - How to use Case When in Spark? 04:30 - String Regex Replace 06:00 - How to convert string to date in Spark? 08:10 - How to add current date or timestamp in Spark ? 10:07 - How to drop NULL records in Spark ? 10:50 - How to transform NULL Columns in Spark ? 12:18 - Fix DataFrame 14:00 - Bonus Tip Local PySpark Jupyter Lab setup - https://youtu.be/WhxljT3IfdM Python Basics - https://www.learnpython.org/ GitHub URL for code - https://github.com/subhamkharwal/pyspark-zero-to-hero/blob/master/04_string_and_dates.ipynb Documentation Spark Functions - https://spark.apache.org/docs/latest/api/python/reference/pyspark.sql/functions.html Documentation Date/Timestamp Patterns - https://spark.apache.org/docs/latest/sql-ref-datetime-pattern.html The series provides a step-by-step guide to learning PySpark, a popular open-source distributed computing framework that is used for big data processing. New video in every 3 days ❤️ #spark #pyspark #python #dataengineering