Summary
Keywords
Full Transcript
Video explains - What is Spark Connect? How Spark Connect Works? What is the difference between Spark Connect and Spark Session? How to setup Spark Connect Server with Cluster? Chapters 00:00 - Introduction 00:44 - What is Spark Connect? 03:00 - Spark Connect Setup with Spark Cluster 09:05 - Spark Connect Client Setup 11:20 - Spark Connect vs Spark Session 21:51 - Spark Connect Medium Blog - PySpark Playlist - https://www.youtube.com/playlist?list=PL2IsFZBGM_IHCl9zhRVC1EXTomkEp_1zm - Databricks Playlist - https://www.youtube.com/playlist?list=PL2IsFZBGM_IGiAvVZWAEKX8gg1ItnxEEb - Medium Blog - https://blog.devgenius.io/pyspark-what-is-spark-connect-f68c8b44bef5 - GitHub URL for docker images for cluster setup - https://github.com/subhamkharwal/docker-images Connect with me - https://www.linkedin.com/in/subhamkharwal The series provides a step-by-step guide to learning PySpark, a popular open-source distributed computing framework that is used for big data processing.
