Summary
Keywords
Full Transcript
#pyspark #spark #dataengineer #azuredataengineer How to install spark and PySpark on Windows use pyspark in jupyter notebook we're going to setup Apache Spark (PySpark) on Windows PC where we have installed JDK, Python, Hadoop and Apache Spark. This video shows how we can install pyspark on windows and use it with jupyter notebook. pyspark is used for Data Science( Data Analytics ,Big data, Machine Learning etc) Want more similar videos- hit like, comment, share and subscribe ❤️Do Like, Share and Comment ❤️ ❤️ Like Aim 5000 likes! ❤️ ➖➖➖➖➖➖➖➖➖➖➖➖➖ Please like & share the video. ➖➖➖➖➖➖➖➖➖➖➖➖➖ Chapters: 0:00 Introduction 0:55 Anaconda Installaton 1:44 Java Jdk install for spark 3:28 apache spark installation 4:54 winutils setup 5:50 environmental setup 7:52 pyspark setup ➖➖➖➖➖➖➖➖➖➖➖➖➖ Steps to follow Download urls: Anaconda- https://www.anaconda.com/download Java jdk- https://www.oracle.com/in/java/technologies/javase/javase8-archive-downloads.html Apache spark - https://spark.apache.org/downloads.html Winutils- https://github.com/cdarlint/winutils commands 1.conda create new --name pyspark 2.conda activate pyspark 3.conda install -c conda-forge findspark 4.conda install jupyter or pip install jupter notebook 5.jupyter notebook command to check import findpark findspark.init() findspark.find() import pyspark ➖➖➖➖➖➖➖➖➖➖➖➖➖ AWS DATA ENGINEER : https://www.youtube.com/playlist?list=PLOlK8ytA0MghBR5BIBY9nDGZMwc1nrztc Azure data engineer playlist : https://youtube.com/playlist?list=PLOlK8ytA0MghBrzu0i6WlTBdoO1WdwV_e SQL PLAYLIST : https://www.youtube.com/playlist?list=PLOlK8ytA0MggGXIKmbfZ-_Xqcos3JKdV- PYSPARK PLAYLIST - https://www.youtube.com/playlist?list=PLOlK8ytA0MgjvOpd-088NRU_vTYw_aryH ➖➖➖➖➖➖➖➖➖➖➖➖➖ 📣Want to connect with me? Check out these links:📣 Join telegram to discuss https://t.me/+Cb98j1_fnZs3OTA1 ➖➖➖➖➖➖➖➖➖➖➖➖➖ what we have covered in this video: Audience This tutorial has been prepared for professionals/students aspiring to learn deep knowledge of Big Data Analytics using Apache Spark and become a Spark Developer and Data Engineer roles. In addition, it would be useful for Analytics Professionals and ETL developers as well. ➖➖➖➖➖➖➖➖➖➖➖➖➖ Hope you liked this video and learned something new :) See you in next video, until then Bye-Bye! ➖➖➖➖➖➖➖➖➖➖➖➖➖ #pyspark #bigdata #datascience #dataanalytics #datascientist #spark #dataengineering #apachespark
Continue this lesson in the app
Install CourseHive on Android or iOS to keep learning while you move.
