Summary
Keywords
Full Transcript
#pyspark #spark #dataengineering Union and union all in pyspark Union in pyspark union all in pyspark Want more similar videos- hit like, comment, share and subscribe ❤️Do Like, Share and Comment ❤️ ❤️ Like Aim 5000 likes! ❤️ ➖➖➖➖➖➖➖➖➖➖➖➖➖ Please like & share the video. dataset import pyspark from pyspark.sql import SparkSession data1 = [("James","Sales","NY",90000,34,10000), \ ("Michael","Sales","NY",86000,56,20000), \ ("Robert","Sales","CA",81000,30,23000), \ ("Maria","Finance","CA",90000,24,23000) \ ] columns= ["employee_name","department","state","salary","age","bonus"] data2 = [("James","Sales","NY",90000,34,10000), \ ("Maria","Finance","CA",90000,24,23000), \ ("Jen","Finance","NY",79000,53,15000), \ ("Jeff","Marketing","CA",80000,25,18000), \ ("Kumar","Marketing","NY",91000,50,21000) \ ] columns2= ["employee_name","department","state","salary","age","bonus"] df2 =spark.createDataFrame(data=data2,schema=columns2) df2.show() ➖➖➖➖➖➖➖➖➖➖➖➖➖ AWS DATA ENGINEER : https://www.youtube.com/playlist?list=PLOlK8ytA0MghpdMjb0m9zu1v9s_qbRP0q Azure data factory : https://youtube.com/playlist?list=PLOlK8ytA0MgguN5XidtQXbILxwCdJCUJE&si=iEICXHP80zGchUYh Azure data engineer playlist : https://youtube.com/playlist?list=PLOlK8ytA0MghBrzu0i6WlTBdoO1WdwV_e SQL PLAYLIST : https://www.youtube.com/playlist?list=PLOlK8ytA0MggGXIKmbfZ-_Xqcos3JKdV- PYSPARK PLAYLIST - https://www.youtube.com/playlist?list=PLOlK8ytA0MgjvOpd-088NRU_vTYw_aryH ➖➖➖➖➖➖➖➖➖➖➖➖➖ 📣Want to connect with me? Check out these links:📣 Join telegram to discuss https://t.me/+Cb98j1_fnZs3OTA1 ➖➖➖➖➖➖➖➖➖➖➖➖➖ what we have covered in this video: PySpark for beginners,PySpark Playlist,PySpark Videos,Learn PySpark,PySpark for data engineers,dataengineers PySpark,PySpark in Azure Synapse Analytics,PySpark in Azure databricks,Understand PySpark,What is PySpark,PySpark in simple explaination,PySpark Overview,synapse pyspark,spark,pyspark,union() in pyspark,unionAll() in pyspark,merge rows from two dataframes using pyspark,pyspark union(),pyspark unionAll(),azure databricks ➖➖➖➖➖➖➖➖➖➖➖➖➖ Hope you liked this video and learned something new :) See you in next video, until then Bye-Bye! ➖➖➖➖➖➖➖➖➖➖➖➖➖
Continue this lesson in the app
Install CourseHive on Android or iOS to keep learning while you move.
