Summary
Keywords
Full Transcript
#dataengineerinterview #dataengineering #dataengineer PySpark interview questions How to handle null values in pyspark pyspark null values problem Want more similar videos- hit like, comment, share and subscribe ❤️Do Like, Share and Comment ❤️ ❤️ Like Aim 5000 likes! ❤️ ➖➖➖➖➖➖➖➖➖➖➖➖➖ Please like & share the video. ➖➖➖➖➖➖➖➖➖➖➖➖➖ script data = [ (101, "Alice", "HR", 5000.0, "2021-01-15", None), (102, "Bob", None, None, "2021-03-20", "New York"), (103, "Charlie", "IT", 7000.0, None, "Los Angeles"), (104, None, "Finance", None, "2021-07-10", None), (105, "Eve", None, 4500.0, "2021-09-01", "Chicago"), (106, None, "HR", None, None, None) ] schema=['id','name','dept','salary','date','country'] df=spark.createDataFrame(data,schema) df.show() ➖➖➖➖➖➖➖➖➖➖➖➖➖ AWS DATA ENGINEER : https://www.youtube.com/playlist?list=PLOlK8ytA0MghpdMjb0m9zu1v9s_qbRP0q Azure data factory : https://youtube.com/playlist?list=PLOlK8ytA0MgguN5XidtQXbILxwCdJCUJE&si=iEICXHP80zGchUYh Azure data engineer playlist : https://youtube.com/playlist?list=PLOlK8ytA0MghBrzu0i6WlTBdoO1WdwV_e SQL PLAYLIST : https://www.youtube.com/playlist?list=PLOlK8ytA0MggGXIKmbfZ-_Xqcos3JKdV- PYSPARK PLAYLIST - https://www.youtube.com/playlist?list=PLOlK8ytA0MgjvOpd-088NRU_vTYw_aryH ➖➖➖➖➖➖➖➖➖➖➖➖➖ 📣Want to connect with me? Check out these links:📣 Join telegram to discuss https://t.me/+Cb98j1_fnZs3OTA1 ➖➖➖➖➖➖➖➖➖➖➖➖➖ what we have covered in this video: ➖➖➖➖➖➖➖➖➖➖➖➖➖ Hope you liked this video and learned something new :) See you in next video, until then Bye-Bye! ➖➖➖➖➖➖➖➖➖➖➖➖➖
Continue this lesson in the app
Install CourseHive on Android or iOS to keep learning while you move.
