AWS DATA ENGINEERING - 35. Important Pyspark Interview Question | LTIMindTree Interview

#pyspark #pysparkinterview #interview #dataengineer Important Pyspark Interview Question PYSPARK INTERVIEW QUESTION WE HAVE 2 TABLE EMPLOYEE AND DEPARTMENT TABLE IS GIVEN 1. WE HAVE TO FIND THE HIGHEST SALARY BASED ON EACH DEPARTMENT NAME 2. WE HAVE TO FIND THE EMPLOYEE WHO IS GETTING HIGHEST SALARY BASED ON EACH DEPARTMENT NAME 3. WE HAVE TO FIND THE lowest SALARY BASED ON EACH DEPARTMENT NAME 4. WE HAVE TO FIND THE EMPLOYEE WHO IS GETTING lowest SALARY BASED ON EACH DEPARTMENT NAME SOLVE USING PYSPARK AND SPARK SQL Want more similar videos- hit like, comment, share and subscribe ❤️Do Like, Share and Comment ❤️ ❤️ Like Aim 5000 likes! ❤️ ➖➖➖➖➖➖➖➖➖➖➖➖➖ DATASET emp_data=[('Manish' , 1 , 75000), ('Raghav' , 1 , 85000 ), ('surya' , 1 , 80000 ), ('virat' , 2 , 70000), ('rohit' , 2 , 75000), ('jadeja' , 3 , 85000), ('anil' , 3 , 55000), ('sachin' , 3 , 55000), ('zahir', 4, 60000), ('bumrah' , 4 , 65000) ] schema= ["emp_name" ,"dept_id" ,"salary"] dept_data = [(1, 'DATA ENGINEER'),(2, 'SALES'),(3, 'SOFTWARE'),(4, 'HR')] schema1=['dept_id','dept_name'] ➖➖➖➖➖➖➖➖➖➖➖➖➖ AWS DATA ENGINEER : https://www.youtube.com/playlist?list=PLOlK8ytA0MghpdMjb0m9zu1v9s_qbRP0q Azure data factory : https://youtube.com/playlist?list=PLOlK8ytA0MgguN5XidtQXbILxwCdJCUJE&si=iEICXHP80zGchUYh Azure data engineer playlist : https://youtube.com/playlist?list=PLOlK8ytA0MghBrzu0i6WlTBdoO1WdwV_e SQL PLAYLIST : https://www.youtube.com/playlist?list=PLOlK8ytA0MggGXIKmbfZ-_Xqcos3JKdV- PYSPARK PLAYLIST - https://www.youtube.com/playlist?list=PLOlK8ytA0MgjvOpd-088NRU_vTYw_aryH ➖➖➖➖➖➖➖➖➖➖➖➖➖ 📣Want to connect with me? Check out these links:📣 Join telegram to discuss https://t.me/+Cb98j1_fnZs3OTA1 ➖➖➖➖➖➖➖➖➖➖➖➖➖ what we have covered in this video: ➖➖➖➖➖➖➖➖➖➖➖➖➖ Hope you liked this video and learned something new :) See you in next video, until then Bye-Bye! ➖➖➖➖➖➖➖➖➖➖➖➖➖