Summary
Keywords
Full Transcript
Spark - Build Memory Config Calculator in Tamil English Video - https://youtu.be/CKUhc12oceo Code - https://github.com/sbgowtham/spark_memory_cal_webapp Spark Executor Memory: The amount of memory allocated to each executor in Spark, used for storing data and performing computations. Spark Driver Memory: The amount of memory allocated to the Spark driver, responsible for the overall coordination of the application, including task scheduling. Spark Cores: The number of CPU cores allocated to each executor, which determines the number of tasks an executor can run in parallel. Number of Executors: The total number of executors in a Spark application, determining the parallelism level across the cluster. YARN Memory Overhead: Extra memory allocated on top of the executor memory for YARN to handle resource management, including JVM overhead, caches, and thread stacks. Email: [email protected] LinkedIn : https://www.linkedin.com/in/sbgowtham/ Instagram: https://www.instagram.com/dataengineeringtamil YouTube channel link www.youtube.com/@dataengineeringtamil Website https://codewithgowtham.blogspot.com http://github.com/Gowthamdataengineer Technology in Tamil & English #DataEngineering #BigData #CloudComputing #DataAnalytics #ETLTutorials #SQLTutorials #DataEngineeringTamil #BigDataTamil #TamilTech #TamilTutorials #TamilITProfessionals #TamilDataEngineeringChannel #HadoopTutorial #ApacheSpark #FlinkTutorial #NoSQLDatabases #MongoDBTutorial #AWSDataEngineering #GCPDataEngineering #AzureDataEngineering #EngineeringStudents #TamilEngineeringStudents #ITCareerTamil #TechJobsTamil #LearnInTamil #TamilTechChannel Tamil Data Engineering Tutorials, Best Tamil Data Engineering Channel, Data Engineering in Tamil, Big Data Tamil Tutorials, Hadoop Tamil Tutorials, Spark Tamil Videos, Flink Tamil Tutorials, Data Engineering Concepts Tamil, AWS Data Engineering Tamil, GCP Data Engineering Tamil, Azure Data Engineering Tamil, NoSQL Tamil Tutorials, BigQuery Tamil Tutorials, Data Pipeline Tutorials Tamil, Cloud Computing Tamil, Hadoop Tamil Tutorial, Hadoop Ecosystem Tamil, MapReduce Tamil Explanation, Apache Spark Tamil, Spark Streaming Tamil, Spark SQL Tamil, MongoDB Tamil Tutorial, Cassandra Tamil Videos, NoSQL Tamil Explanation, AWS Tamil Big Data Tutorials, Google Cloud Tamil Data Engineering, Azure Data Engineering Tamil, SQL Tamil Tutorials, ETL Process Tamil Videos, Data Warehouse Tamil, Tamil Tech Channel, Data Engineers Tamil Nadu, Tamil IT Professionals, Engineering Students Tamil Tutorials
Continue this lesson in the app
Install CourseHive on Android or iOS to keep learning while you move.
