Summary
Keywords
Full Transcript
🔥Discover SKillUP free online certification programs – https://www.simplilearn.com/skillup-free-online-courses?utm_campaign=18FebSKillupYT&utm_medium=DescriptionFF&utm_source=youtube 🔥Professional Certificate Program in Data Engineering - https://www.simplilearn.com/pgp-data-engineering-certification-training-course?utm_campaign=5zJt9qAe01w&utm_medium=DescriptionFirstFold&utm_source=Youtube 🔥IITK - Professional Certificate Course in Data Science (India Only) - https://www.simplilearn.com/iitk-professional-certificate-course-data-science?utm_campaign=5zJt9qAe01w&utm_medium=DescriptionFirstFold&utm_source=Youtube 🔥Microsoft Azure - Data Analyst Course - https://www.simplilearn.com/in/data-analyst-course?utm_campaign=5zJt9qAe01w&utm_medium=DescriptionFirstFold&utm_source=Youtube This full course video on Hadoop will introduce you to the world of big data, the applications of big data, the significant challenges in big data, and how Hadoop solves these major challenges. You will get an idea about the essential tools that are part of the Hadoop ecosystem. You will learn how Hadoop stores vast volumes of data using HDFS, and processes this data using MapReduce. You will understand how cluster resource management works using YARN. It will make you know how you can query and analyze big data using tools and frameworks like Hive, Pig, Sqoop, and HBase. The below topics are covered in this Hadoop full course tutorial: Evolution of Big Data - 01:21 Why Big Data - 06:08 What is Big Data - 10:47 5V's of Big Data - 12:13 Big Data Case Study - 18:20 Challenges of Big Data - 24:46 Hadoop as a Solutions - 28:24 History of Hadoop - 36:04 Cloudera Hadoop Installation - 37:17 Hadoop Installation on Ubuntu - 57:29 Hadoop Ecosystem - 2:03:14 HDFS Tuitorial - 2:03:45 Why HDFS? - 2:04:17 What is HDFS? - 2:05:30 HDFS Cluster Architecture - 2:09:40 HDFS Data Blocks - 2:11:11 DataNode Failure and Replication - 2:13:19 Rack Awareness in HDFS - 2:15:59 HDFS Architecture - 2:17:01 HDFS Read Mechanism - 2:20:00 HDFS Write Mechanism - 2:24:10 HDFS Write Mechanism with example - 2:27:13 Advantages of HDFS - 2:28:17 HDFS Tuitorial - 2:29:37 MapReduce Analogy - 2:45:14 What is MapReduce? - 2:47:11 Parallel Processing MapReduce - 2:52:51 MapReduce Workflow - 2:53:31 MapReduce Architecture - 3:00:24 MapReduce Example - 3:28:04 Hadoop 1.0 (MR 1) - 3:55:39 Limitations of Hadoop 1.0 (MR 1) - 4:00:12 Need for YARN - 4:02:25 Solution - Hadoop 2.0 (YARN) - 4:04:15 What is YARN? - 4:05:13 Workloads running on YARN - 4:06:33 YARN Components - 4:07:20 YARN Components - Resource Manager - 4:12:10 YARN Components - Node Manager - 4:15:30 YARN Architecture - 4:25:40 Running an application in YARN - 4:26:30 Need for Sqoop - 5:00:00 What is Sqoop - 5:01:06 Sqoop Features - 5:01:39 Sqoop Architecture - 5:02:49 Sqoop Import - 5:04:03 Sqoop Export - 5:04:53 Sqoop Processing - 5:06:37 Demo on Sqoop - 5:27:31 Flume - 5:27:36 Hadoop Ecosystem - 5:28:49 History of Hive - 5:29:09 Big Data Analytics - 7:13:45 Big Data Applications - 7:37:08 How to become a Big Data Engineer - 7:50:13 Hadoop Interview Questions - 7:58:01 Watch more videos on HadoopTraining: https://www.youtube.com/watch?v=CKLzDWMsQGM&list=PLEiEAq2VkUUJqp1k-g5W1mo37urJQOdCZ #CompleteHadoopTutorial #HadoopFullCourse #IntroductionToHadoop #HadoopTutorialForBeginners #WhatIsBigData #HDFSTutorial #HadoopYARN #Hadoop #HadoopMapReduce #LearnHadoop #HadoopTraining #HadoopCertification #SimplilearnHadoop #Simplilearn ➡️ About Post Graduate Program In Data Engineering This Data Engineering course is ideal for professionals, covering critical topics like the Hadoop framework, Data Processing using Spark, Data Pipelines with Kafka, Big Data on AWS, and Azure cloud infrastructures. This program is delivered via live sessions, industry projects, IBM hackathons, and Ask Me Anything sessions. ✅ Key Features Post Graduate Program Certificate and Alumni Association membership - Exclusive Masterclasses and Ask me Anything sessions by IBM - 8X higher live interaction in live Data Engineering online classes by industry experts - Capstone from 3 domains and 14+ Projects with Industry datasets from YouTube, Glassdoor, Facebook etc. - Simplilearn's JobAssist helps you get noticed by top hiring companies ✅ Skills Covered - Real-Time Data Processing - Data Pipelining - Big Data Analytics - Data Visualization - Provisioning data storage services - Apache Hadoop - Ingesting Streaming and Batch Data - Transforming Data - Implementing Security Requirements - Data Protection - Encryption Techniques - Data Governance and Compliance Controls 👉 Learn More At: https://www.simplilearn.com/pgp-data-engineering-certification-training-course?utm_campaign=Hadoop-5zJt9qAe01w&utm_medium=Description&utm_source=youtube
Continue this lesson in the app
Install CourseHive on Android or iOS to keep learning while you move.
