Hadoop Tutorial

Big Data is a collection of data that is growing exponentially, and it is huge in volume with a lot of complexity as it comes from various resources. This data may be structured data, unstructured or semi-structured. So to handle or manage it efficiently, Hadoop comes into the picture.

Hadoop is a framework written in Java programming language that works over the collection of commodity hardware. Before Hadoop, we are using a single system for storing and processing data. Also, we are dependent on RDBMS which only stores the structured data. To solve the problem of such huge complex data, Hadoop provides the best solution. So let’s get started.

Topics:

• Basics
• Installation and Environment Setup
• Components of Hadoop
• Cluster, Rack & Schedulers
• HDFS
• MapReduce
• MapReduce Programs
• Hadoop Streaming
• Hadoop File and Commands
• Misc

Basics

• What is Big Data?
• What is Unstructured Data?
• What is Semi-Structured Data?
• 5V’s of Big Data
• Hadoop – Solution to Big Data
• Evolution of Hadoop
• Different Versions of Hadoop
• RDBMS vs Hadoop
• Hadoop Architecture
• Hadoop 2.x vs Hadoop 3.x
• Hadoop – Ecosystem

Installation and Environment Setup

• How to Install Hadoop in Linux?
• Installing and Setting Up Hadoop in Windows 10
• Installing Single Node Cluster Hadoop on Windows
• Configuring Eclipse with Apache Hadoop

Components of Hadoop

• Hadoop Distributed File System(HDFS)
• MapReduce
• YARN

Cluster, Rack & Schedulers

• Hadoop Cluster
• Hadoop – Cluster, Properties and its Types
• Hadoop – Rack and Rack Awareness
• Hadoop – Schedulers and Types of Schedulers
• Hadoop – Different Modes of Operation

HDFS

• Various Filesystems in Hadoop
• Why a Block in HDFS is so Large?
• Daemons and Their Features
• File Blocks and Replication Factor
• Data Read Operation

MapReduce

• Map Reduce in Hadoop
• MapReduce Architecture
• Mapper In MapReduce
• Reducer in Map-Reduce
• MapReduce Job Execution
• Hadoop MapReduce – Data Flow
• Job Initializations in MapReduce
• How does Job run on MapReduce?
• How MapReduce Completes a Task?

MapReduce Programs

• Weather Data Analysis For Analyzing Hot And Cold Days
• Finding The Average Age of Male and Female Died in Titanic Disaster
• How to Execute Character Count Program in MapReduce Hadoop?

Hadoop Streaming

• What is Hadoop Streaming?
• Hadoop Streaming Using Python – Word Count Problem

Hadoop File and Commands

• Hadoop – File Permission and ACL(Access Control List)
• Hadoop – copyFromLocal Command
• Hadoop – getmerge Command

Misc

• Hadoop Version 3.0 – What’s New?
• Top 7 Reasons to Learn Hadoop
• Top 10 Hadoop Analytics Tools For Big Data
• Top 5 Recommended Books To Learn Hadoop
• Features of Hadoop Which Makes It Popular
• Hadoop vs Spark vs Flink