Training Agenda

Introduction and Overview of Hadoop

• What is Hadoop?
• History of Hadoop
• Building Blocks - Hadoop Eco-System
• Who is behind Hadoop?
• What Hadoop is good for and what it is not

Hadoop Distributed FileSystem (HDFS)

• HDFS Overview and Architecture
• HDFS Installation
• HDFS Use Cases
• Hadoop FileSystem Shell
• FileSystem Java API
• Hadoop Configuration

HBase - The Hadoop Database

• HBase Overview and Architecture
• HBase Installation
• HBase Shell
• Java Client API
• Java Administrative API
• Filters
• Scan Caching and Batching
• Key Design
• Table Design

Map/Reduce 2.0/YARN

• MapReduce 2.0 and YARN Overview
• MapReduce 2.0 and YARN Architecture
• Installation
• YARN and MapReduce Command Line Tools
• Developing MapReduce Jobs
• Input and Output Formats
• HDFS and HBase as Source and Sink
• Job Configuration
• Job Submission and Monitoring
• Anatomy of Mappers, Reducers, Combiners and Partitioners
• Anatomy of Job Execution on YARN
• Distributed Cache
• Hadoop Streaming

MapReduce Workflows

• Decomposing Problems into MapReduce Workflow
• Using JobControl
• Oozie Introduction and Architecture
• Oozie Installation
• Developing, deploying, and Executing Oozie Workflows

Pig

• Pig Overview
• Installation
• Pig Latin
• Developing Pig Scripts
• Processing Big Data with Pig
• Joining data-sets with Pig

Hive

• Hive Overview
• Installation
• Hive QL

Putting it all together

• Distributed installations
• Best Practices