Hadoop Big Data Training Course Content In Madhapur Hyderabad

Hadoop

• BigData Introduction.
• Hadoop Introduction.
• Relation between BigData and Hadoop.
• Why all industries are talking about Bigdata (Real time use of Bigdata)
• Challenges with Big Data
  • Storage
  • Processing
• Technologies supporting Bigdata.
  • Hadoop
  • Database

» Traditional

» No SQL

• Comparison with other Technologies
  • RDBM
  • Data Warehouse
  • Tera Data
• Components of Hadoop Eco System
  • Storage Components
  • Processing Components
• Integration of Hadoop with other Bigdata solutions.

HDFS (Hadoop Distributed File System)

• What is a Cluster Environment?
• Cluster Vs Hadoop Cluster
• Significance of HDFS in Hadoop
• Features of HDFS

• Storage aspects of HDFS
  • Block
  • How to Configure Block size
  • Default Vs Configurable Block size
  • Why HDFS Block size so large?
  • Design Principles of Block size
• HDFS Architecture -5 Daemons of Hadoop
  • Name Node and its Functionality
  • Data Node and its Functionality
  • Job Tracker and its Functionality
  • Task Tracker and its Functionality
  • Secondary Name Node and its Functionality
• Replication in Hadoop – Fail Over Mechanism
  • Data Storage in Data Nodes
  • Fail over Mechanism in Hadoop – Replication
  • Replication Configuration
  • Custom Replication
  • Design Constraints with Replication Factor
• Accessing HDFS
  • CLI (Command Line Interface) and HDFS Commands
  • Java Based Approach
• Configuration of HDFS
• How to overcome drawbacks in HDFS

Map Reduce

• Why Map Reduce is essential in Hadoop?
• Processing Daemons of Hadoop
  • Job Tracker

» Roles of Job Tracker

» Drawbacks w.r.t Job Tracker, Failure in Hadoop Cluster

» How to Configure Job Tracker in Hadoop Cluster

• • Task Tracker

» Roles of Task Tracker

» Drawbacks w.r.t Task Tracker Failure in Hadoop Cluster

• Input Split
  • Input Split
  • Need of Input Split in Map Reduce
  • Input Split size
  • Input Split size Vs Block size
  • Input Split Vs Mappers
• Map Reduce Life Cycle
  • Communication Mechanism of Job Tracker & Task Tracker
  • Input Format Class
  • Record Reader Class
  • Success Case Scenarios
  • Failure Case Scenarios
  • Retry Mechanism in Map Reduce
• Map Reduce Programming Model
  • Different Phases of Map Reduce Algorithm
  • Different Data types in Map Reduce

» Primitive Data types Vs Map Reduced Data types

• • How to write a basic Map Reduce Program

» Driver code

• Importance of Driver code in a Map Reduce Program
• How to Identify the Driver code in Map Reduce Program
• Different Section of Driver code
  • Mapper code

• Importance of Mapper phase in Map Reduce
• How to Write Reducer Class
• Methods in Mapper Class
  • Reducer code
• Importance of Reduce Phase in Map Reduce
  • How to Write Reducer Class?
  • Methods in Reducer Class
  • Identity Mapper & Identity Reducer
  • Input Formats in Map Reduce

» Text lnput Format

» Key Value Text Input Format

» N Line Input Format

» DB Input Format

» Sequence File Input Format

» How to use the Specific input Format in Map Reduce

• • Map reduce API(Application Programing Interface)

» New API

» Deprecated API

• • Combiner in Map Reduce

» Is combiner mandate in Map Reduce

» How to use the combiner class in Map Reduce

» Performance tradeoffs w.r.t combiner

• • Partitioner in Map Reduce

» Importance of partitioner class in Map Reduce

» How to use the partitioner class in Map Reduce

» Hash partitioner functionality

» How to write a custom partitioner

• • Compression techniques in Map Reduce
    

» Importance of compression in Map Reduce

» What is CODEC?

» Compression types

» GzipCodec

» BzipCodec

» LZOCodec

» SnappuCodec

» Configurations w.r.t compressions techniques

» How to customize the compressions per one job Vs all the job

• • • Joins in Map Reduce

» Map Side Join

» Reduce Side Join

» Performance trade off

» Distributed cache

• • • How to debug Map Reduce jobs in local and pseudo cluster mode?
    • Introduction to Map reduce streaming
    • Data localization in Map Reduce
    • Secondary sorting use Map Reduce