Hadoop Training in Mind Q Systems - PowerPoint PPT Presentation

View by Category
About This Presentation
Title:

Hadoop Training in Mind Q Systems

Description:

Big Data and Hadoop Certification Training from Simplilearn is designed to ensure that you are job ready to take up an assignment in Big Data. This training not just equips you with essential skills of Hadoop 2.7, but also gives you the required work experience in Big Data Hadoop via implementation of real life industry projects spanned across 3 months. – PowerPoint PPT presentation

Number of Views:19
Slides: 11
Provided by: mindqsystems
Category: Other

less

Write a Comment
User Comments (0)
Transcript and Presenter's Notes

Title: Hadoop Training in Mind Q Systems


1
Mind Q Systems
  • Leaders in Training

8-3-214/7, 2nd Floor, Srinivasa Nagar Colony
(W) Above HDFC Bank,  S.R.Nagar
Hyderabad-500038.  Tel 040-66664291/92 /
040-65544295  Mob 91 9502991277  Email info_at_min
dqsystems.com http//www.mindqsystems.com/
2
Hadoop Training in Mind Q Systems
  • Course Objective Summary
  • ? During this course, you will learn
  • ? Introduction to Big Data and Hadoop
  • ? Hadoop ecosystem - Concepts
  • ? Hadoop Map-reduce concepts and features
  • ? Developing the map-reduce
  • Applications
  • ? Pig concepts
  • ? Hive concepts
  • ? Oozie workflow concepts
  • ? HBASE Concepts

3
Hadoop Training in Mind Q Systems
  • Introduction to Big Data and Hadoop
  • ? What is Big Data?
  • ? What are the challenges for processingbig data?
  • ? What technologies support big data?
  • ? What is Hadoop?
  • ? Why Hadoop?
  • ? History of Hadoop
  • ? Use Cases of Hadoop
  • ? Hadoop eco System
  • ? HDFS
  • ? Map Reduce
  • ? Statistics

4
Hadoop Training in Mind Q Systems
  • Understanding the Cluster
  • ? Typical workflow
  • ? Writing files to HDFS
  • ? Reading files from HDFS
  • ? Rack Awareness
  • ? 5 daemons
  • Let's talk Map Reduce
  • ? Before Map reduce
  • ? Map Reduce Overview
  • ? Word Count Problem
  • ? Word Count Flow and Solution
  • ? Map Reduce Flow
  • ? Algorithms for simple Complex prob

5
Hadoop Training in Mind Q Systems
  • Developing the Map Reduce Application
  • ? Data Types
  • ? File Formats
  • ? Explain the Driver, Mapper and Reducer code
  • ? Configuring development environment- Eclipse
  • ? Writing Unit Test
  • ? Running locally
  • ? Running on Cluster
  • ? Hands on exercises

6
Hadoop Training in Mind Q Systems
  • How Map-Reduce Works
  • ? Anatomy of Map Reduce Job run
  • ? Job Submission
  • ? Job Initialization
  • ? Task Assignment
  • ? Job Completion
  • ? Job Scheduling
  • ? Job Failures
  • ? Shuffle and sort
  • ? Oozie Workflows
  • ? Hands on Exercises

7
Hadoop Training in Mind Q Systems
  • Map Reduce Types and Formats
  • ? MapReduce Types
  • ? Input Formats - Input splits records,text
    input, binary input, multiple inputs database
    input
  • ? Output Formats - text Output, binary output,
    multiple outputs, lazy output and database output
  • ? Hands on Exercises

8
Hadoop Training in Mind Q Systems
  • Map Reduce Features
  • ? Counters
  • ? Sorting
  • ? Joins - Map Side and Reduce Side
  • ? Side Data Distribution
  • ? Map Reduce Combiner
  • ? Map Reduce Partitioner
  • ? Map Reduce Distributed Cache
  • ? Hands Exercises

9
Hadoop Training in Mind Q Systems
  • Hive and PIG
  • ? Fundamentals
  • ? When to Use PIG and HIVE
  • ? Concepts
  • ? Hands on Exercises
  • HBASE
  • ? CAP Theorem
  • ? Introduction to NOSQL
  • ? Hbase Architecture and concepts
  • ? Programming and Hands on Exercises

10
(No Transcript)
About PowerShow.com