Hadoop for Developers (2 days) Training Course

Primary tabs

Client Testimonials

Hadoop for Developers

The trainer clearly understood the subject matter very well. He managed to articulate the subject areas well and demonstrated using practicals how to apply that knowledge.

Matthew Tindall - Knowledgepool

Course Code

68736

Duration Duration

14 hours (usually 2 days including breaks)

Course Outline Course Outline

Introduction

  • What is Hadoop?
  • What does it do?
  • How does it do it?

The Motivation for Hadoop

  • Problems with Traditional Large-Scale Systems
  • Introducing Hadoop
  • Hadoopable Problems

Hadoop: Basic Concepts and HDFS

  • The Hadoop Project and Hadoop Components
  • The Hadoop Distributed File System

Introduction to MapReduce

  • MapReduce Overview
  • Example: WordCount
  • Mappers
  • Reducers

Hadoop Clusters and the Hadoop Ecosystem

  • Hadoop Cluster Overview
  • Hadoop Jobs and Tasks
  • Other Hadoop Ecosystem Components

Writing a MapReduce Program in Java

  • Basic MapReduce API Concepts
  • Writing MapReduce Drivers, Mappers, and Reducers in Java
  • Speeding Up Hadoop Development by Using Eclipse
  • Differences Between the Old and New MapReduce APIs

Writing a MapReduce Program Using Streaming

  • Writing Mappers and Reducers with the Streaming API

Unit Testing MapReduce Programs

  • Unit Testing
  • The JUnit and MRUnit Testing Frameworks
  • Writing Unit Tests with MRUnit
  • Running Unit Tests

Delving Deeper into the Hadoop API

  • Using the ToolRunner Class
  • Setting Up and Tearing Down Mappers and Reducers
  • Decreasing the Amount of Intermediate Data with Combiners
  • Accessing HDFS Programmatically
  • Using The Distributed Cache
  • Using the Hadoop API’s Library of Mappers, Reducers, and Partitioners

Practical Development Tips and Techniques

  • Strategies for Debugging MapReduce Code
  • Testing MapReduce Code Locally by Using LocalJobRunner
  • Writing and Viewing Log Files
  • Retrieving Job Information with Counters
  • Reusing Objects
  • Creating Map-Only MapReduce Jobs

Partitioners and Reducers

  • How Partitioners and Reducers Work Together
  • Determining the Optimal Number of Reducers for a Job
  • Writing Customer Partitioners

Data Input and Output

  • Creating Custom Writable and Writable-Comparable Implementations
  • Saving Binary Data Using SequenceFile and Avro Data Files
  • Issues to Consider When Using File Compression
  • Implementing Custom InputFormats and OutputFormats
  • Common MapReduce Algorithms
    • Sorting and Searching Large Data Sets
    • Indexing Data
    • Computing Term Frequency — Inverse Document Frequency
    • Calculating Word Co-Occurrence
    • Performing Secondary Sort
  • Joining Data Sets in MapReduce Jobs
    • Writing a Map-Side Join
    • Writing a Reduce-Side Join
  • Integrating Hadoop into the Enterprise Workflow
    • Integrating Hadoop into an Existing Enterprise
    • Loading Data from an RDBMS into HDFS by Using Sqoop
    • Managing Real-Time Data Using Flume
    • Accessing HDFS from Legacy Systems with FuseDFS and HttpFS
  • An Introduction to Hive, Imapala, and Pig
    • The Motivation for Hive, Impala, and Pig
    • Hive Overview
    • Impala Overview
    • Pig Overview
    • Choosing Between Hive, Impala, and Pig
  • An Introduction to Oozie
    • Introduction to Oozie
    • Creating Oozie Workflows

Guaranteed to run even with a single delegate!
Public Classroom Public Classroom
Participants from multiple organisations. Topics usually cannot be customised
From $6150
(105)
Private Classroom Private Classroom
Participants are from one organisation only. No external participants are allowed. Usually customised to a specific group, course topics are agreed between the client and the trainer.
Private Remote Private Remote
The instructor and the participants are in two different physical locations and communicate via the Internet
From $3850
Request quote

The more delegates, the greater the savings per delegate. Table reflects price per delegate and is used for illustration purposes only, actual prices may differ.

Number of Delegates Public Classroom Private Remote
1 $6150 $3850
2 $3495 $2270
3 $2610 $1743
4 $2168 $1480
Cannot find a suitable date? Choose Your Course Date >>
Too expensive? Suggest your price

Related Categories


Upcoming Courses

VenueCourse DateCourse Price [Remote / Classroom]
ON, London - London City CentreMon, Dec 19 2016, 9:30 am$3850 / $6210
BC, Vancouver - World Trade CenterTue, Dec 20 2016, 9:30 am$3850 / $6250
SK, SaskatoonWed, Dec 21 2016, 9:30 am$3850 / $6850
MB, Winnipeg - 201 Portage AvenueThu, Dec 22 2016, 9:30 am$3850 / $6350
ON, Oakville - Glen AbbeyThu, Dec 29 2016, 9:30 am$3850 / $6210

Course Discounts

Course Venue Course Date Course Price [Remote / Classroom]
Web Application Performance Testing with JMeter Remote Course Thu, Dec 15 2016, 9:30 am $1822 / N/A
WebServices with SOAP and WSDL Basics Remote Course Tue, Dec 20 2016, 9:30 am $3406 / N/A

Course Discounts Newsletter

We respect the privacy of your email address. We will not pass on or sell your address to others.
You can always change your preferences or unsubscribe completely.

Some of our clients