This project has retired. For details please refer to its Attic page.

org.apache.crunch.impl.mr.run
Class CrunchCombineFileInputFormat<K,V>

java.lang.Object
  org.apache.hadoop.mapreduce.InputFormat<K,V>
      org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V>
          org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat<K,V>
              org.apache.crunch.impl.mr.run.CrunchCombineFileInputFormat<K,V>

public class CrunchCombineFileInputFormat<K,V>
extends org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat<K,V>

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

org.apache.hadoop.mapreduce.lib.input.FileInputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat

SPLIT_MINSIZE_PERNODE, SPLIT_MINSIZE_PERRACK

Constructor Summary

CrunchCombineFileInputFormat(org.apache.hadoop.mapreduce.JobContext jobContext)

Method Summary

org.apache.hadoop.mapreduce.RecordReader

createRecordReader(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext)

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat

createPool, createPool, getFileBlockLocations, getSplits, isSplitable, setMaxSplitSize, setMinSplitSizeNode, setMinSplitSizeRack

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CrunchCombineFileInputFormat

public CrunchCombineFileInputFormat(org.apache.hadoop.mapreduce.JobContext jobContext)

Method Detail

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader createRecordReader(org.apache.hadoop.mapreduce.InputSplit inputSplit,
                                                                   org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext)
                                                            throws IOException

Specified by:

createRecordReader in class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat<K,V>

Throws:

IOException