This project has retired. For details please refer to its
Attic page .
AvroInputFormat (Apache Crunch 0.14.0 API)
JavaScript is disabled on your browser.
java.lang.Object
org.apache.hadoop.mapreduce.InputFormat<K,V>
org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.avro.mapred.AvroWrapper<T>,org.apache.hadoop.io.NullWritable>
org.apache.crunch.types.avro.AvroInputFormat<T>
public class AvroInputFormat<T>
extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.avro.mapred.AvroWrapper<T>,org.apache.hadoop.io.NullWritable>
An InputFormat
for Avro data files.
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.Counter
Field Summary
Fields inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat
DEFAULT_LIST_STATUS_NUM_THREADS, INPUT_DIR, INPUT_DIR_RECURSIVE, LIST_STATUS_NUM_THREADS, NUM_INPUT_FILES, PATHFILTER_CLASS, SPLIT_MAXSIZE, SPLIT_MINSIZE
Method Summary
All Methods Instance Methods Concrete Methods
Modifier and Type
Method and Description
org.apache.hadoop.mapreduce.RecordReader<org.apache.avro.mapred.AvroWrapper<T >,org.apache.hadoop.io.NullWritable>
createRecordReader (org.apache.hadoop.mapreduce.InputSplit split,
org.apache.hadoop.mapreduce.TaskAttemptContext context)
Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat
addInputPath, addInputPaths, getInputDirRecursive, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, getSplits, setInputDirRecursive, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize
Constructor Detail
AvroInputFormat
public AvroInputFormat()
Method Detail
createRecordReader
public org.apache.hadoop.mapreduce.RecordReader<org.apache.avro.mapred.AvroWrapper<T >,org.apache.hadoop.io.NullWritable> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
org.apache.hadoop.mapreduce.TaskAttemptContext context)
throws IOException ,
InterruptedException
Specified by:
createRecordReader
in class org.apache.hadoop.mapreduce.InputFormat<org.apache.avro.mapred.AvroWrapper<T >,org.apache.hadoop.io.NullWritable>
Throws:
IOException
InterruptedException
Copyright © 2016 The Apache Software Foundation . All rights reserved.