This project has retired. For details please refer to its
Attic page .
AvroOutputFormat (Apache Crunch 0.9.0 API)
org.apache.crunch.types.avro
Class AvroOutputFormat<T>
java.lang.Object
org.apache.hadoop.mapreduce.OutputFormat<K,V>
org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<org.apache.avro.mapred.AvroWrapper<T>,org.apache.hadoop.io.NullWritable>
org.apache.crunch.types.avro.AvroOutputFormat<T>
public class AvroOutputFormat<T> extends org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<org.apache.avro.mapred.AvroWrapper<T>,org.apache.hadoop.io.NullWritable>
An OutputFormat
for Avro data files.
Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.Counter
Fields inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
BASE_OUTPUT_NAME, PART
Method Summary
static
<S> org.apache.avro.file.DataFileWriter<S>
getDataFileWriter (org.apache.hadoop.fs.Path path,
org.apache.hadoop.conf.Configuration conf)
org.apache.hadoop.mapreduce.RecordWriter<org.apache.avro.mapred.AvroWrapper<T >,org.apache.hadoop.io.NullWritable>
getRecordWriter (org.apache.hadoop.mapreduce.TaskAttemptContext context)
Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
checkOutputSpecs, getCompressOutput, getDefaultWorkFile, getOutputCommitter, getOutputCompressorClass, getOutputName, getOutputPath, getPathForWorkFile, getUniqueFile, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputName, setOutputPath
Methods inherited from class java.lang.Object
clone , equals , finalize , getClass , hashCode , notify , notifyAll , toString , wait , wait , wait
AvroOutputFormat
public AvroOutputFormat ()
getDataFileWriter
public static <S> org.apache.avro.file.DataFileWriter<S> getDataFileWriter (org.apache.hadoop.fs.Path path,
org.apache.hadoop.conf.Configuration conf)
throws IOException
Throws:
IOException
getRecordWriter
public org.apache.hadoop.mapreduce.RecordWriter<org.apache.avro.mapred.AvroWrapper<T >,org.apache.hadoop.io.NullWritable> getRecordWriter (org.apache.hadoop.mapreduce.TaskAttemptContext context)
throws IOException ,
InterruptedException
Specified by: getRecordWriter
in class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<org.apache.avro.mapred.AvroWrapper<T >,org.apache.hadoop.io.NullWritable>
Throws:
IOException
InterruptedException
Copyright © 2014 The Apache Software Foundation . All Rights Reserved.