This project has retired. For details please refer to its Attic page.
FormatBundle (Apache Crunch 0.11.0 API)

org.apache.crunch.io
Class FormatBundle<K>

java.lang.Object
  extended by org.apache.crunch.io.FormatBundle<K>
All Implemented Interfaces:
Serializable, org.apache.hadoop.conf.Configurable, org.apache.hadoop.io.Writable

public class FormatBundle<K>
extends Object
implements Serializable, org.apache.hadoop.io.Writable, org.apache.hadoop.conf.Configurable

A combination of an InputFormat or OutputFormat and any extra configuration information that format class needs to run.

The FormatBundle allow us to let different formats act as if they are the only format that exists in a particular MapReduce job, even when we have multiple types of inputs and outputs within a single job.

See Also:
Serialized Form

Constructor Summary
FormatBundle()
           
 
Method Summary
 org.apache.hadoop.conf.Configuration configure(org.apache.hadoop.conf.Configuration conf)
           
 boolean equals(Object other)
           
static
<T extends org.apache.hadoop.mapreduce.InputFormat<?,?>>
FormatBundle<T>
forInput(Class<T> inputFormatClass)
           
static
<T extends org.apache.hadoop.mapreduce.OutputFormat<?,?>>
FormatBundle<T>
forOutput(Class<T> outputFormatClass)
           
static
<T> FormatBundle<T>
fromSerialized(String serialized, org.apache.hadoop.conf.Configuration conf)
           
 org.apache.hadoop.conf.Configuration getConf()
           
 Class<K> getFormatClass()
           
 String getName()
           
 int hashCode()
           
 void readFields(DataInput in)
           
 String serialize()
           
 FormatBundle<K> set(String key, String value)
           
 void setConf(org.apache.hadoop.conf.Configuration conf)
           
 void write(DataOutput out)
           
 
Methods inherited from class java.lang.Object
getClass, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

FormatBundle

public FormatBundle()
Method Detail

fromSerialized

public static <T> FormatBundle<T> fromSerialized(String serialized,
                                                 org.apache.hadoop.conf.Configuration conf)

forInput

public static <T extends org.apache.hadoop.mapreduce.InputFormat<?,?>> FormatBundle<T> forInput(Class<T> inputFormatClass)

forOutput

public static <T extends org.apache.hadoop.mapreduce.OutputFormat<?,?>> FormatBundle<T> forOutput(Class<T> outputFormatClass)

set

public FormatBundle<K> set(String key,
                           String value)

getFormatClass

public Class<K> getFormatClass()

configure

public org.apache.hadoop.conf.Configuration configure(org.apache.hadoop.conf.Configuration conf)

serialize

public String serialize()

getName

public String getName()

hashCode

public int hashCode()
Overrides:
hashCode in class Object

equals

public boolean equals(Object other)
Overrides:
equals in class Object

readFields

public void readFields(DataInput in)
                throws IOException
Specified by:
readFields in interface org.apache.hadoop.io.Writable
Throws:
IOException

write

public void write(DataOutput out)
           throws IOException
Specified by:
write in interface org.apache.hadoop.io.Writable
Throws:
IOException

getConf

public org.apache.hadoop.conf.Configuration getConf()
Specified by:
getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)
Specified by:
setConf in interface org.apache.hadoop.conf.Configurable


Copyright © 2014 The Apache Software Foundation. All Rights Reserved.