org.apache.crunch.io

Class FormatBundle<K>

java.lang.Object

org.apache.crunch.io.FormatBundle<K>

All Implemented Interfaces:

Serializable, org.apache.hadoop.conf.Configurable, org.apache.hadoop.io.Writable

public class FormatBundle<K>
extends Object
implements Serializable, org.apache.hadoop.io.Writable, org.apache.hadoop.conf.Configurable

A combination of an InputFormat or OutputFormat and any extra configuration information that format class needs to run.

The FormatBundle allow us to let different formats act as if they are the only format that exists in a particular MapReduce job, even when we have multiple types of inputs and outputs within a single job.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
FormatBundle()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.conf.Configuration	configure(org.apache.hadoop.conf.Configuration conf)
boolean	equals(Object other)
static <T extends org.apache.hadoop.mapreduce.InputFormat<?,?>> FormatBundle<T>	forInput(Class<T> inputFormatClass)
static <T extends org.apache.hadoop.mapreduce.OutputFormat<?,?>> FormatBundle<T>	forOutput(Class<T> outputFormatClass)
static <T> FormatBundle<T>	fromSerialized(String serialized, org.apache.hadoop.conf.Configuration conf)
org.apache.hadoop.conf.Configuration	getConf()
Class<K>	getFormatClass()
String	getName()
int	hashCode()
void	readFields(DataInput in)
String	serialize()
FormatBundle<K>	set(String key, String value)
void	setConf(org.apache.hadoop.conf.Configuration conf)
void	write(DataOutput out)

Methods inherited from class java.lang.Object

getClass, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FormatBundle

public FormatBundle()

Method Detail

fromSerialized

public static <T> FormatBundle<T> fromSerialized(String serialized,
                                                 org.apache.hadoop.conf.Configuration conf)

forInput

public static <T extends org.apache.hadoop.mapreduce.InputFormat<?,?>> FormatBundle<T> forInput(Class<T> inputFormatClass)

forOutput

public static <T extends org.apache.hadoop.mapreduce.OutputFormat<?,?>> FormatBundle<T> forOutput(Class<T> outputFormatClass)

set

public FormatBundle<K> set(String key,
                           String value)

getFormatClass

public Class<K> getFormatClass()

configure

public org.apache.hadoop.conf.Configuration configure(org.apache.hadoop.conf.Configuration conf)

serialize

public String serialize()

getName

public String getName()

hashCode

public int hashCode()

Overrides:

hashCode in class Object

equals

public boolean equals(Object other)

Overrides:

equals in class Object

readFields

public void readFields(DataInput in)
                throws IOException

Specified by:

readFields in interface org.apache.hadoop.io.Writable

Throws:

IOException

write

public void write(DataOutput out)
           throws IOException

Specified by:

write in interface org.apache.hadoop.io.Writable

Throws:

IOException

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable