|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.crunch.DoFn<S,T> org.apache.crunch.MapFn<R,T> org.apache.crunch.fn.CompositeMapFn<R,S,T>
public class CompositeMapFn<R,S,T>
Constructor Summary | |
---|---|
CompositeMapFn(MapFn<R,S> first,
MapFn<S,T> second)
|
Method Summary | |
---|---|
void |
cleanup(Emitter<T> emitter)
Called during the cleanup of the MapReduce job this DoFn is
associated with. |
void |
configure(org.apache.hadoop.conf.Configuration conf)
Configure this DoFn. |
MapFn<R,S> |
getFirst()
|
MapFn<S,T> |
getSecond()
|
void |
initialize()
Initialize this DoFn. |
T |
map(R input)
Maps the given input into an instance of the output type. |
void |
setContext(org.apache.hadoop.mapreduce.TaskInputOutputContext<?,?,?,?> context)
Called during setup to pass the TaskInputOutputContext to this
DoFn instance. |
Methods inherited from class org.apache.crunch.MapFn |
---|
process, scaleFactor |
Methods inherited from class java.lang.Object |
---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public CompositeMapFn(MapFn<R,S> first, MapFn<S,T> second)
Method Detail |
---|
public void setContext(org.apache.hadoop.mapreduce.TaskInputOutputContext<?,?,?,?> context)
DoFn
TaskInputOutputContext
to this
DoFn
instance.
setContext
in class DoFn<R,T>
public void initialize()
DoFn
DoFn.process(Object, Emitter)
is triggered. Subclasses may override
this method to do appropriate initialization.
Called during the setup of the job instance this DoFn
is associated
with.
initialize
in class DoFn<R,T>
public MapFn<R,S> getFirst()
public MapFn<S,T> getSecond()
public T map(R input)
MapFn
map
in class MapFn<R,T>
public void cleanup(Emitter<T> emitter)
DoFn
DoFn
is
associated with. Subclasses may override this method to do appropriate
cleanup.
cleanup
in class DoFn<R,T>
emitter
- The emitter that was used for outputpublic void configure(org.apache.hadoop.conf.Configuration conf)
DoFn
Called during the job planning phase by the crunch-client.
configure
in class DoFn<R,T>
conf
- The Configuration instance for the Job.
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |