This project has retired. For details please refer to its
Attic page .
SPairFunction (Apache Crunch 0.11.0 API)
org.apache.crunch.fn
Class SPairFunction<T,K,V>
java.lang.Object
org.apache.crunch.DoFn <S,T>
org.apache.crunch.MapFn <T,R>
org.apache.crunch.fn.SPairFunction<T,K,V>
All Implemented Interfaces: Serializable , org.apache.spark.api.java.function.PairFunction<T,K,V>
public abstract class SPairFunction<T,K,V> extends MapFn <T,R>implements org.apache.spark.api.java.function.PairFunction<T,K,V>
A Crunch-compatible abstract base class for Spark's PairFunction
. Subclasses
of this class may be used against either Crunch PCollections
or Spark RDDs
.
See Also: Serialized Form
Method Summary
void
cleanup (Emitter <R> emitter)
Called during the cleanup of the MapReduce job this DoFn
is
associated with.
void
initialize ()
Initialize this DoFn.
Pair <K ,V >
map (T input)
Maps the given input into an instance of the output type.
Methods inherited from interface org.apache.spark.api.java.function.PairFunction
call
SPairFunction
public SPairFunction ()
map
public Pair <K ,V > map (T input)
Description copied from class: MapFn
Maps the given input into an instance of the output type.
Specified by: map
in class MapFn <T ,Pair <K ,V >>
initialize
public final void initialize ()
Description copied from class: DoFn
Initialize this DoFn. This initialization will happen before the actual
DoFn.process(Object, Emitter)
is triggered. Subclasses may override
this method to do appropriate initialization.
Called during the setup of the job instance this DoFn
is associated
with.
Overrides: initialize
in class DoFn <T,R>
cleanup
public final void cleanup (Emitter <R> emitter)
Description copied from class: DoFn
Called during the cleanup of the MapReduce job this DoFn
is
associated with. Subclasses may override this method to do appropriate
cleanup.
Overrides: cleanup
in class DoFn <T,R>
Parameters: emitter
- The emitter that was used for output
Copyright © 2014 The Apache Software Foundation . All Rights Reserved.