public abstract class SFlatMapFunction<T,R> extends DoFn<T,R> implements org.apache.spark.api.java.function.FlatMapFunction<T,R>
FlatMapFunction. Subclasses of this class may be used against either Crunch
|Constructor and Description|
|Modifier and Type||Method and Description|
Called during the cleanup of the MapReduce job this
Initialize this DoFn.
Processes the records from a
configure, disableDeepCopy, scaleFactor, setConfiguration, setContext
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
DoFn.process(Object, Emitter)method call. This functionality is imposed by Hadoop's Reducer implementation: The framework will reuse the key and value objects that are passed into the reduce, therefore the application should clone the objects they want to keep a copy of.
public final void initialize()
DoFn.process(Object, Emitter)is triggered. Subclasses may override this method to do appropriate initialization.
Called during the setup of the job instance this
DoFn is associated
Copyright © 2017 The Apache Software Foundation. All rights reserved.