public static class FilterFn.AndFn<S> extends FilterFn<S>
FilterFn.AndFn<S>, FilterFn.NotFn<S>, FilterFn.OrFn<S>
Constructor and Description |
---|
FilterFn.AndFn(FilterFn<S>... fns)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
boolean |
accept(S input)
Deprecated.
If true, emit the given record.
|
void |
cleanup()
Deprecated.
Called during the cleanup of the MapReduce job this
FilterFn is
associated with. |
void |
configure(org.apache.hadoop.conf.Configuration conf)
Deprecated.
Configure this DoFn.
|
void |
initialize()
Deprecated.
Initialize this DoFn.
|
float |
scaleFactor()
Deprecated.
Returns an estimate of how applying this function to a
PCollection
will cause it to change in side. |
void |
setContext(org.apache.hadoop.mapreduce.TaskInputOutputContext<?,?,?,?> context)
Deprecated.
Called during setup to pass the
TaskInputOutputContext to this
DoFn instance. |
public void configure(org.apache.hadoop.conf.Configuration conf)
DoFn
Called during the job planning phase by the crunch-client.
public void setContext(org.apache.hadoop.mapreduce.TaskInputOutputContext<?,?,?,?> context)
DoFn
TaskInputOutputContext
to this
DoFn
instance.setContext
in class DoFn<S,S>
public void initialize()
DoFn
DoFn.process(Object, Emitter)
is triggered. Subclasses may override
this method to do appropriate initialization.
Called during the setup of the job instance this DoFn
is associated
with.
initialize
in class DoFn<S,S>
public void cleanup()
FilterFn
FilterFn
is
associated with. Subclasses may override this method to do appropriate
cleanup.public boolean accept(S input)
FilterFn
public float scaleFactor()
DoFn
PCollection
will cause it to change in side. The optimizer uses these estimates to
decide where to break up dependent MR jobs into separate Map and Reduce
phases in order to minimize I/O.
Subclasses of DoFn
that will substantially alter the size of the
resulting PCollection
should override this method.
scaleFactor
in class FilterFn<S>
Copyright © 2013 The Apache Software Foundation. All Rights Reserved.