|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.crunch.DoFn<T,T> org.apache.crunch.FilterFn<S> org.apache.crunch.FilterFn.AndFn<S>
FilterFns.and(FilterFn...)
public static class FilterFn.AndFn<S>
Nested Class Summary |
---|
Nested classes/interfaces inherited from class org.apache.crunch.FilterFn |
---|
FilterFn.AndFn<S>, FilterFn.NotFn<S>, FilterFn.OrFn<S> |
Constructor Summary | |
---|---|
FilterFn.AndFn(FilterFn<S>... fns)
Deprecated. |
Method Summary | |
---|---|
boolean |
accept(S input)
Deprecated. If true, emit the given record. |
void |
cleanup()
Deprecated. Called during the cleanup of the MapReduce job this FilterFn is
associated with. |
void |
configure(org.apache.hadoop.conf.Configuration conf)
Deprecated. Configure this DoFn. |
void |
initialize()
Deprecated. Initialize this DoFn. |
float |
scaleFactor()
Deprecated. Returns an estimate of how applying this function to a PCollection
will cause it to change in side. |
void |
setContext(org.apache.hadoop.mapreduce.TaskInputOutputContext<?,?,?,?> context)
Deprecated. Called during setup to pass the TaskInputOutputContext to this
DoFn instance. |
Methods inherited from class org.apache.crunch.FilterFn |
---|
and, cleanup, not, or, process |
Methods inherited from class java.lang.Object |
---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public FilterFn.AndFn(FilterFn<S>... fns)
Method Detail |
---|
public void configure(org.apache.hadoop.conf.Configuration conf)
DoFn
Called during the job planning phase by the crunch-client.
configure
in class DoFn<S,S>
conf
- The Configuration instance for the Job.public void setContext(org.apache.hadoop.mapreduce.TaskInputOutputContext<?,?,?,?> context)
DoFn
TaskInputOutputContext
to this
DoFn
instance.
setContext
in class DoFn<S,S>
public void initialize()
DoFn
DoFn.process(Object, Emitter)
is triggered. Subclasses may override
this method to do appropriate initialization.
Called during the setup of the job instance this DoFn
is associated
with.
initialize
in class DoFn<S,S>
public void cleanup()
FilterFn
FilterFn
is
associated with. Subclasses may override this method to do appropriate
cleanup.
cleanup
in class FilterFn<S>
public boolean accept(S input)
FilterFn
accept
in class FilterFn<S>
public float scaleFactor()
DoFn
PCollection
will cause it to change in side. The optimizer uses these estimates to
decide where to break up dependent MR jobs into separate Map and Reduce
phases in order to minimize I/O.
Subclasses of DoFn
that will substantially alter the size of the
resulting PCollection
should override this method.
scaleFactor
in class FilterFn<S>
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |