|
|||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | ||||||||
java.lang.Objectorg.apache.crunch.DoFn<T,T>
org.apache.crunch.FilterFn<S>
org.apache.crunch.FilterFn.AndFn<S>
FilterFns.and(FilterFn...)
public static class FilterFn.AndFn<S>
| Nested Class Summary |
|---|
| Nested classes/interfaces inherited from class org.apache.crunch.FilterFn |
|---|
FilterFn.AndFn<S>, FilterFn.NotFn<S>, FilterFn.OrFn<S> |
| Constructor Summary | |
|---|---|
FilterFn.AndFn(FilterFn<S>... fns)
Deprecated. |
|
| Method Summary | |
|---|---|
boolean |
accept(S input)
Deprecated. If true, emit the given record. |
void |
cleanup()
Deprecated. Called during the cleanup of the MapReduce job this FilterFn is
associated with. |
void |
configure(org.apache.hadoop.conf.Configuration conf)
Deprecated. Configure this DoFn. |
void |
initialize()
Deprecated. Initialize this DoFn. |
float |
scaleFactor()
Deprecated. Returns an estimate of how applying this function to a PCollection
will cause it to change in side. |
void |
setContext(org.apache.hadoop.mapreduce.TaskInputOutputContext<?,?,?,?> context)
Deprecated. Called during setup to pass the TaskInputOutputContext to this
DoFn instance. |
| Methods inherited from class org.apache.crunch.FilterFn |
|---|
and, cleanup, not, or, process |
| Methods inherited from class java.lang.Object |
|---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
| Constructor Detail |
|---|
public FilterFn.AndFn(FilterFn<S>... fns)
| Method Detail |
|---|
public void configure(org.apache.hadoop.conf.Configuration conf)
DoFnCalled during the job planning phase by the crunch-client.
configure in class DoFn<S,S>conf - The Configuration instance for the Job.public void setContext(org.apache.hadoop.mapreduce.TaskInputOutputContext<?,?,?,?> context)
DoFnTaskInputOutputContext to this
DoFn instance.
setContext in class DoFn<S,S>public void initialize()
DoFnDoFn.process(Object, Emitter) is triggered. Subclasses may override
this method to do appropriate initialization.
Called during the setup of the job instance this DoFn is associated
with.
initialize in class DoFn<S,S>public void cleanup()
FilterFnFilterFn is
associated with. Subclasses may override this method to do appropriate
cleanup.
cleanup in class FilterFn<S>public boolean accept(S input)
FilterFn
accept in class FilterFn<S>public float scaleFactor()
DoFnPCollection
will cause it to change in side. The optimizer uses these estimates to
decide where to break up dependent MR jobs into separate Map and Reduce
phases in order to minimize I/O.
Subclasses of DoFn that will substantially alter the size of the
resulting PCollection should override this method.
scaleFactor in class FilterFn<S>
|
|||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | ||||||||