Uses of Class
org.apache.crunch.DoFn

Packages that use DoFn

org.apache.crunch
org.apache.crunch.fn
org.apache.crunch.impl.mem.collect
org.apache.crunch.impl.mr.collect
org.apache.crunch.impl.mr.plan
org.apache.crunch.impl.mr.run
org.apache.crunch.lib
org.apache.crunch.lib.join
org.apache.crunch.types
org.apache.crunch.util

Uses of DoFn in org.apache.crunch

Subclasses of DoFn in org.apache.crunch

class	CombineFn<S,T> A special DoFn implementation that converts an Iterable of values into a single value.
static class	CombineFn.AggregatorCombineFn<K,V> A CombineFn that delegates all of the actual work to an Aggregator instance.
class	FilterFn<T> A DoFn for the common case of filtering the members of a PCollection based on a boolean condition.
static class	FilterFn.AndFn<S>
static class	FilterFn.NotFn<S>
static class	FilterFn.OrFn<S>
class	MapFn<S,T> A DoFn for the common case of emitting exactly one value for each input record.

Methods in org.apache.crunch with parameters of type DoFn

<K,V> PTable<K,V>	PCollection.parallelDo(DoFn<S,Pair<K,V>> doFn, PTableType<K,V> type) Similar to the other parallelDo instance, but returns a PTable instance instead of a PCollection.
<T> PCollection<T>	PCollection.parallelDo(DoFn<S,T> doFn, PType<T> type) Applies the given doFn to the elements of this PCollection and returns a new PCollection that is the output of this processing.
<K,V> PTable<K,V>	PCollection.parallelDo(String name, DoFn<S,Pair<K,V>> doFn, PTableType<K,V> type) Similar to the other parallelDo instance, but returns a PTable instance instead of a PCollection.
<T> PCollection<T>	PCollection.parallelDo(String name, DoFn<S,T> doFn, PType<T> type) Applies the given doFn to the elements of this PCollection and returns a new PCollection that is the output of this processing.

Uses of DoFn in org.apache.crunch.fn

Subclasses of DoFn in org.apache.crunch.fn

class	CompositeMapFn<R,S,T>
class	ExtractKeyFn<K,V> Wrapper function for converting a MapFn into a key-value pair that is used to convert from a PCollection<V> to a PTable<K, V>.
class	IdentityFn<T>
class	MapKeysFn<K1,K2,V>
class	MapValuesFn<K,V1,V2>
class	PairMapFn<K,V,S,T>

Uses of DoFn in org.apache.crunch.impl.mem.collect

Methods in org.apache.crunch.impl.mem.collect with parameters of type DoFn

<K,V> PTable<K,V>	MemCollection.parallelDo(DoFn<S,Pair<K,V>> doFn, PTableType<K,V> type)
<T> PCollection<T>	MemCollection.parallelDo(DoFn<S,T> doFn, PType<T> type)
<K,V> PTable<K,V>	MemCollection.parallelDo(String name, DoFn<S,Pair<K,V>> doFn, PTableType<K,V> type)
<T> PCollection<T>	MemCollection.parallelDo(String name, DoFn<S,T> doFn, PType<T> type)

Uses of DoFn in org.apache.crunch.impl.mr.collect

Methods in org.apache.crunch.impl.mr.collect with parameters of type DoFn

<K,V> PTable<K,V>	PCollectionImpl.parallelDo(DoFn<S,Pair<K,V>> fn, PTableType<K,V> type)
<T> PCollection<T>	PCollectionImpl.parallelDo(DoFn<S,T> fn, PType<T> type)
<K,V> PTable<K,V>	PCollectionImpl.parallelDo(String name, DoFn<S,Pair<K,V>> fn, PTableType<K,V> type)
<T> PCollection<T>	PCollectionImpl.parallelDo(String name, DoFn<S,T> fn, PType<T> type)

Uses of DoFn in org.apache.crunch.impl.mr.plan

Methods in org.apache.crunch.impl.mr.plan with parameters of type DoFn

static DoNode

DoNode.createFnNode(String name, DoFn<?,?> function, PType<?> ptype)

Uses of DoFn in org.apache.crunch.impl.mr.run

Constructors in org.apache.crunch.impl.mr.run with parameters of type DoFn

RTNode(DoFn<Object,Object> fn, String name, List<RTNode> children, Converter inputConverter, Converter outputConverter, String outputName)

Uses of DoFn in org.apache.crunch.lib

Subclasses of DoFn in org.apache.crunch.lib

static class	Aggregate.TopKCombineFn<K,V>
static class	Aggregate.TopKFn<K,V>
static class	Sample.SamplerFn<S>

Uses of DoFn in org.apache.crunch.lib.join

Subclasses of DoFn in org.apache.crunch.lib.join

class	FullOuterJoinFn<K,U,V> Used to perform the last step of an full outer join.
class	InnerJoinFn<K,U,V> Used to perform the last step of an inner join.
class	JoinFn<K,U,V> Represents a DoFn for performing joins.
class	LeftOuterJoinFn<K,U,V> Used to perform the last step of an left outer join.
class	RightOuterJoinFn<K,U,V> Used to perform the last step of an right outer join.

Uses of DoFn in org.apache.crunch.types

Subclasses of DoFn in org.apache.crunch.types

static class

PGroupedTableType.PairIterableMapFn<K,V>

Uses of DoFn in org.apache.crunch.util

Subclasses of DoFn in org.apache.crunch.util

static class	Protos.ExtractKeyFn<M extends Message,K>
static class	Protos.TextToProtoFn<M extends Message>
static class	PTypes.JacksonInputMapFn<T>
static class	PTypes.JacksonOutputMapFn<T>
static class	PTypes.ProtoInputMapFn<T extends Message>
static class	PTypes.ProtoOutputMapFn<T extends Message>
static class	PTypes.ThriftInputMapFn<T extends TBase>
static class	PTypes.ThriftOutputMapFn<T extends TBase>

Methods in org.apache.crunch.util that return DoFn

static <M extends com.google.protobuf.Message> DoFn<String,M>

Protos.lineParser(String sep, Class<M> msgClass)