This project has retired. For details please refer to its Attic page.

Uses of Class
org.apache.crunch.DoFn

Packages that use DoFn

org.apache.crunch	Client-facing API and core abstractions.
org.apache.crunch.contrib.bloomfilter	Support for creating Bloom Filters.
org.apache.crunch.fn	Commonly used functions for manipulating collections.
org.apache.crunch.lib	Joining, sorting, aggregating, and other commonly used functionality.
org.apache.crunch.lib.join	Inner and outer joins on collections.
org.apache.crunch.types	Common functionality for business object serialization.

Uses of DoFn in org.apache.crunch

Subclasses of DoFn in org.apache.crunch

class	CombineFn<S,T> A special DoFn implementation that converts an Iterable of values into a single value.
static class	CombineFn.AggregatorCombineFn<K,V> A CombineFn that delegates all of the actual work to an Aggregator instance.
class	FilterFn<T> A DoFn for the common case of filtering the members of a PCollection based on a boolean condition.
static class	FilterFn.AndFn<S>
static class	FilterFn.NotFn<S>
static class	FilterFn.OrFn<S>
class	MapFn<S,T> A DoFn for the common case of emitting exactly one value for each input record.

Methods in org.apache.crunch with parameters of type DoFn

<K,V> PTable<K,V>	PCollection.parallelDo(DoFn<S,Pair<K,V>> doFn, PTableType<K,V> type) Similar to the other parallelDo instance, but returns a PTable instance instead of a PCollection.
<T> PCollection<T>	PCollection.parallelDo(DoFn<S,T> doFn, PType<T> type) Applies the given doFn to the elements of this PCollection and returns a new PCollection that is the output of this processing.
<K,V> PTable<K,V>	PCollection.parallelDo(String name, DoFn<S,Pair<K,V>> doFn, PTableType<K,V> type) Similar to the other parallelDo instance, but returns a PTable instance instead of a PCollection.
<T> PCollection<T>	PCollection.parallelDo(String name, DoFn<S,T> doFn, PType<T> type) Applies the given doFn to the elements of this PCollection and returns a new PCollection that is the output of this processing.

Uses of DoFn in org.apache.crunch.contrib.bloomfilter

Subclasses of DoFn in org.apache.crunch.contrib.bloomfilter

class

BloomFilterFn<S> The class is responsible for generating keys that are used in a BloomFilter

Uses of DoFn in org.apache.crunch.fn

Subclasses of DoFn in org.apache.crunch.fn

class	CompositeMapFn<R,S,T>
class	ExtractKeyFn<K,V> Wrapper function for converting a MapFn into a key-value pair that is used to convert from a PCollection<V> to a PTable<K, V>.
class	IdentityFn<T>
class	MapKeysFn<K1,K2,V>
class	MapValuesFn<K,V1,V2>
class	PairMapFn<K,V,S,T>

Uses of DoFn in org.apache.crunch.lib

Subclasses of DoFn in org.apache.crunch.lib

static class	Aggregate.TopKCombineFn<K,V>
static class	Aggregate.TopKFn<K,V>
static class	Sample.SamplerFn<S>

Methods in org.apache.crunch.lib with parameters of type DoFn

static <K,V1,V2,U,V> PTable<U,V>	SecondarySort.sortAndApply(PTable<K,Pair<V1,V2>> input, DoFn<Pair<K,Iterable<Pair<V1,V2>>>,Pair<U,V>> doFn, PTableType<U,V> ptype) Perform a secondary sort on the given PTable instance and then apply a DoFn to the resulting sorted data to yield an output PTable<U, V>.
static <K,V1,V2,T> PCollection<T>	SecondarySort.sortAndApply(PTable<K,Pair<V1,V2>> input, DoFn<Pair<K,Iterable<Pair<V1,V2>>>,T> doFn, PType<T> ptype) Perform a secondary sort on the given PTable instance and then apply a DoFn to the resulting sorted data to yield an output PCollection<T>.

Uses of DoFn in org.apache.crunch.lib.join

Subclasses of DoFn in org.apache.crunch.lib.join

class	FullOuterJoinFn<K,U,V> Used to perform the last step of an full outer join.
class	InnerJoinFn<K,U,V> Used to perform the last step of an inner join.
class	JoinFn<K,U,V> Represents a DoFn for performing joins.
class	LeftOuterJoinFn<K,U,V> Used to perform the last step of an left outer join.
class	RightOuterJoinFn<K,U,V> Used to perform the last step of an right outer join.

Uses of DoFn in org.apache.crunch.types

Subclasses of DoFn in org.apache.crunch.types

static class	PGroupedTableType.PairIterableMapFn<K,V>
static class	Protos.ExtractKeyFn<M extends Message,K>
static class	Protos.TextToProtoFn<M extends Message>
static class	PTypes.EnumInputMapper<T extends Enum>
static class	PTypes.EnumOutputMapper<T extends Enum>
static class	PTypes.JacksonInputMapFn<T>
static class	PTypes.JacksonOutputMapFn<T>
static class	PTypes.ProtoInputMapFn<T extends Message>
static class	PTypes.ProtoOutputMapFn<T extends Message>
static class	PTypes.ThriftInputMapFn<T extends TBase>
static class	PTypes.ThriftOutputMapFn<T extends TBase>

Methods in org.apache.crunch.types that return DoFn

static <M extends com.google.protobuf.Message> DoFn<String,M>

Protos.lineParser(String sep, Class<M> msgClass)