Uses of Class org.apache.crunch.DoFn (Apache Crunch 0.3.0-incubating API)

This project has retired. For details please refer to its Attic page.

Overview

Package

Class

Use

Tree

Deprecated

Index

PREV NEXT

FRAMES NO FRAMES

Uses of Class
org.apache.crunch.DoFn

Packages that use DoFn
org.apache.crunch
org.apache.crunch.fn
org.apache.crunch.impl.mem.collect
org.apache.crunch.impl.mr.collect
org.apache.crunch.impl.mr.plan
org.apache.crunch.impl.mr.run
org.apache.crunch.lib
org.apache.crunch.lib.join
org.apache.crunch.types
org.apache.crunch.util

Uses of DoFn in org.apache.crunch

Subclasses of DoFn in org.apache.crunch

class CombineFn<S,T>
          A special DoFn implementation that converts an Iterable of values into a single value.

static class CombineFn.AggregatorCombineFn<K,V>
          A CombineFn that delegates all of the actual work to an Aggregator instance.

class FilterFn<T>
          A DoFn for the common case of filtering the members of a PCollection based on a boolean condition.

static class FilterFn.AndFn<S>


static class FilterFn.NotFn<S>


static class FilterFn.OrFn<S>


class MapFn<S,T>
          A DoFn for the common case of emitting exactly one value for each input record.

Subclasses of DoFn in org.apache.crunch
`class`	`CombineFn<S,T>` A special `DoFn` implementation that converts an `Iterable` of values into a single value.
`static class`	`CombineFn.AggregatorCombineFn<K,V>` A `CombineFn` that delegates all of the actual work to an `Aggregator` instance.
`class`	`FilterFn<T>` A `DoFn` for the common case of filtering the members of a `PCollection` based on a boolean condition.
`static class`	`FilterFn.AndFn<S>`
`static class`	`FilterFn.NotFn<S>`
`static class`	`FilterFn.OrFn<S>`
`class`	`MapFn<S,T>` A `DoFn` for the common case of emitting exactly one value for each input record.

Methods in org.apache.crunch with parameters of type DoFn

<K,V> PTable<K,V> PCollection.parallelDo(DoFn<S,Pair<K,V>> doFn, PTableType<K,V> type)
          Similar to the other parallelDo instance, but returns a PTable instance instead of a PCollection.

<T> PCollection<T> PCollection.parallelDo(DoFn<S,T> doFn, PType<T> type)
          Applies the given doFn to the elements of this PCollection and returns a new PCollection that is the output of this processing.

<K,V> PTable<K,V> PCollection.parallelDo(String name, DoFn<S,Pair<K,V>> doFn, PTableType<K,V> type)
          Similar to the other parallelDo instance, but returns a PTable instance instead of a PCollection.

<T> PCollection<T> PCollection.parallelDo(String name, DoFn<S,T> doFn, PType<T> type)
          Applies the given doFn to the elements of this PCollection and returns a new PCollection that is the output of this processing.

Uses of DoFn in org.apache.crunch.fn

Subclasses of DoFn in org.apache.crunch.fn

class CompositeMapFn<R,S,T>


class ExtractKeyFn<K,V>
          Wrapper function for converting a MapFn into a key-value pair that is used to convert from a PCollection<V> to a PTable<K, V>.

class IdentityFn<T>


class MapKeysFn<K1,K2,V>


class MapValuesFn<K,V1,V2>


class PairMapFn<K,V,S,T>

Subclasses of DoFn in org.apache.crunch.fn
`class`	`CompositeMapFn<R,S,T>`
`class`	`ExtractKeyFn<K,V>` Wrapper function for converting a `MapFn` into a key-value pair that is used to convert from a `PCollection<V>` to a `PTable<K, V>`.
`class`	`IdentityFn<T>`
`class`	`MapKeysFn<K1,K2,V>`
`class`	`MapValuesFn<K,V1,V2>`
`class`	`PairMapFn<K,V,S,T>`

Uses of DoFn in org.apache.crunch.impl.mem.collect

Methods in org.apache.crunch.impl.mem.collect with parameters of type DoFn

<K,V> PTable<K,V> MemCollection.parallelDo(DoFn<S,Pair<K,V>> doFn, PTableType<K,V> type)


<T> PCollection<T> MemCollection.parallelDo(DoFn<S,T> doFn, PType<T> type)


<K,V> PTable<K,V> MemCollection.parallelDo(String name, DoFn<S,Pair<K,V>> doFn, PTableType<K,V> type)


<T> PCollection<T> MemCollection.parallelDo(String name, DoFn<S,T> doFn, PType<T> type)

Uses of DoFn in org.apache.crunch.impl.mr.collect

Methods in org.apache.crunch.impl.mr.collect with parameters of type DoFn

<K,V> PTable<K,V> PCollectionImpl.parallelDo(DoFn<S,Pair<K,V>> fn, PTableType<K,V> type)


<T> PCollection<T> PCollectionImpl.parallelDo(DoFn<S,T> fn, PType<T> type)


<K,V> PTable<K,V> PCollectionImpl.parallelDo(String name, DoFn<S,Pair<K,V>> fn, PTableType<K,V> type)


<T> PCollection<T> PCollectionImpl.parallelDo(String name, DoFn<S,T> fn, PType<T> type)

Uses of DoFn in org.apache.crunch.impl.mr.plan

Methods in org.apache.crunch.impl.mr.plan with parameters of type DoFn

static DoNode DoNode.createFnNode(String name, DoFn<?,?> function, PType<?> ptype)

Methods in org.apache.crunch.impl.mr.plan with parameters of type DoFn
`static DoNode`	`DoNode.createFnNode(String name, DoFn<?,?> function, PType<?> ptype)`

Uses of DoFn in org.apache.crunch.impl.mr.run

Constructors in org.apache.crunch.impl.mr.run with parameters of type DoFn

RTNode(DoFn<Object,Object> fn, String name, List<RTNode> children, Converter inputConverter, Converter outputConverter, String outputName)

Constructors in org.apache.crunch.impl.mr.run with parameters of type DoFn
`RTNode(DoFn<Object,Object> fn, String name, List<RTNode> children, Converter inputConverter, Converter outputConverter, String outputName)`

Uses of DoFn in org.apache.crunch.lib

Subclasses of DoFn in org.apache.crunch.lib

static class Aggregate.TopKCombineFn<K,V>


static class Aggregate.TopKFn<K,V>


static class Sample.SamplerFn<S>

Subclasses of DoFn in org.apache.crunch.lib
`static class`	`Aggregate.TopKCombineFn<K,V>`
`static class`	`Aggregate.TopKFn<K,V>`
`static class`	`Sample.SamplerFn<S>`

Uses of DoFn in org.apache.crunch.lib.join

Subclasses of DoFn in org.apache.crunch.lib.join

class FullOuterJoinFn<K,U,V>
          Used to perform the last step of an full outer join.

class InnerJoinFn<K,U,V>
          Used to perform the last step of an inner join.

class JoinFn<K,U,V>
          Represents a DoFn for performing joins.

class LeftOuterJoinFn<K,U,V>
          Used to perform the last step of an left outer join.

class RightOuterJoinFn<K,U,V>
          Used to perform the last step of an right outer join.

Subclasses of DoFn in org.apache.crunch.lib.join
`class`	`FullOuterJoinFn<K,U,V>` Used to perform the last step of an full outer join.
`class`	`InnerJoinFn<K,U,V>` Used to perform the last step of an inner join.
`class`	`JoinFn<K,U,V>` Represents a `DoFn` for performing joins.
`class`	`LeftOuterJoinFn<K,U,V>` Used to perform the last step of an left outer join.
`class`	`RightOuterJoinFn<K,U,V>` Used to perform the last step of an right outer join.

Uses of DoFn in org.apache.crunch.types

Subclasses of DoFn in org.apache.crunch.types

static class PGroupedTableType.PairIterableMapFn<K,V>

Subclasses of DoFn in org.apache.crunch.types
`static class`	`PGroupedTableType.PairIterableMapFn<K,V>`

Uses of DoFn in org.apache.crunch.util

Subclasses of DoFn in org.apache.crunch.util

static class Protos.ExtractKeyFn<M extends Message,K>


static class Protos.TextToProtoFn<M extends Message>


static class PTypes.JacksonInputMapFn<T>


static class PTypes.JacksonOutputMapFn<T>


static class PTypes.ProtoInputMapFn<T extends Message>


static class PTypes.ProtoOutputMapFn<T extends Message>


static class PTypes.ThriftInputMapFn<T extends TBase>


static class PTypes.ThriftOutputMapFn<T extends TBase>

Subclasses of DoFn in org.apache.crunch.util
`static class`	`Protos.ExtractKeyFn<M extends Message,K>`
`static class`	`Protos.TextToProtoFn<M extends Message>`
`static class`	`PTypes.JacksonInputMapFn<T>`
`static class`	`PTypes.JacksonOutputMapFn<T>`
`static class`	`PTypes.ProtoInputMapFn<T extends Message>`
`static class`	`PTypes.ProtoOutputMapFn<T extends Message>`
`static class`	`PTypes.ThriftInputMapFn<T extends TBase>`
`static class`	`PTypes.ThriftOutputMapFn<T extends TBase>`

Methods in org.apache.crunch.util that return DoFn

static <M extends com.google.protobuf.Message> DoFn<String,M> Protos.lineParser(String sep, Class<M> msgClass)