Package | Description |
---|---|
org.apache.crunch |
Client-facing API and core abstractions.
|
org.apache.crunch.contrib.bloomfilter |
Support for creating Bloom Filters.
|
org.apache.crunch.fn |
Commonly used functions for manipulating collections.
|
org.apache.crunch.lib |
Joining, sorting, aggregating, and other commonly used functionality.
|
org.apache.crunch.lib.join |
Inner and outer joins on collections.
|
Modifier and Type | Method and Description |
---|---|
void |
FilterFn.cleanup(Emitter<T> emitter) |
void |
DoFn.cleanup(Emitter<T> emitter)
Called during the cleanup of the MapReduce job this
DoFn is
associated with. |
void |
MapFn.process(S input,
Emitter<T> emitter) |
abstract void |
DoFn.process(S input,
Emitter<T> emitter)
Processes the records from a
PCollection . |
void |
FilterFn.process(T input,
Emitter<T> emitter) |
Modifier and Type | Method and Description |
---|---|
void |
BloomFilterFn.cleanup(Emitter<Pair<String,org.apache.hadoop.util.bloom.BloomFilter>> emitter) |
void |
BloomFilterFn.process(S input,
Emitter<Pair<String,org.apache.hadoop.util.bloom.BloomFilter>> emitter) |
Modifier and Type | Method and Description |
---|---|
void |
PairMapFn.cleanup(Emitter<Pair<S,T>> emitter) |
void |
CompositeMapFn.cleanup(Emitter<T> emitter) |
void |
SFlatMapFunction2.process(Pair<K,V> input,
Emitter<R> emitter) |
void |
SDoubleFlatMapFunction.process(T input,
Emitter<Double> emitter) |
void |
SPairFlatMapFunction.process(T input,
Emitter<Pair<K,V>> emitter) |
void |
SFlatMapFunction.process(T input,
Emitter<R> emitter) |
Modifier and Type | Method and Description |
---|---|
void |
Aggregate.TopKFn.cleanup(Emitter<Pair<Integer,Pair<K,V>>> emitter) |
void |
Aggregate.TopKCombineFn.process(Pair<Integer,Iterable<Pair<K,V>>> input,
Emitter<Pair<Integer,Pair<K,V>>> emitter) |
void |
Aggregate.TopKFn.process(Pair<K,V> input,
Emitter<Pair<Integer,Pair<K,V>>> emitter) |
Modifier and Type | Method and Description |
---|---|
void |
LeftOuterJoinFn.cleanup(Emitter<Pair<K,Pair<U,V>>> emitter)
Called during the cleanup of the MapReduce job this
DoFn is
associated with. |
void |
FullOuterJoinFn.cleanup(Emitter<Pair<K,Pair<U,V>>> emitter)
Called during the cleanup of the MapReduce job this
DoFn is
associated with. |
void |
RightOuterJoinFn.join(K key,
int id,
Iterable<Pair<U,V>> pairs,
Emitter<Pair<K,Pair<U,V>>> emitter)
Performs the actual joining.
|
void |
LeftOuterJoinFn.join(K key,
int id,
Iterable<Pair<U,V>> pairs,
Emitter<Pair<K,Pair<U,V>>> emitter)
Performs the actual joining.
|
abstract void |
JoinFn.join(K key,
int id,
Iterable<Pair<U,V>> pairs,
Emitter<Pair<K,Pair<U,V>>> emitter)
Performs the actual joining.
|
void |
InnerJoinFn.join(K key,
int id,
Iterable<Pair<U,V>> pairs,
Emitter<Pair<K,Pair<U,V>>> emitter) |
void |
FullOuterJoinFn.join(K key,
int id,
Iterable<Pair<U,V>> pairs,
Emitter<Pair<K,Pair<U,V>>> emitter)
Performs the actual joining.
|
void |
JoinFn.process(Pair<Pair<K,Integer>,Iterable<Pair<U,V>>> input,
Emitter<Pair<K,Pair<U,V>>> emitter)
Split up the input record to make coding a bit more manageable.
|
Copyright © 2016 The Apache Software Foundation. All rights reserved.