Package | Description |
---|---|
org.apache.crunch |
Client-facing API and core abstractions.
|
org.apache.crunch.fn |
Commonly used functions for manipulating collections.
|
org.apache.crunch.impl.dist.collect | |
org.apache.crunch.impl.spark | |
org.apache.crunch.impl.spark.collect | |
org.apache.crunch.impl.spark.fn | |
org.apache.crunch.lib |
Joining, sorting, aggregating, and other commonly used functionality.
|
Modifier and Type | Method and Description |
---|---|
PTable<K,V> |
PGroupedTable.combineValues(CombineFn<K,V> combineFn)
Combines the values of this grouping using the given
CombineFn . |
PTable<K,V> |
PGroupedTable.combineValues(CombineFn<K,V> combineFn,
CombineFn<K,V> reduceFn)
Combines and reduces the values of this grouping using the given
CombineFn instances. |
PTable<K,V> |
PGroupedTable.combineValues(CombineFn<K,V> combineFn,
CombineFn<K,V> reduceFn)
Combines and reduces the values of this grouping using the given
CombineFn instances. |
Modifier and Type | Method and Description |
---|---|
static <K,V> CombineFn<K,V> |
Aggregators.toCombineFn(Aggregator<V> aggregator)
Deprecated.
use the safer
Aggregators.toCombineFn(Aggregator, PType) instead. |
static <K,V> CombineFn<K,V> |
Aggregators.toCombineFn(Aggregator<V> aggregator,
PType<V> ptype)
Wrap a
CombineFn adapter around the given aggregator. |
Modifier and Type | Method and Description |
---|---|
PTable<K,V> |
BaseGroupedTable.combineValues(CombineFn<K,V> combineFn) |
PTable<K,V> |
BaseGroupedTable.combineValues(CombineFn<K,V> combineFn,
CombineFn<K,V> reduceFn) |
PTable<K,V> |
BaseGroupedTable.combineValues(CombineFn<K,V> combineFn,
CombineFn<K,V> reduceFn) |
<S,K,V> BaseDoTable<K,V> |
PCollectionFactory.createDoTable(String name,
PCollectionImpl<S> chainingCollection,
CombineFn<K,V> combineFn,
DoFn<S,Pair<K,V>> fn,
PTableType<K,V> type) |
Modifier and Type | Method and Description |
---|---|
CombineFn |
SparkRuntime.getCombineFn() |
Modifier and Type | Method and Description |
---|---|
void |
SparkRuntime.setCombineFn(CombineFn combineFn) |
Modifier and Type | Method and Description |
---|---|
<S,K,V> BaseDoTable<K,V> |
SparkCollectFactory.createDoTable(String name,
PCollectionImpl<S> parent,
CombineFn<K,V> combineFn,
DoFn<S,Pair<K,V>> fn,
PTableType<K,V> type) |
Constructor and Description |
---|
CombineMapsideFunction(CombineFn<K,V> combineFn,
SparkRuntimeContext ctxt) |
Modifier and Type | Class and Description |
---|---|
static class |
Aggregate.TopKCombineFn<K,V> |
Copyright © 2016 The Apache Software Foundation. All rights reserved.