| Package | Description |
|---|---|
| org.apache.crunch |
Client-facing API and core abstractions.
|
| org.apache.crunch.impl.dist.collect | |
| org.apache.crunch.impl.spark | |
| org.apache.crunch.impl.spark.collect | |
| org.apache.crunch.impl.spark.fn | |
| org.apache.crunch.lambda |
Alternative Crunch API using Java 8 features to allow construction of pipelines using lambda functions and method
references.
|
| org.apache.crunch.types |
Common functionality for business object serialization.
|
| Modifier and Type | Method and Description |
|---|---|
GroupingOptions |
GroupingOptions.Builder.build() |
| Modifier and Type | Method and Description |
|---|---|
PGroupedTable<K,V> |
PTable.groupByKey(GroupingOptions options)
Performs a grouping operation on the keys of this table, using the
additional
GroupingOptions to control how the grouping is executed. |
boolean |
GroupingOptions.isCompatibleWith(GroupingOptions other) |
| Modifier and Type | Method and Description |
|---|---|
<K,V> BaseGroupedTable<K,V> |
PCollectionFactory.createGroupedTable(PTableBase<K,V> parent,
GroupingOptions groupingOptions) |
BaseGroupedTable<K,V> |
PTableBase.groupByKey(GroupingOptions groupingOptions) |
| Constructor and Description |
|---|
SparkComparator(GroupingOptions options,
PGroupedTableType ptype,
SparkRuntimeContext ctxt) |
| Modifier and Type | Method and Description |
|---|---|
<K,V> BaseGroupedTable<K,V> |
SparkCollectFactory.createGroupedTable(PTableBase<K,V> parent,
GroupingOptions groupingOptions) |
| Constructor and Description |
|---|
PartitionedMapOutputFunction(SerDe<K> keySerde,
SerDe<V> valueSerde,
PGroupedTableType<K,V> ptype,
int numPartitions,
GroupingOptions options,
SparkRuntimeContext runtimeContext) |
ReduceGroupingFunction(GroupingOptions options,
PGroupedTableType ptype,
SparkRuntimeContext ctxt) |
| Modifier and Type | Method and Description |
|---|---|
default LGroupedTable<K,V> |
LTable.groupByKey(GroupingOptions opts)
Group this table by key to yield a
LGroupedTable |
| Modifier and Type | Method and Description |
|---|---|
abstract void |
PGroupedTableType.configureShuffle(org.apache.hadoop.mapreduce.Job job,
GroupingOptions options) |
Copyright © 2016 The Apache Software Foundation. All rights reserved.