Package | Description |
---|---|
org.apache.crunch |
Client-facing API and core abstractions.
|
org.apache.crunch.impl.dist.collect | |
org.apache.crunch.impl.spark | |
org.apache.crunch.impl.spark.collect | |
org.apache.crunch.impl.spark.fn | |
org.apache.crunch.lambda |
Alternative Crunch API using Java 8 features to allow construction of pipelines using lambda functions and method
references.
|
org.apache.crunch.types |
Common functionality for business object serialization.
|
Modifier and Type | Method and Description |
---|---|
GroupingOptions |
GroupingOptions.Builder.build() |
Modifier and Type | Method and Description |
---|---|
PGroupedTable<K,V> |
PTable.groupByKey(GroupingOptions options)
Performs a grouping operation on the keys of this table, using the
additional
GroupingOptions to control how the grouping is executed. |
boolean |
GroupingOptions.isCompatibleWith(GroupingOptions other) |
Modifier and Type | Method and Description |
---|---|
<K,V> BaseGroupedTable<K,V> |
PCollectionFactory.createGroupedTable(PTableBase<K,V> parent,
GroupingOptions groupingOptions) |
BaseGroupedTable<K,V> |
PTableBase.groupByKey(GroupingOptions groupingOptions) |
Constructor and Description |
---|
SparkComparator(GroupingOptions options,
PGroupedTableType ptype,
SparkRuntimeContext ctxt) |
Modifier and Type | Method and Description |
---|---|
<K,V> BaseGroupedTable<K,V> |
SparkCollectFactory.createGroupedTable(PTableBase<K,V> parent,
GroupingOptions groupingOptions) |
Constructor and Description |
---|
PartitionedMapOutputFunction(SerDe<K> keySerde,
SerDe<V> valueSerde,
PGroupedTableType<K,V> ptype,
int numPartitions,
GroupingOptions options,
SparkRuntimeContext runtimeContext) |
ReduceGroupingFunction(GroupingOptions options,
PGroupedTableType ptype,
SparkRuntimeContext ctxt) |
Modifier and Type | Method and Description |
---|---|
default LGroupedTable<K,V> |
LTable.groupByKey(GroupingOptions opts)
Group this table by key to yield a
LGroupedTable |
Modifier and Type | Method and Description |
---|---|
abstract void |
PGroupedTableType.configureShuffle(org.apache.hadoop.mapreduce.Job job,
GroupingOptions options) |
Copyright © 2016 The Apache Software Foundation. All rights reserved.