Package | Description |
---|---|
org.apache.crunch |
Client-facing API and core abstractions.
|
org.apache.crunch.impl.dist.collect | |
org.apache.crunch.impl.spark.collect | |
org.apache.crunch.lambda |
Alternative Crunch API using Java 8 features to allow construction of pipelines using lambda functions and method
references.
|
org.apache.crunch.lib |
Joining, sorting, aggregating, and other commonly used functionality.
|
Modifier and Type | Method and Description |
---|---|
PGroupedTable<K,V> |
PTable.groupByKey()
Performs a grouping operation on the keys of this table.
|
PGroupedTable<K,V> |
PTable.groupByKey(GroupingOptions options)
Performs a grouping operation on the keys of this table, using the
additional
GroupingOptions to control how the grouping is executed. |
PGroupedTable<K,V> |
PTable.groupByKey(int numPartitions)
Performs a grouping operation on the keys of this table, using the given
number of partitions.
|
Modifier and Type | Class and Description |
---|---|
class |
BaseGroupedTable<K,V> |
Modifier and Type | Class and Description |
---|---|
class |
PGroupedTableImpl<K,V> |
Modifier and Type | Method and Description |
---|---|
PGroupedTable<K,V> |
LGroupedTable.underlying()
Get the underlying
PGroupedTable for this LGroupedTable |
Modifier and Type | Method and Description |
---|---|
<K,V> LGroupedTable<K,V> |
LCollectionFactory.wrap(PGroupedTable<K,V> collection)
Wrap a PGroupedTable into an LGroupedTable
|
static <K,V> LGroupedTable<K,V> |
Lambda.wrap(PGroupedTable<K,V> collection) |
Modifier and Type | Method and Description |
---|---|
static <K,U,V> PTable<K,V> |
PTables.mapValues(PGroupedTable<K,U> ptable,
MapFn<Iterable<U>,V> mapFn,
PType<V> ptype)
An analogue of the
mapValues function for PGroupedTable<K, U> collections. |
static <K,U,V> PTable<K,V> |
PTables.mapValues(String name,
PGroupedTable<K,U> ptable,
MapFn<Iterable<U>,V> mapFn,
PType<V> ptype)
An analogue of the
mapValues function for PGroupedTable<K, U> collections. |
static <K1,V1,K2 extends org.apache.hadoop.io.Writable,V2 extends org.apache.hadoop.io.Writable> |
Mapreduce.reduce(PGroupedTable<K1,V1> input,
Class<? extends org.apache.hadoop.mapreduce.Reducer<K1,V1,K2,V2>> reducerClass,
Class<K2> keyClass,
Class<V2> valueClass) |
static <K1,V1,K2 extends org.apache.hadoop.io.Writable,V2 extends org.apache.hadoop.io.Writable> |
Mapred.reduce(PGroupedTable<K1,V1> input,
Class<? extends org.apache.hadoop.mapred.Reducer<K1,V1,K2,V2>> reducerClass,
Class<K2> keyClass,
Class<V2> valueClass) |
Copyright © 2016 The Apache Software Foundation. All rights reserved.