Package | Description |
---|---|
org.apache.crunch |
Client-facing API and core abstractions.
|
org.apache.crunch.impl.mem |
In-memory Pipeline implementation for rapid prototyping and testing.
|
org.apache.crunch.lib |
Joining, sorting, aggregating, and other commonly used functionality.
|
org.apache.crunch.types |
Common functionality for business object serialization.
|
org.apache.crunch.types.avro |
Business object serialization using Apache Avro.
|
org.apache.crunch.types.writable |
Business object serialization using Hadoop's Writables framework.
|
Modifier and Type | Method and Description |
---|---|
PTableType<K,V> |
PTable.getPTableType()
Returns the
PTableType of this PTable . |
PTableType<K,V> |
TableSource.getTableType() |
Modifier and Type | Method and Description |
---|---|
<K,V> PTable<K,V> |
PCollection.parallelDo(DoFn<S,Pair<K,V>> doFn,
PTableType<K,V> type)
Similar to the other
parallelDo instance, but returns a
PTable instance instead of a PCollection . |
<K,V> PTable<K,V> |
PCollection.parallelDo(String name,
DoFn<S,Pair<K,V>> doFn,
PTableType<K,V> type)
Similar to the other
parallelDo instance, but returns a
PTable instance instead of a PCollection . |
<K,V> PTable<K,V> |
PCollection.parallelDo(String name,
DoFn<S,Pair<K,V>> doFn,
PTableType<K,V> type,
ParallelDoOptions options)
Similar to the other
parallelDo instance, but returns a
PTable instance instead of a PCollection . |
Modifier and Type | Method and Description |
---|---|
static <S,T> PTable<S,T> |
MemPipeline.typedTableOf(PTableType<S,T> ptype,
Iterable<Pair<S,T>> pairs) |
static <S,T> PTable<S,T> |
MemPipeline.typedTableOf(PTableType<S,T> ptype,
S s,
T t,
Object... more) |
Modifier and Type | Method and Description |
---|---|
static <K,V> Pair<K,V> |
PTables.getDetachedValue(PTableType<K,V> tableType,
Pair<K,V> value)
Create a detached value for a table
Pair . |
static <K,V1,V2,U,V> |
SecondarySort.sortAndApply(PTable<K,Pair<V1,V2>> input,
DoFn<Pair<K,Iterable<Pair<V1,V2>>>,Pair<U,V>> doFn,
PTableType<U,V> ptype)
Perform a secondary sort on the given
PTable instance and then apply a
DoFn to the resulting sorted data to yield an output PTable<U, V> . |
Modifier and Type | Method and Description |
---|---|
PTableType<K,V> |
PGroupedTableType.getTableType() |
<K,V> PTableType<K,V> |
PTypeFamily.tableOf(PType<K> key,
PType<V> value) |
Constructor and Description |
---|
PGroupedTableType(PTableType<K,V> tableType) |
Modifier and Type | Method and Description |
---|---|
<K,V> PTableType<K,V> |
AvroTypeFamily.tableOf(PType<K> key,
PType<V> value) |
Modifier and Type | Method and Description |
---|---|
<K,V> PTableType<K,V> |
WritableTypeFamily.tableOf(PType<K> key,
PType<V> value) |
Copyright © 2013 The Apache Software Foundation. All Rights Reserved.