Package | Description |
---|---|
org.apache.crunch |
Client-facing API and core abstractions.
|
org.apache.crunch.contrib.text | |
org.apache.crunch.fn |
Commonly used functions for manipulating collections.
|
org.apache.crunch.lib |
Joining, sorting, aggregating, and other commonly used functionality.
|
org.apache.crunch.types |
Common functionality for business object serialization.
|
org.apache.crunch.types.avro |
Business object serialization using Apache Avro.
|
org.apache.crunch.types.orc | |
org.apache.crunch.types.writable |
Business object serialization using Hadoop's Writables framework.
|
org.apache.crunch.util |
An assorted set of utilities.
|
Modifier and Type | Method and Description |
---|---|
static TupleN |
TupleN.of(Object... values) |
Modifier and Type | Method and Description |
---|---|
static Extractor<TupleN> |
Extractors.xtupleN(TokenizerFactory scannerFactory,
Extractor... extractors)
Returns an Extractor for an arbitrary number of types that uses the given
TokenizerFactory
for parsing the sub-fields. |
Modifier and Type | Method and Description |
---|---|
static Aggregator<TupleN> |
Aggregators.tupleAggregator(Aggregator<?>... aggregators)
Apply separate aggregators to each component of a
Tuple . |
Modifier and Type | Method and Description |
---|---|
static <K,U,V> PTable<K,TupleN> |
Cogroup.cogroup(int numReducers,
PTable<K,?> first,
PTable<K,?>... rest)
Co-groups an arbitrary number of
PTable arguments with a user-specified degree of parallelism
(a.k.a, number of reducers.) The largest table should come last in the ordering. |
static <K> PTable<K,TupleN> |
Cogroup.cogroup(PTable<K,?> first,
PTable<K,?>... rest)
Co-groups an arbitrary number of
PTable arguments. |
Modifier and Type | Field and Description |
---|---|
static TupleFactory<TupleN> |
TupleFactory.TUPLEN |
Modifier and Type | Method and Description |
---|---|
PType<TupleN> |
PTypeFamily.tuples(PType<?>... ptypes) |
Modifier and Type | Method and Description |
---|---|
static AvroType<TupleN> |
Avros.namedTuples(String tupleName,
String[] fieldNames,
PType[] ptypes) |
static AvroType<TupleN> |
Avros.tuples(PType... ptypes) |
PType<TupleN> |
AvroTypeFamily.tuples(PType<?>... ptypes) |
Modifier and Type | Method and Description |
---|---|
static PType<TupleN> |
Orcs.tuples(PType... ptypes)
Create a tuple-based PType.
|
Modifier and Type | Method and Description |
---|---|
static WritableType<TupleN,TupleWritable> |
Writables.tuples(PType... ptypes) |
PType<TupleN> |
WritableTypeFamily.tuples(PType<?>... ptypes) |
Modifier and Type | Method and Description |
---|---|
Iterator<TupleN> |
Tuples.TupleNIterable.iterator() |
Copyright © 2016 The Apache Software Foundation. All rights reserved.