Package | Description |
---|---|
org.apache.crunch |
Client-facing API and core abstractions.
|
org.apache.crunch.contrib.text | |
org.apache.crunch.lib |
Joining, sorting, aggregating, and other commonly used functionality.
|
org.apache.crunch.lib.sort | |
org.apache.crunch.types |
Common functionality for business object serialization.
|
org.apache.crunch.types.avro |
Business object serialization using Apache Avro.
|
org.apache.crunch.types.orc | |
org.apache.crunch.types.writable |
Business object serialization using Hadoop's Writables framework.
|
Modifier and Type | Class and Description |
---|---|
class |
Pair<K,V>
A convenience class for two-element
Tuple s. |
class |
Tuple3<V1,V2,V3>
A convenience class for three-element
Tuple s. |
static class |
Tuple3.Collect<V1,V2,V3> |
class |
Tuple4<V1,V2,V3,V4>
A convenience class for four-element
Tuple s. |
static class |
Tuple4.Collect<V1,V2,V3,V4> |
class |
TupleN
A
Tuple instance for an arbitrary number of values. |
Modifier and Type | Method and Description |
---|---|
static <T extends Tuple> |
Extractors.xcustom(Class<T> clazz,
TokenizerFactory scannerFactory,
Extractor... extractors)
Returns an Extractor for a subclass of
Tuple with a constructor that
has the given extractor types that uses the given TokenizerFactory
for parsing the sub-fields. |
Modifier and Type | Method and Description |
---|---|
static <T extends Tuple> |
Sort.sortTuples(PCollection<T> collection,
int numReducers,
Sort.ColumnOrder... columnOrders)
Sorts the
PCollection of TupleN s using the specified column
ordering and a client-specified number of reducers. |
static <T extends Tuple> |
Sort.sortTuples(PCollection<T> collection,
Sort.ColumnOrder... columnOrders)
Sorts the
PCollection of tuples using the specified column ordering. |
Modifier and Type | Class and Description |
---|---|
static class |
SortFns.AvroGenericFn<V extends Tuple>
Pulls a composite set of keys from an Avro
GenericRecord instance. |
static class |
SortFns.KeyExtraction<V extends Tuple>
Utility class for encapsulating key extraction logic and serialization information about
key extraction.
|
static class |
SortFns.SingleKeyFn<V extends Tuple,K>
Extracts a single indexed key from a
Tuple instance. |
static class |
SortFns.TupleKeyFn<V extends Tuple,K extends Tuple>
Extracts a composite key from a
Tuple instance. |
static class |
SortFns.TupleKeyFn<V extends Tuple,K extends Tuple>
Extracts a composite key from a
Tuple instance. |
Modifier and Type | Class and Description |
---|---|
class |
TupleDeepCopier<T extends Tuple>
Performs deep copies (based on underlying PType deep copying) of Tuple-based objects.
|
class |
TupleFactory<T extends Tuple> |
Modifier and Type | Method and Description |
---|---|
static <T extends Tuple> |
TupleFactory.create(Class<T> clazz,
Class... typeArgs) |
static <T extends Tuple> |
TupleFactory.getTupleFactory(Class<T> tupleClass)
Get the
TupleFactory for a given Tuple implementation. |
<T extends Tuple> |
PTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes) |
Modifier and Type | Method and Description |
---|---|
static <T extends Tuple> |
Avros.tuples(Class<T> clazz,
PType... ptypes) |
<T extends Tuple> |
AvroTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes) |
Modifier and Type | Class and Description |
---|---|
class |
TupleObjectInspector<T extends Tuple>
An object inspector to define the structure of Crunch Tuples
|
Modifier and Type | Method and Description |
---|---|
static <T extends Tuple> |
Writables.tuples(Class<T> clazz,
PType... ptypes) |
<T extends Tuple> |
WritableTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes) |
Copyright © 2016 The Apache Software Foundation. All rights reserved.