Package | Description |
---|---|
org.apache.crunch |
Client-facing API and core abstractions.
|
org.apache.crunch.fn |
Commonly used functions for manipulating collections.
|
org.apache.crunch.types |
Common functionality for business object serialization.
|
org.apache.crunch.types.avro |
Business object serialization using Apache Avro.
|
org.apache.crunch.types.writable |
Business object serialization using Hadoop's Writables framework.
|
Modifier and Type | Method and Description |
---|---|
<K> PTable<K,S> |
PCollection.by(MapFn<S,K> extractKeyFn,
PType<K> keyType)
Apply the given map function to each element of this instance in order to
create a
PTable . |
<K> PTable<K,S> |
PCollection.by(String name,
MapFn<S,K> extractKeyFn,
PType<K> keyType)
Apply the given map function to each element of this instance in order to
create a
PTable . |
Modifier and Type | Class and Description |
---|---|
class |
CompositeMapFn<R,S,T> |
class |
ExtractKeyFn<K,V>
Wrapper function for converting a
MapFn into a key-value pair that is
used to convert from a PCollection<V> to a PTable<K, V> . |
class |
IdentityFn<T> |
class |
PairMapFn<K,V,S,T> |
Modifier and Type | Method and Description |
---|---|
MapFn<R,S> |
CompositeMapFn.getFirst() |
MapFn<S,T> |
CompositeMapFn.getSecond() |
Constructor and Description |
---|
CompositeMapFn(MapFn<R,S> first,
MapFn<S,T> second) |
CompositeMapFn(MapFn<R,S> first,
MapFn<S,T> second) |
ExtractKeyFn(MapFn<V,K> mapFn) |
PairMapFn(MapFn<K,S> keys,
MapFn<V,T> values) |
PairMapFn(MapFn<K,S> keys,
MapFn<V,T> values) |
Modifier and Type | Class and Description |
---|---|
static class |
PGroupedTableType.PairIterableMapFn<K,V> |
Modifier and Type | Field and Description |
---|---|
static MapFn<BigInteger,ByteBuffer> |
PTypes.BIGINT_TO_BYTE |
static MapFn<ByteBuffer,BigInteger> |
PTypes.BYTE_TO_BIGINT |
Modifier and Type | Method and Description |
---|---|
static <M extends com.google.protobuf.Message,K> |
Protos.extractKey(String fieldName) |
MapFn<Object,T> |
PType.getInputMapFn() |
MapFn<T,Object> |
PType.getOutputMapFn() |
Modifier and Type | Method and Description |
---|---|
<S,T> PType<T> |
PTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
<S,T> PType<T> |
PTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
Constructor and Description |
---|
PGroupedTableType.PairIterableMapFn(MapFn<Object,K> keys,
MapFn<Object,V> values) |
PGroupedTableType.PairIterableMapFn(MapFn<Object,K> keys,
MapFn<Object,V> values) |
Modifier and Type | Field and Description |
---|---|
static MapFn<Object,ByteBuffer> |
Avros.BYTES_IN |
static MapFn<String,org.apache.avro.util.Utf8> |
Avros.STRING_TO_UTF8 |
static MapFn<CharSequence,String> |
Avros.UTF8_TO_STRING |
Modifier and Type | Method and Description |
---|---|
MapFn<Object,T> |
AvroType.getInputMapFn() |
MapFn<T,Object> |
AvroType.getOutputMapFn() |
Modifier and Type | Method and Description |
---|---|
static <S,T> AvroType<T> |
Avros.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
static <S,T> AvroType<T> |
Avros.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
<S,T> PType<T> |
AvroTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
<S,T> PType<T> |
AvroTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
Constructor and Description |
---|
AvroType(Class<T> typeClass,
org.apache.avro.Schema schema,
MapFn inputMapFn,
MapFn outputMapFn,
DeepCopier<T> deepCopier,
PType... ptypes) |
AvroType(Class<T> typeClass,
org.apache.avro.Schema schema,
MapFn inputMapFn,
MapFn outputMapFn,
DeepCopier<T> deepCopier,
PType... ptypes) |
Modifier and Type | Method and Description |
---|---|
MapFn |
WritableType.getInputMapFn() |
MapFn |
WritableType.getOutputMapFn() |
Modifier and Type | Method and Description |
---|---|
static <S,T> PType<T> |
Writables.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
static <S,T> PType<T> |
Writables.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
<S,T> PType<T> |
WritableTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
<S,T> PType<T> |
WritableTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
Constructor and Description |
---|
WritableType(Class<T> typeClass,
Class<W> writableClass,
MapFn<W,T> inputDoFn,
MapFn<T,W> outputDoFn,
PType... subTypes) |
WritableType(Class<T> typeClass,
Class<W> writableClass,
MapFn<W,T> inputDoFn,
MapFn<T,W> outputDoFn,
PType... subTypes) |
Copyright © 2013 The Apache Software Foundation. All Rights Reserved.