Package | Description |
---|---|
org.apache.crunch |
Client-facing API and core abstractions.
|
org.apache.crunch.contrib.io.jdbc |
Support for reading data from RDBMS using JDBC
|
org.apache.crunch.contrib.text | |
org.apache.crunch.impl.mem |
In-memory Pipeline implementation for rapid prototyping and testing.
|
org.apache.crunch.impl.mr |
A Pipeline implementation that runs on Hadoop MapReduce.
|
org.apache.crunch.io |
Data input and output for Pipelines.
|
org.apache.crunch.lib |
Joining, sorting, aggregating, and other commonly used functionality.
|
org.apache.crunch.lib.join |
Inner and outer joins on collections.
|
org.apache.crunch.types |
Common functionality for business object serialization.
|
org.apache.crunch.types.avro |
Business object serialization using Apache Avro.
|
org.apache.crunch.types.writable |
Business object serialization using Hadoop's Writables framework.
|
Modifier and Type | Method and Description |
---|---|
PType<K> |
PTable.getKeyType()
Returns the
PType of the key. |
PType<S> |
PCollection.getPType()
Returns the
PType of this PCollection . |
PType<T> |
Source.getType()
Returns the
PType for this source. |
PType<V> |
PTable.getValueType()
Returns the
PType of the value. |
Modifier and Type | Method and Description |
---|---|
boolean |
Target.accept(OutputHandler handler,
PType<?> ptype)
Checks to see if this
Target instance is compatible with the
given PType . |
<T> SourceTarget<T> |
Target.asSourceTarget(PType<T> ptype)
Attempt to create the
SourceTarget type that corresponds to this Target
for the given PType , if possible. |
<K> PTable<K,S> |
PCollection.by(MapFn<S,K> extractKeyFn,
PType<K> keyType)
Apply the given map function to each element of this instance in order to
create a
PTable . |
<K> PTable<K,S> |
PCollection.by(String name,
MapFn<S,K> extractKeyFn,
PType<K> keyType)
Apply the given map function to each element of this instance in order to
create a
PTable . |
<T> PCollection<T> |
PCollection.parallelDo(DoFn<S,T> doFn,
PType<T> type)
Applies the given doFn to the elements of this
PCollection and
returns a new PCollection that is the output of this processing. |
<T> PCollection<T> |
PCollection.parallelDo(String name,
DoFn<S,T> doFn,
PType<T> type)
Applies the given doFn to the elements of this
PCollection and
returns a new PCollection that is the output of this processing. |
<T> PCollection<T> |
PCollection.parallelDo(String name,
DoFn<S,T> doFn,
PType<T> type,
ParallelDoOptions options)
Applies the given doFn to the elements of this
PCollection and
returns a new PCollection that is the output of this processing. |
Modifier and Type | Method and Description |
---|---|
PType<T> |
DataBaseSource.getType() |
Modifier and Type | Method and Description |
---|---|
PType<T> |
Extractor.getPType(PTypeFamily ptf)
Returns the
PType associated with this data type for the
given PTypeFamily . |
Modifier and Type | Method and Description |
---|---|
static <T> PCollection<T> |
MemPipeline.typedCollectionOf(PType<T> ptype,
Iterable<T> collect) |
static <T> PCollection<T> |
MemPipeline.typedCollectionOf(PType<T> ptype,
T... ts) |
Modifier and Type | Method and Description |
---|---|
<T> SourceTarget<T> |
MRPipeline.createIntermediateOutput(PType<T> ptype) |
Modifier and Type | Method and Description |
---|---|
boolean |
OutputHandler.configure(Target target,
PType<?> ptype) |
void |
PathTargetImpl.configureForMapReduce(org.apache.hadoop.mapreduce.Job job,
PType<?> ptype,
org.apache.hadoop.fs.Path outputPath,
String name) |
void |
MapReduceTarget.configureForMapReduce(org.apache.hadoop.mapreduce.Job job,
PType<?> ptype,
org.apache.hadoop.fs.Path outputPath,
String name) |
static <K,V> TableSource<K,V> |
From.formattedFile(org.apache.hadoop.fs.Path path,
Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<?,?>> formatClass,
PType<K> keyType,
PType<V> valueType)
Creates a
TableSource<K, V> for reading data from files that have custom
FileInputFormat implementations not covered by the provided TableSource
and Source factory methods. |
static <K,V> TableSource<K,V> |
From.formattedFile(org.apache.hadoop.fs.Path path,
Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<?,?>> formatClass,
PType<K> keyType,
PType<V> valueType)
Creates a
TableSource<K, V> for reading data from files that have custom
FileInputFormat implementations not covered by the provided TableSource
and Source factory methods. |
static <K,V> TableSource<K,V> |
From.formattedFile(String pathName,
Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<?,?>> formatClass,
PType<K> keyType,
PType<V> valueType)
Creates a
TableSource<K, V> for reading data from files that have custom
FileInputFormat implementations not covered by the provided TableSource
and Source factory methods. |
static <K,V> TableSource<K,V> |
From.formattedFile(String pathName,
Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<?,?>> formatClass,
PType<K> keyType,
PType<V> valueType)
Creates a
TableSource<K, V> for reading data from files that have custom
FileInputFormat implementations not covered by the provided TableSource
and Source factory methods. |
static <K,V> TableSource<K,V> |
From.sequenceFile(org.apache.hadoop.fs.Path path,
PType<K> keyType,
PType<V> valueType)
Creates a
TableSource<K, V> instance for the SequenceFile(s) at the given Path . |
static <K,V> TableSource<K,V> |
From.sequenceFile(org.apache.hadoop.fs.Path path,
PType<K> keyType,
PType<V> valueType)
Creates a
TableSource<K, V> instance for the SequenceFile(s) at the given Path . |
static <K,V> TableSourceTarget<K,V> |
At.sequenceFile(org.apache.hadoop.fs.Path path,
PType<K> keyType,
PType<V> valueType)
Creates a
TableSourceTarget<K, V> instance from the SequenceFile(s) at the given Path
from the key-value pairs in the SequenceFile(s). |
static <K,V> TableSourceTarget<K,V> |
At.sequenceFile(org.apache.hadoop.fs.Path path,
PType<K> keyType,
PType<V> valueType)
Creates a
TableSourceTarget<K, V> instance from the SequenceFile(s) at the given Path
from the key-value pairs in the SequenceFile(s). |
static <T> Source<T> |
From.sequenceFile(org.apache.hadoop.fs.Path path,
PType<T> ptype)
Creates a
Source<T> instance from the SequenceFile(s) at the given Path
from the value field of each key-value pair in the SequenceFile(s). |
static <T> SourceTarget<T> |
At.sequenceFile(org.apache.hadoop.fs.Path path,
PType<T> ptype)
Creates a
SourceTarget<T> instance from the SequenceFile(s) at the given Path
from the value field of each key-value pair in the SequenceFile(s). |
static <K,V> TableSource<K,V> |
From.sequenceFile(String pathName,
PType<K> keyType,
PType<V> valueType)
Creates a
TableSource<K, V> instance for the SequenceFile(s) at the given path name. |
static <K,V> TableSource<K,V> |
From.sequenceFile(String pathName,
PType<K> keyType,
PType<V> valueType)
Creates a
TableSource<K, V> instance for the SequenceFile(s) at the given path name. |
static <K,V> TableSourceTarget<K,V> |
At.sequenceFile(String pathName,
PType<K> keyType,
PType<V> valueType)
Creates a
TableSourceTarget<K, V> instance from the SequenceFile(s) at the given path name
from the key-value pairs in the SequenceFile(s). |
static <K,V> TableSourceTarget<K,V> |
At.sequenceFile(String pathName,
PType<K> keyType,
PType<V> valueType)
Creates a
TableSourceTarget<K, V> instance from the SequenceFile(s) at the given path name
from the key-value pairs in the SequenceFile(s). |
static <T> Source<T> |
From.sequenceFile(String pathName,
PType<T> ptype)
Creates a
Source<T> instance from the SequenceFile(s) at the given path name
from the value field of each key-value pair in the SequenceFile(s). |
static <T> SourceTarget<T> |
At.sequenceFile(String pathName,
PType<T> ptype)
Creates a
SourceTarget<T> instance from the SequenceFile(s) at the given path name
from the value field of each key-value pair in the SequenceFile(s). |
static <T> Source<T> |
From.textFile(org.apache.hadoop.fs.Path path,
PType<T> ptype)
Creates a
Source<T> instance for the text file(s) at the given Path using
the provided PType<T> to convert the input text. |
static <T> SourceTarget<T> |
At.textFile(org.apache.hadoop.fs.Path path,
PType<T> ptype)
Creates a
SourceTarget<T> instance for the text file(s) at the given Path using
the provided PType<T> to convert the input text. |
static <T> Source<T> |
From.textFile(String pathName,
PType<T> ptype)
Creates a
Source<T> instance for the text file(s) at the given path name using
the provided PType<T> to convert the input text. |
static <T> SourceTarget<T> |
At.textFile(String pathName,
PType<T> ptype)
Creates a
SourceTarget<T> instance for the text file(s) at the given path name using
the provided PType<T> to convert the input text. |
Modifier and Type | Method and Description |
---|---|
static <K,V1,V2,T> |
SecondarySort.sortAndApply(PTable<K,Pair<V1,V2>> input,
DoFn<Pair<K,Iterable<Pair<V1,V2>>>,T> doFn,
PType<T> ptype)
Perform a secondary sort on the given
PTable instance and then apply a
DoFn to the resulting sorted data to yield an output PCollection<T> . |
Constructor and Description |
---|
FullOuterJoinFn(PType<K> keyType,
PType<U> leftValueType) |
FullOuterJoinFn(PType<K> keyType,
PType<U> leftValueType) |
InnerJoinFn(PType<K> keyType,
PType<U> leftValueType) |
InnerJoinFn(PType<K> keyType,
PType<U> leftValueType) |
JoinFn(PType<K> keyType,
PType<U> leftValueType)
Instantiate with the PType of the value of the left side of the join (used for creating deep
copies of values).
|
JoinFn(PType<K> keyType,
PType<U> leftValueType)
Instantiate with the PType of the value of the left side of the join (used for creating deep
copies of values).
|
LeftOuterJoinFn(PType<K> keyType,
PType<U> leftValueType) |
LeftOuterJoinFn(PType<K> keyType,
PType<U> leftValueType) |
RightOuterJoinFn(PType<K> keyType,
PType<U> leftValueType) |
RightOuterJoinFn(PType<K> keyType,
PType<U> leftValueType) |
Modifier and Type | Interface and Description |
---|---|
interface |
PTableType<K,V>
An extension of
PType specifically for PTable objects. |
Modifier and Type | Class and Description |
---|---|
class |
PGroupedTableType<K,V>
The
PType instance for PGroupedTable instances. |
Modifier and Type | Method and Description |
---|---|
<T> PType<T> |
PTypeFamily.as(PType<T> ptype)
Returns the equivalent of the given ptype for this family, if it exists.
|
static PType<BigInteger> |
PTypes.bigInt(PTypeFamily typeFamily) |
PType<Boolean> |
PTypeFamily.booleans() |
PType<ByteBuffer> |
PTypeFamily.bytes() |
<T> PType<Collection<T>> |
PTypeFamily.collections(PType<T> ptype) |
static <T> PType<T> |
PTypeUtils.convert(PType<T> ptype,
PTypeFamily tf) |
<S,T> PType<T> |
PTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
PType<Double> |
PTypeFamily.doubles() |
static <T extends Enum> |
PTypes.enums(Class<T> type,
PTypeFamily typeFamily) |
PType<Float> |
PTypeFamily.floats() |
PType<K> |
PTableType.getKeyType()
Returns the key type for the table.
|
PType<V> |
PTableType.getValueType()
Returns the value type for the table.
|
PType<Integer> |
PTypeFamily.ints() |
static <T> PType<T> |
PTypes.jsonString(Class<T> clazz,
PTypeFamily typeFamily) |
PType<Long> |
PTypeFamily.longs() |
<T> PType<Map<String,T>> |
PTypeFamily.maps(PType<T> ptype) |
PType<Void> |
PTypeFamily.nulls() |
<V1,V2> PType<Pair<V1,V2>> |
PTypeFamily.pairs(PType<V1> p1,
PType<V2> p2) |
static <T extends com.google.protobuf.Message> |
PTypes.protos(Class<T> clazz,
PTypeFamily typeFamily) |
<V1,V2,V3,V4> |
PTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<T> PType<T> |
PTypeFamily.records(Class<T> clazz) |
PType<String> |
PTypeFamily.strings() |
static <T extends org.apache.thrift.TBase> |
PTypes.thrifts(Class<T> clazz,
PTypeFamily typeFamily) |
<V1,V2,V3> PType<Tuple3<V1,V2,V3>> |
PTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
<T extends Tuple> |
PTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes) |
PType<TupleN> |
PTypeFamily.tuples(PType<?>... ptypes) |
Modifier and Type | Method and Description |
---|---|
List<PType> |
PType.getSubTypes()
Returns the sub-types that make up this PType if it is a composite instance, such as a tuple.
|
List<PType> |
PGroupedTableType.getSubTypes() |
Modifier and Type | Method and Description |
---|---|
<T> PType<T> |
PTypeFamily.as(PType<T> ptype)
Returns the equivalent of the given ptype for this family, if it exists.
|
<T> PType<Collection<T>> |
PTypeFamily.collections(PType<T> ptype) |
static <T> PType<T> |
PTypeUtils.convert(PType<T> ptype,
PTypeFamily tf) |
<S,T> PType<T> |
PTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
<T> PType<Map<String,T>> |
PTypeFamily.maps(PType<T> ptype) |
<V1,V2> PType<Pair<V1,V2>> |
PTypeFamily.pairs(PType<V1> p1,
PType<V2> p2) |
<V1,V2> PType<Pair<V1,V2>> |
PTypeFamily.pairs(PType<V1> p1,
PType<V2> p2) |
<V1,V2,V3,V4> |
PTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<V1,V2,V3,V4> |
PTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<V1,V2,V3,V4> |
PTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<V1,V2,V3,V4> |
PTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<K,V> PTableType<K,V> |
PTypeFamily.tableOf(PType<K> key,
PType<V> value) |
<K,V> PTableType<K,V> |
PTypeFamily.tableOf(PType<K> key,
PType<V> value) |
<V1,V2,V3> PType<Tuple3<V1,V2,V3>> |
PTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
<V1,V2,V3> PType<Tuple3<V1,V2,V3>> |
PTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
<V1,V2,V3> PType<Tuple3<V1,V2,V3>> |
PTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
<T extends Tuple> |
PTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes) |
PType<TupleN> |
PTypeFamily.tuples(PType<?>... ptypes) |
Constructor and Description |
---|
CollectionDeepCopier(PType<T> elementType) |
MapDeepCopier(PType<T> ptype) |
TupleDeepCopier(Class<T> tupleClass,
PType... elementTypes) |
Modifier and Type | Class and Description |
---|---|
class |
AvroType<T>
The implementation of the PType interface for Avro-based serialization.
|
Modifier and Type | Method and Description |
---|---|
<T> PType<T> |
AvroTypeFamily.as(PType<T> ptype) |
PType<Boolean> |
AvroTypeFamily.booleans() |
PType<ByteBuffer> |
AvroTypeFamily.bytes() |
<T> PType<Collection<T>> |
AvroTypeFamily.collections(PType<T> ptype) |
<T> PType<T> |
AvroTypeFamily.containers(Class<T> clazz) |
<S,T> PType<T> |
AvroTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
PType<Double> |
AvroTypeFamily.doubles() |
PType<Float> |
AvroTypeFamily.floats() |
PType<org.apache.avro.generic.GenericData.Record> |
AvroTypeFamily.generics(org.apache.avro.Schema schema) |
static <T> PType<T> |
Avros.getPrimitiveType(Class<T> clazz) |
PType<Integer> |
AvroTypeFamily.ints() |
static <T> PType<T> |
Avros.jsons(Class<T> clazz) |
PType<Long> |
AvroTypeFamily.longs() |
<T> PType<Map<String,T>> |
AvroTypeFamily.maps(PType<T> ptype) |
PType<Void> |
AvroTypeFamily.nulls() |
<V1,V2> PType<Pair<V1,V2>> |
AvroTypeFamily.pairs(PType<V1> p1,
PType<V2> p2) |
<V1,V2,V3,V4> |
AvroTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<T> PType<T> |
AvroTypeFamily.records(Class<T> clazz) |
PType<String> |
AvroTypeFamily.strings() |
<V1,V2,V3> PType<Tuple3<V1,V2,V3>> |
AvroTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
<T extends Tuple> |
AvroTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes) |
PType<TupleN> |
AvroTypeFamily.tuples(PType<?>... ptypes) |
Modifier and Type | Method and Description |
---|---|
List<PType> |
AvroType.getSubTypes() |
Modifier and Type | Method and Description |
---|---|
<T> PType<T> |
AvroTypeFamily.as(PType<T> ptype) |
static <T> AvroType<Collection<T>> |
Avros.collections(PType<T> ptype) |
<T> PType<Collection<T>> |
AvroTypeFamily.collections(PType<T> ptype) |
static <S,T> AvroType<T> |
Avros.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
<S,T> PType<T> |
AvroTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
static <T> AvroType<Map<String,T>> |
Avros.maps(PType<T> ptype) |
<T> PType<Map<String,T>> |
AvroTypeFamily.maps(PType<T> ptype) |
static <V1,V2> AvroType<Pair<V1,V2>> |
Avros.pairs(PType<V1> p1,
PType<V2> p2) |
static <V1,V2> AvroType<Pair<V1,V2>> |
Avros.pairs(PType<V1> p1,
PType<V2> p2) |
<V1,V2> PType<Pair<V1,V2>> |
AvroTypeFamily.pairs(PType<V1> p1,
PType<V2> p2) |
<V1,V2> PType<Pair<V1,V2>> |
AvroTypeFamily.pairs(PType<V1> p1,
PType<V2> p2) |
static <V1,V2,V3,V4> |
Avros.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
static <V1,V2,V3,V4> |
Avros.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
static <V1,V2,V3,V4> |
Avros.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
static <V1,V2,V3,V4> |
Avros.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<V1,V2,V3,V4> |
AvroTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<V1,V2,V3,V4> |
AvroTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<V1,V2,V3,V4> |
AvroTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<V1,V2,V3,V4> |
AvroTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
static <K,V> org.apache.crunch.types.avro.AvroTableType<K,V> |
Avros.tableOf(PType<K> key,
PType<V> value) |
static <K,V> org.apache.crunch.types.avro.AvroTableType<K,V> |
Avros.tableOf(PType<K> key,
PType<V> value) |
<K,V> PTableType<K,V> |
AvroTypeFamily.tableOf(PType<K> key,
PType<V> value) |
<K,V> PTableType<K,V> |
AvroTypeFamily.tableOf(PType<K> key,
PType<V> value) |
static <V1,V2,V3> AvroType<Tuple3<V1,V2,V3>> |
Avros.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
static <V1,V2,V3> AvroType<Tuple3<V1,V2,V3>> |
Avros.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
static <V1,V2,V3> AvroType<Tuple3<V1,V2,V3>> |
Avros.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
<V1,V2,V3> PType<Tuple3<V1,V2,V3>> |
AvroTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
<V1,V2,V3> PType<Tuple3<V1,V2,V3>> |
AvroTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
<V1,V2,V3> PType<Tuple3<V1,V2,V3>> |
AvroTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
static <T extends Tuple> |
Avros.tuples(Class<T> clazz,
PType... ptypes) |
<T extends Tuple> |
AvroTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes) |
static AvroType<TupleN> |
Avros.tuples(PType... ptypes) |
PType<TupleN> |
AvroTypeFamily.tuples(PType<?>... ptypes) |
Constructor and Description |
---|
AvroType(Class<T> typeClass,
org.apache.avro.Schema schema,
DeepCopier<T> deepCopier,
PType... ptypes) |
AvroType(Class<T> typeClass,
org.apache.avro.Schema schema,
MapFn inputMapFn,
MapFn outputMapFn,
DeepCopier<T> deepCopier,
PType... ptypes) |
Modifier and Type | Class and Description |
---|---|
class |
WritableType<T,W extends org.apache.hadoop.io.Writable> |
Modifier and Type | Method and Description |
---|---|
<T> PType<T> |
WritableTypeFamily.as(PType<T> ptype) |
PType<Boolean> |
WritableTypeFamily.booleans() |
PType<ByteBuffer> |
WritableTypeFamily.bytes() |
<T> PType<Collection<T>> |
WritableTypeFamily.collections(PType<T> ptype) |
static <S,T> PType<T> |
Writables.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
<S,T> PType<T> |
WritableTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
PType<Double> |
WritableTypeFamily.doubles() |
PType<Float> |
WritableTypeFamily.floats() |
static <T> PType<T> |
Writables.getPrimitiveType(Class<T> clazz) |
PType<Integer> |
WritableTypeFamily.ints() |
static <T> PType<T> |
Writables.jsons(Class<T> clazz) |
PType<Long> |
WritableTypeFamily.longs() |
<T> PType<Map<String,T>> |
WritableTypeFamily.maps(PType<T> ptype) |
PType<Void> |
WritableTypeFamily.nulls() |
<V1,V2> PType<Pair<V1,V2>> |
WritableTypeFamily.pairs(PType<V1> p1,
PType<V2> p2) |
<V1,V2,V3,V4> |
WritableTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<T> PType<T> |
WritableTypeFamily.records(Class<T> clazz) |
PType<String> |
WritableTypeFamily.strings() |
<V1,V2,V3> PType<Tuple3<V1,V2,V3>> |
WritableTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
static <T extends Tuple> |
Writables.tuples(Class<T> clazz,
PType... ptypes) |
<T extends Tuple> |
WritableTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes) |
PType<TupleN> |
WritableTypeFamily.tuples(PType<?>... ptypes) |
<W extends org.apache.hadoop.io.Writable> |
WritableTypeFamily.writables(Class<W> clazz) |
Modifier and Type | Method and Description |
---|---|
List<PType> |
WritableType.getSubTypes() |
Modifier and Type | Method and Description |
---|---|
<T> PType<T> |
WritableTypeFamily.as(PType<T> ptype) |
static <T> WritableType<Collection<T>,org.apache.crunch.types.writable.GenericArrayWritable<T>> |
Writables.collections(PType<T> ptype) |
<T> PType<Collection<T>> |
WritableTypeFamily.collections(PType<T> ptype) |
static <S,T> PType<T> |
Writables.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
<S,T> PType<T> |
WritableTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base) |
static <T> WritableType<Map<String,T>,org.apache.hadoop.io.MapWritable> |
Writables.maps(PType<T> ptype) |
<T> PType<Map<String,T>> |
WritableTypeFamily.maps(PType<T> ptype) |
static <V1,V2> WritableType<Pair<V1,V2>,TupleWritable> |
Writables.pairs(PType<V1> p1,
PType<V2> p2) |
static <V1,V2> WritableType<Pair<V1,V2>,TupleWritable> |
Writables.pairs(PType<V1> p1,
PType<V2> p2) |
<V1,V2> PType<Pair<V1,V2>> |
WritableTypeFamily.pairs(PType<V1> p1,
PType<V2> p2) |
<V1,V2> PType<Pair<V1,V2>> |
WritableTypeFamily.pairs(PType<V1> p1,
PType<V2> p2) |
static <V1,V2,V3,V4> |
Writables.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
static <V1,V2,V3,V4> |
Writables.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
static <V1,V2,V3,V4> |
Writables.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
static <V1,V2,V3,V4> |
Writables.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<V1,V2,V3,V4> |
WritableTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<V1,V2,V3,V4> |
WritableTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<V1,V2,V3,V4> |
WritableTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
<V1,V2,V3,V4> |
WritableTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4) |
static <K,V> org.apache.crunch.types.writable.WritableTableType<K,V> |
Writables.tableOf(PType<K> key,
PType<V> value) |
static <K,V> org.apache.crunch.types.writable.WritableTableType<K,V> |
Writables.tableOf(PType<K> key,
PType<V> value) |
<K,V> PTableType<K,V> |
WritableTypeFamily.tableOf(PType<K> key,
PType<V> value) |
<K,V> PTableType<K,V> |
WritableTypeFamily.tableOf(PType<K> key,
PType<V> value) |
static <V1,V2,V3> WritableType<Tuple3<V1,V2,V3>,TupleWritable> |
Writables.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
static <V1,V2,V3> WritableType<Tuple3<V1,V2,V3>,TupleWritable> |
Writables.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
static <V1,V2,V3> WritableType<Tuple3<V1,V2,V3>,TupleWritable> |
Writables.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
<V1,V2,V3> PType<Tuple3<V1,V2,V3>> |
WritableTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
<V1,V2,V3> PType<Tuple3<V1,V2,V3>> |
WritableTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
<V1,V2,V3> PType<Tuple3<V1,V2,V3>> |
WritableTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3) |
static <T extends Tuple> |
Writables.tuples(Class<T> clazz,
PType... ptypes) |
<T extends Tuple> |
WritableTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes) |
static WritableType<TupleN,TupleWritable> |
Writables.tuples(PType... ptypes) |
PType<TupleN> |
WritableTypeFamily.tuples(PType<?>... ptypes) |
Constructor and Description |
---|
WritableType(Class<T> typeClass,
Class<W> writableClass,
MapFn<W,T> inputDoFn,
MapFn<T,W> outputDoFn,
PType... subTypes) |
Copyright © 2013 The Apache Software Foundation. All Rights Reserved.