|
|||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use PType | |
---|---|
org.apache.crunch | Client-facing API and core abstractions. |
org.apache.crunch.contrib.text | |
org.apache.crunch.fn | Commonly used functions for manipulating collections. |
org.apache.crunch.impl.dist | |
org.apache.crunch.impl.dist.collect | |
org.apache.crunch.impl.mem | In-memory Pipeline implementation for rapid prototyping and testing. |
org.apache.crunch.impl.spark | |
org.apache.crunch.impl.spark.collect | |
org.apache.crunch.io | Data input and output for Pipelines. |
org.apache.crunch.lib | Joining, sorting, aggregating, and other commonly used functionality. |
org.apache.crunch.lib.join | Inner and outer joins on collections. |
org.apache.crunch.lib.sort | |
org.apache.crunch.types | Common functionality for business object serialization. |
org.apache.crunch.types.avro | Business object serialization using Apache Avro. |
org.apache.crunch.types.orc | |
org.apache.crunch.types.writable | Business object serialization using Hadoop's Writables framework. |
Uses of PType in org.apache.crunch |
---|
Methods in org.apache.crunch that return PType | ||
---|---|---|
static
|
Tuple3.Collect.derived(PType<V1> first,
PType<V2> second,
PType<V3> third)
|
|
static
|
Tuple4.Collect.derived(PType<V1> first,
PType<V2> second,
PType<V3> third,
PType<V4> fourth)
|
|
PType<K> |
PTable.getKeyType()
Returns the PType of the key. |
|
PType<S> |
PCollection.getPType()
Returns the PType of this PCollection . |
|
PType<T> |
Source.getType()
Returns the PType for this source. |
|
PType<V> |
PTable.getValueType()
Returns the PType of the value. |
Methods in org.apache.crunch with parameters of type PType | ||
---|---|---|
boolean |
Target.accept(OutputHandler handler,
PType<?> ptype)
Checks to see if this Target instance is compatible with the
given PType . |
|
|
Target.asSourceTarget(PType<T> ptype)
Attempt to create the SourceTarget type that corresponds to this Target
for the given PType , if possible. |
|
|
PCollection.by(MapFn<S,K> extractKeyFn,
PType<K> keyType)
Apply the given map function to each element of this instance in order to create a PTable . |
|
|
PCollection.by(String name,
MapFn<S,K> extractKeyFn,
PType<K> keyType)
Apply the given map function to each element of this instance in order to create a PTable . |
|
static
|
Tuple3.Collect.derived(PType<V1> first,
PType<V2> second,
PType<V3> third)
|
|
static
|
Tuple3.Collect.derived(PType<V1> first,
PType<V2> second,
PType<V3> third)
|
|
static
|
Tuple3.Collect.derived(PType<V1> first,
PType<V2> second,
PType<V3> third)
|
|
static
|
Tuple4.Collect.derived(PType<V1> first,
PType<V2> second,
PType<V3> third,
PType<V4> fourth)
|
|
static
|
Tuple4.Collect.derived(PType<V1> first,
PType<V2> second,
PType<V3> third,
PType<V4> fourth)
|
|
static
|
Tuple4.Collect.derived(PType<V1> first,
PType<V2> second,
PType<V3> third,
PType<V4> fourth)
|
|
static
|
Tuple4.Collect.derived(PType<V1> first,
PType<V2> second,
PType<V3> third,
PType<V4> fourth)
|
|
|
Pipeline.emptyPCollection(PType<T> ptype)
Creates an empty PCollection of the given PType . |
|
Converter<?,?,?,?> |
Target.getConverter(PType<?> ptype)
Returns the Converter to use for mapping from the output PCollection
into the output values expected by this instance. |
|
|
PTable.mapKeys(MapFn<K,K2> mapFn,
PType<K2> ptype)
Returns a PTable that has the same values as this instance, but
uses the given function to map the keys. |
|
|
PTable.mapKeys(String name,
MapFn<K,K2> mapFn,
PType<K2> ptype)
Returns a PTable that has the same values as this instance, but
uses the given function to map the keys. |
|
|
PGroupedTable.mapValues(MapFn<Iterable<V>,U> mapFn,
PType<U> ptype)
Maps the Iterable<V> elements of each record to a new type. |
|
|
PTable.mapValues(MapFn<V,U> mapFn,
PType<U> ptype)
Returns a PTable that has the same keys as this instance, but
uses the given function to map the values. |
|
|
PGroupedTable.mapValues(String name,
MapFn<Iterable<V>,U> mapFn,
PType<U> ptype)
Maps the Iterable<V> elements of each record to a new type. |
|
|
PTable.mapValues(String name,
MapFn<V,U> mapFn,
PType<U> ptype)
Returns a PTable that has the same keys as this instance, but
uses the given function to map the values. |
|
|
PCollection.parallelDo(DoFn<S,T> doFn,
PType<T> type)
Applies the given doFn to the elements of this PCollection and
returns a new PCollection that is the output of this processing. |
|
|
PCollection.parallelDo(String name,
DoFn<S,T> doFn,
PType<T> type)
Applies the given doFn to the elements of this PCollection and
returns a new PCollection that is the output of this processing. |
|
|
PCollection.parallelDo(String name,
DoFn<S,T> doFn,
PType<T> type,
ParallelDoOptions options)
Applies the given doFn to the elements of this PCollection and
returns a new PCollection that is the output of this processing. |
Uses of PType in org.apache.crunch.contrib.text |
---|
Methods in org.apache.crunch.contrib.text that return PType | |
---|---|
PType<T> |
Extractor.getPType(PTypeFamily ptf)
Returns the PType associated with this data type for the
given PTypeFamily . |
Uses of PType in org.apache.crunch.fn |
---|
Methods in org.apache.crunch.fn that return PType | ||
---|---|---|
static
|
SwapFn.ptype(PType<Pair<V1,V2>> pt)
|
Methods in org.apache.crunch.fn with parameters of type PType | ||
---|---|---|
static
|
SwapFn.ptype(PType<Pair<V1,V2>> pt)
|
Uses of PType in org.apache.crunch.impl.dist |
---|
Methods in org.apache.crunch.impl.dist with parameters of type PType | ||
---|---|---|
|
DistributedPipeline.createIntermediateOutput(PType<T> ptype)
|
|
|
DistributedPipeline.emptyPCollection(PType<S> ptype)
|
Uses of PType in org.apache.crunch.impl.dist.collect |
---|
Methods in org.apache.crunch.impl.dist.collect that return PType | |
---|---|
PType<K> |
PTableBase.getKeyType()
|
PType<Pair<K,V>> |
EmptyPTable.getPType()
|
PType<T> |
EmptyPCollection.getPType()
|
PType<Pair<K,V>> |
BaseUnionTable.getPType()
|
PType<S> |
BaseUnionCollection.getPType()
|
PType<Pair<K,V>> |
BaseInputTable.getPType()
|
PType<S> |
BaseInputCollection.getPType()
|
PType<Pair<K,Iterable<V>>> |
BaseGroupedTable.getPType()
|
PType<Pair<K,V>> |
BaseDoTable.getPType()
|
PType<S> |
BaseDoCollection.getPType()
|
PType<V> |
PTableBase.getValueType()
|
Methods in org.apache.crunch.impl.dist.collect with parameters of type PType | ||
---|---|---|
|
PCollectionImpl.by(MapFn<S,K> mapFn,
PType<K> keyType)
|
|
|
PCollectionImpl.by(String name,
MapFn<S,K> mapFn,
PType<K> keyType)
|
|
|
PCollectionFactory.createDoCollection(String name,
PCollectionImpl<S> chainingCollection,
DoFn<S,T> fn,
PType<T> type,
ParallelDoOptions options)
|
|
|
PTableBase.mapKeys(MapFn<K,K2> mapFn,
PType<K2> ptype)
|
|
|
PTableBase.mapKeys(String name,
MapFn<K,K2> mapFn,
PType<K2> ptype)
|
|
|
BaseGroupedTable.mapValues(MapFn<Iterable<V>,U> mapFn,
PType<U> ptype)
|
|
|
PTableBase.mapValues(MapFn<V,U> mapFn,
PType<U> ptype)
|
|
|
BaseGroupedTable.mapValues(String name,
MapFn<Iterable<V>,U> mapFn,
PType<U> ptype)
|
|
|
PTableBase.mapValues(String name,
MapFn<V,U> mapFn,
PType<U> ptype)
|
|
|
PCollectionImpl.parallelDo(DoFn<S,T> fn,
PType<T> type)
|
|
|
PCollectionImpl.parallelDo(String name,
DoFn<S,T> fn,
PType<T> type)
|
|
|
PCollectionImpl.parallelDo(String name,
DoFn<S,T> fn,
PType<T> type,
ParallelDoOptions options)
|
Constructors in org.apache.crunch.impl.dist.collect with parameters of type PType | |
---|---|
EmptyPCollection(DistributedPipeline pipeline,
PType<T> ptype)
|
Uses of PType in org.apache.crunch.impl.mem |
---|
Methods in org.apache.crunch.impl.mem with parameters of type PType | ||
---|---|---|
|
MemPipeline.emptyPCollection(PType<T> ptype)
|
|
static
|
MemPipeline.typedCollectionOf(PType<T> ptype,
Iterable<T> collect)
|
|
static
|
MemPipeline.typedCollectionOf(PType<T> ptype,
T... ts)
|
Uses of PType in org.apache.crunch.impl.spark |
---|
Methods in org.apache.crunch.impl.spark with parameters of type PType | ||
---|---|---|
|
SparkPipeline.emptyPCollection(PType<S> ptype)
|
Uses of PType in org.apache.crunch.impl.spark.collect |
---|
Methods in org.apache.crunch.impl.spark.collect with parameters of type PType | ||
---|---|---|
|
SparkCollectFactory.createDoCollection(String name,
PCollectionImpl<S> parent,
DoFn<S,T> fn,
PType<T> type,
ParallelDoOptions options)
|
Constructors in org.apache.crunch.impl.spark.collect with parameters of type PType | |
---|---|
EmptyPCollection(DistributedPipeline pipeline,
PType<T> ptype)
|
Uses of PType in org.apache.crunch.io |
---|
Methods in org.apache.crunch.io with parameters of type PType | ||
---|---|---|
static
|
From.avroFile(List<org.apache.hadoop.fs.Path> paths,
PType<T> ptype)
Creates a Source<T> instance from the Avro file(s) at the given Path s. |
|
static
|
From.avroFile(org.apache.hadoop.fs.Path path,
PType<T> ptype)
Creates a Source<T> instance from the Avro file(s) at the given Path . |
|
static
|
At.avroFile(org.apache.hadoop.fs.Path path,
PType<T> ptype)
Creates a SourceTarget<T> instance from the Avro file(s) at the given Path . |
|
static
|
From.avroFile(String pathName,
PType<T> ptype)
Creates a Source<T> instance from the Avro file(s) at the given path name. |
|
static
|
At.avroFile(String pathName,
PType<T> ptype)
Creates a SourceTarget<T> instance from the Avro file(s) at the given path name. |
|
boolean |
OutputHandler.configure(Target target,
PType<?> ptype)
|
|
void |
MapReduceTarget.configureForMapReduce(org.apache.hadoop.mapreduce.Job job,
PType<?> ptype,
org.apache.hadoop.fs.Path outputPath,
String name)
|
|
static
|
From.formattedFile(List<org.apache.hadoop.fs.Path> paths,
Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<?,?>> formatClass,
PType<K> keyType,
PType<V> valueType)
Creates a TableSource<K, V> for reading data from files that have custom
FileInputFormat implementations not covered by the provided TableSource
and Source factory methods. |
|
static
|
From.formattedFile(List<org.apache.hadoop.fs.Path> paths,
Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<?,?>> formatClass,
PType<K> keyType,
PType<V> valueType)
Creates a TableSource<K, V> for reading data from files that have custom
FileInputFormat implementations not covered by the provided TableSource
and Source factory methods. |
|
static
|
From.formattedFile(org.apache.hadoop.fs.Path path,
Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<?,?>> formatClass,
PType<K> keyType,
PType<V> valueType)
Creates a TableSource<K, V> for reading data from files that have custom
FileInputFormat implementations not covered by the provided TableSource
and Source factory methods. |
|
static
|
From.formattedFile(org.apache.hadoop.fs.Path path,
Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<?,?>> formatClass,
PType<K> keyType,
PType<V> valueType)
Creates a TableSource<K, V> for reading data from files that have custom
FileInputFormat implementations not covered by the provided TableSource
and Source factory methods. |
|
static
|
From.formattedFile(String pathName,
Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<?,?>> formatClass,
PType<K> keyType,
PType<V> valueType)
Creates a TableSource<K, V> for reading data from files that have custom
FileInputFormat implementations not covered by the provided TableSource
and Source factory methods. |
|
static
|
From.formattedFile(String pathName,
Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<?,?>> formatClass,
PType<K> keyType,
PType<V> valueType)
Creates a TableSource<K, V> for reading data from files that have custom
FileInputFormat implementations not covered by the provided TableSource
and Source factory methods. |
|
static
|
From.sequenceFile(List<org.apache.hadoop.fs.Path> paths,
PType<K> keyType,
PType<V> valueType)
Creates a TableSource<K, V> instance for the SequenceFile(s) at the given Path s. |
|
static
|
From.sequenceFile(List<org.apache.hadoop.fs.Path> paths,
PType<K> keyType,
PType<V> valueType)
Creates a TableSource<K, V> instance for the SequenceFile(s) at the given Path s. |
|
static
|
From.sequenceFile(List<org.apache.hadoop.fs.Path> paths,
PType<T> ptype)
Creates a Source<T> instance from the SequenceFile(s) at the given Path s
from the value field of each key-value pair in the SequenceFile(s). |
|
static
|
From.sequenceFile(org.apache.hadoop.fs.Path path,
PType<K> keyType,
PType<V> valueType)
Creates a TableSource<K, V> instance for the SequenceFile(s) at the given Path . |
|
static
|
From.sequenceFile(org.apache.hadoop.fs.Path path,
PType<K> keyType,
PType<V> valueType)
Creates a TableSource<K, V> instance for the SequenceFile(s) at the given Path . |
|
static
|
At.sequenceFile(org.apache.hadoop.fs.Path path,
PType<K> keyType,
PType<V> valueType)
Creates a TableSourceTarget<K, V> instance from the SequenceFile(s) at the given Path
from the key-value pairs in the SequenceFile(s). |
|
static
|
At.sequenceFile(org.apache.hadoop.fs.Path path,
PType<K> keyType,
PType<V> valueType)
Creates a TableSourceTarget<K, V> instance from the SequenceFile(s) at the given Path
from the key-value pairs in the SequenceFile(s). |
|
static
|
From.sequenceFile(org.apache.hadoop.fs.Path path,
PType<T> ptype)
Creates a Source<T> instance from the SequenceFile(s) at the given Path
from the value field of each key-value pair in the SequenceFile(s). |
|
static
|
At.sequenceFile(org.apache.hadoop.fs.Path path,
PType<T> ptype)
Creates a SourceTarget<T> instance from the SequenceFile(s) at the given Path
from the value field of each key-value pair in the SequenceFile(s). |
|
static
|
From.sequenceFile(String pathName,
PType<K> keyType,
PType<V> valueType)
Creates a TableSource<K, V> instance for the SequenceFile(s) at the given path name. |
|
static
|
From.sequenceFile(String pathName,
PType<K> keyType,
PType<V> valueType)
Creates a TableSource<K, V> instance for the SequenceFile(s) at the given path name. |
|
static
|
At.sequenceFile(String pathName,
PType<K> keyType,
PType<V> valueType)
Creates a TableSourceTarget<K, V> instance from the SequenceFile(s) at the given path name
from the key-value pairs in the SequenceFile(s). |
|
static
|
At.sequenceFile(String pathName,
PType<K> keyType,
PType<V> valueType)
Creates a TableSourceTarget<K, V> instance from the SequenceFile(s) at the given path name
from the key-value pairs in the SequenceFile(s). |
|
static
|
From.sequenceFile(String pathName,
PType<T> ptype)
Creates a Source<T> instance from the SequenceFile(s) at the given path name
from the value field of each key-value pair in the SequenceFile(s). |
|
static
|
At.sequenceFile(String pathName,
PType<T> ptype)
Creates a SourceTarget<T> instance from the SequenceFile(s) at the given path name
from the value field of each key-value pair in the SequenceFile(s). |
|
static
|
From.textFile(List<org.apache.hadoop.fs.Path> paths,
PType<T> ptype)
Creates a Source<T> instance for the text file(s) at the given Path s using
the provided PType<T> to convert the input text. |
|
static
|
From.textFile(org.apache.hadoop.fs.Path path,
PType<T> ptype)
Creates a Source<T> instance for the text file(s) at the given Path using
the provided PType<T> to convert the input text. |
|
static
|
At.textFile(org.apache.hadoop.fs.Path path,
PType<T> ptype)
Creates a SourceTarget<T> instance for the text file(s) at the given Path using
the provided PType<T> to convert the input text. |
|
static
|
From.textFile(String pathName,
PType<T> ptype)
Creates a Source<T> instance for the text file(s) at the given path name using
the provided PType<T> to convert the input text. |
|
static
|
At.textFile(String pathName,
PType<T> ptype)
Creates a SourceTarget<T> instance for the text file(s) at the given path name using
the provided PType<T> to convert the input text. |
Uses of PType in org.apache.crunch.lib |
---|
Methods in org.apache.crunch.lib with parameters of type PType | ||
---|---|---|
static
|
PTables.mapKeys(PTable<K1,V> ptable,
MapFn<K1,K2> mapFn,
PType<K2> ptype)
Maps a PTable<K1, V> to a PTable<K2, V> using the given MapFn<K1, K2> on
the keys of the PTable . |
|
static
|
PTables.mapKeys(String name,
PTable<K1,V> ptable,
MapFn<K1,K2> mapFn,
PType<K2> ptype)
Maps a PTable<K1, V> to a PTable<K2, V> using the given MapFn<K1, K2> on
the keys of the PTable . |
|
static
|
PTables.mapValues(PGroupedTable<K,U> ptable,
MapFn<Iterable<U>,V> mapFn,
PType<V> ptype)
An analogue of the mapValues function for PGroupedTable<K, U> collections. |
|
static
|
PTables.mapValues(PTable<K,U> ptable,
MapFn<U,V> mapFn,
PType<V> ptype)
Maps a PTable<K, U> to a PTable<K, V> using the given MapFn<U, V> on
the values of the PTable . |
|
static
|
PTables.mapValues(String name,
PGroupedTable<K,U> ptable,
MapFn<Iterable<U>,V> mapFn,
PType<V> ptype)
An analogue of the mapValues function for PGroupedTable<K, U> collections. |
|
static
|
PTables.mapValues(String name,
PTable<K,U> ptable,
MapFn<U,V> mapFn,
PType<V> ptype)
Maps a PTable<K, U> to a PTable<K, V> using the given MapFn<U, V> on
the values of the PTable . |
|
static
|
SecondarySort.sortAndApply(PTable<K,Pair<V1,V2>> input,
DoFn<Pair<K,Iterable<Pair<V1,V2>>>,T> doFn,
PType<T> ptype)
Perform a secondary sort on the given PTable instance and then apply a
DoFn to the resulting sorted data to yield an output PCollection<T> . |
|
static
|
SecondarySort.sortAndApply(PTable<K,Pair<V1,V2>> input,
DoFn<Pair<K,Iterable<Pair<V1,V2>>>,T> doFn,
PType<T> ptype,
int numReducers)
Perform a secondary sort on the given PTable instance and then apply a
DoFn to the resulting sorted data to yield an output PCollection<T> , using
the given number of reducers. |
|
static
|
Channels.split(PCollection<Pair<T,U>> pCollection,
PType<T> firstPType,
PType<U> secondPType)
Splits a PCollection of any Pair of objects into a Pair of
PCollection}, to allow for the output of a DoFn to be handled using
separate channels. |
|
static
|
Channels.split(PCollection<Pair<T,U>> pCollection,
PType<T> firstPType,
PType<U> secondPType)
Splits a PCollection of any Pair of objects into a Pair of
PCollection}, to allow for the output of a DoFn to be handled using
separate channels. |
Constructors in org.apache.crunch.lib with parameters of type PType | |
---|---|
Aggregate.TopKCombineFn(int limit,
boolean maximize,
PType<Pair<K,V>> pairType)
|
|
Aggregate.TopKFn(int limit,
boolean ascending,
PType<Pair<K,V>> pairType)
|
Uses of PType in org.apache.crunch.lib.join |
---|
Methods in org.apache.crunch.lib.join with parameters of type PType | ||
---|---|---|
static
|
OneToManyJoin.oneToManyJoin(PTable<K,U> left,
PTable<K,V> right,
DoFn<Pair<U,Iterable<V>>,T> postProcessFn,
PType<T> ptype)
Performs a join on two tables, where the left table only contains a single value per key. |
|
static
|
OneToManyJoin.oneToManyJoin(PTable<K,U> left,
PTable<K,V> right,
DoFn<Pair<U,Iterable<V>>,T> postProcessFn,
PType<T> ptype,
int numReducers)
Supports a user-specified number of reducers for the one-to-many join. |
Constructors in org.apache.crunch.lib.join with parameters of type PType | |
---|---|
FullOuterJoinFn(PType<K> keyType,
PType<U> leftValueType)
|
|
FullOuterJoinFn(PType<K> keyType,
PType<U> leftValueType)
|
|
InnerJoinFn(PType<K> keyType,
PType<U> leftValueType)
|
|
InnerJoinFn(PType<K> keyType,
PType<U> leftValueType)
|
|
JoinFn(PType<K> keyType,
PType<U> leftValueType)
Instantiate with the PType of the value of the left side of the join (used for creating deep copies of values). |
|
JoinFn(PType<K> keyType,
PType<U> leftValueType)
Instantiate with the PType of the value of the left side of the join (used for creating deep copies of values). |
|
LeftOuterJoinFn(PType<K> keyType,
PType<U> leftValueType)
|
|
LeftOuterJoinFn(PType<K> keyType,
PType<U> leftValueType)
|
|
RightOuterJoinFn(PType<K> keyType,
PType<U> leftValueType)
|
|
RightOuterJoinFn(PType<K> keyType,
PType<U> leftValueType)
|
Uses of PType in org.apache.crunch.lib.sort |
---|
Methods in org.apache.crunch.lib.sort that return PType | |
---|---|
PType<Object> |
SortFns.KeyExtraction.getKeyType()
|
Methods in org.apache.crunch.lib.sort with parameters of type PType | ||
---|---|---|
static
|
SortFns.createOrderedTupleSchema(PType<S> ptype,
Sort.ColumnOrder[] orders)
Constructs an Avro schema for the given PType<S> that respects the given column
orderings. |
Constructors in org.apache.crunch.lib.sort with parameters of type PType | |
---|---|
SortFns.KeyExtraction(PType<V> ptype,
Sort.ColumnOrder[] columnOrder)
|
Uses of PType in org.apache.crunch.types |
---|
Subinterfaces of PType in org.apache.crunch.types | |
---|---|
interface |
PTableType<K,V>
An extension of PType specifically for PTable objects. |
Classes in org.apache.crunch.types that implement PType | |
---|---|
class |
PGroupedTableType<K,V>
The PType instance for PGroupedTable instances. |
Methods in org.apache.crunch.types that return PType | ||
---|---|---|
|
PTypeFamily.as(PType<T> ptype)
Returns the equivalent of the given ptype for this family, if it exists. |
|
static PType<BigInteger> |
PTypes.bigInt(PTypeFamily typeFamily)
A PType for Java's BigInteger type. |
|
PType<Boolean> |
PTypeFamily.booleans()
|
|
PType<ByteBuffer> |
PTypeFamily.bytes()
|
|
|
PTypeFamily.collections(PType<T> ptype)
|
|
static
|
PTypeUtils.convert(PType<T> ptype,
PTypeFamily tf)
|
|
|
PTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
|
PTypeFamily.derivedImmutable(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
A derived type whose values are immutable. |
|
PType<Double> |
PTypeFamily.doubles()
|
|
static
|
PTypes.enums(Class<T> type,
PTypeFamily typeFamily)
Constructs a PType for a Java Enum type. |
|
PType<Float> |
PTypeFamily.floats()
|
|
PType<K> |
PTableType.getKeyType()
Returns the key type for the table. |
|
PType<V> |
PTableType.getValueType()
Returns the value type for the table. |
|
PType<Integer> |
PTypeFamily.ints()
|
|
static
|
PTypes.jsonString(Class<T> clazz,
PTypeFamily typeFamily)
Constructs a PType for reading a Java type from a JSON string using Jackson's ObjectMapper . |
|
PType<Long> |
PTypeFamily.longs()
|
|
|
PTypeFamily.maps(PType<T> ptype)
|
|
PType<Void> |
PTypeFamily.nulls()
|
|
|
PTypeFamily.pairs(PType<V1> p1,
PType<V2> p2)
|
|
static
|
PTypes.protos(Class<T> clazz,
PTypeFamily typeFamily)
Constructs a PType for the given protocol buffer. |
|
static
|
PTypes.protos(Class<T> clazz,
PTypeFamily typeFamily,
SerializableSupplier<com.google.protobuf.ExtensionRegistry> supplier)
Constructs a PType for a protocol buffer, using the given SerializableSupplier to provide
an ExtensionRegistry to use in reading the given protobuf. |
|
|
PTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
PTypeFamily.records(Class<T> clazz)
|
|
PType<String> |
PTypeFamily.strings()
|
|
static
|
PTypes.thrifts(Class<T> clazz,
PTypeFamily typeFamily)
Constructs a PType for a Thrift record. |
|
|
PTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
|
PTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes)
|
|
PType<TupleN> |
PTypeFamily.tuples(PType<?>... ptypes)
|
|
PType<Union> |
PTypeFamily.unionOf(PType<?>... ptypes)
|
|
static PType<UUID> |
PTypes.uuid(PTypeFamily ptf)
A PType for Java's UUID type. |
Methods in org.apache.crunch.types that return types with arguments of type PType | |
---|---|
List<PType> |
PType.getSubTypes()
Returns the sub-types that make up this PType if it is a composite instance, such as a tuple. |
List<PType> |
PGroupedTableType.getSubTypes()
|
Methods in org.apache.crunch.types with parameters of type PType | ||
---|---|---|
|
PTypeFamily.as(PType<T> ptype)
Returns the equivalent of the given ptype for this family, if it exists. |
|
|
PTypeFamily.collections(PType<T> ptype)
|
|
static
|
PTypeUtils.convert(PType<T> ptype,
PTypeFamily tf)
|
|
|
PTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
|
PTypeFamily.derivedImmutable(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
A derived type whose values are immutable. |
|
|
PTypeFamily.maps(PType<T> ptype)
|
|
|
PTypeFamily.pairs(PType<V1> p1,
PType<V2> p2)
|
|
|
PTypeFamily.pairs(PType<V1> p1,
PType<V2> p2)
|
|
|
PTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
PTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
PTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
PTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
PTypeFamily.tableOf(PType<K> key,
PType<V> value)
|
|
|
PTypeFamily.tableOf(PType<K> key,
PType<V> value)
|
|
|
PTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
|
PTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
|
PTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
|
PTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes)
|
|
PType<TupleN> |
PTypeFamily.tuples(PType<?>... ptypes)
|
|
PType<Union> |
PTypeFamily.unionOf(PType<?>... ptypes)
|
Constructors in org.apache.crunch.types with parameters of type PType | |
---|---|
CollectionDeepCopier(PType<T> elementType)
|
|
MapDeepCopier(PType<T> ptype)
|
|
TupleDeepCopier(Class<T> tupleClass,
PType... elementTypes)
|
|
UnionDeepCopier(PType... elementTypes)
|
Uses of PType in org.apache.crunch.types.avro |
---|
Classes in org.apache.crunch.types.avro that implement PType | |
---|---|
class |
AvroType<T>
The implementation of the PType interface for Avro-based serialization. |
Methods in org.apache.crunch.types.avro that return PType | ||
---|---|---|
|
AvroTypeFamily.as(PType<T> ptype)
|
|
PType<Boolean> |
AvroTypeFamily.booleans()
|
|
PType<ByteBuffer> |
AvroTypeFamily.bytes()
|
|
|
AvroTypeFamily.collections(PType<T> ptype)
|
|
|
AvroTypeFamily.containers(Class<T> clazz)
|
|
|
AvroTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
|
AvroTypeFamily.derivedImmutable(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
PType<Double> |
AvroTypeFamily.doubles()
|
|
PType<Float> |
AvroTypeFamily.floats()
|
|
PType<org.apache.avro.generic.GenericData.Record> |
AvroTypeFamily.generics(org.apache.avro.Schema schema)
|
|
static
|
Avros.getPrimitiveType(Class<T> clazz)
|
|
PType<Integer> |
AvroTypeFamily.ints()
|
|
static
|
Avros.jsons(Class<T> clazz)
|
|
PType<Long> |
AvroTypeFamily.longs()
|
|
|
AvroTypeFamily.maps(PType<T> ptype)
|
|
PType<Void> |
AvroTypeFamily.nulls()
|
|
|
AvroTypeFamily.pairs(PType<V1> p1,
PType<V2> p2)
|
|
|
AvroTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
AvroTypeFamily.records(Class<T> clazz)
|
|
PType<String> |
AvroTypeFamily.strings()
|
|
|
AvroTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
|
AvroTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes)
|
|
PType<TupleN> |
AvroTypeFamily.tuples(PType<?>... ptypes)
|
|
static PType<Union> |
Avros.unionOf(PType<?>... ptypes)
|
|
PType<Union> |
AvroTypeFamily.unionOf(PType<?>... ptypes)
|
Methods in org.apache.crunch.types.avro that return types with arguments of type PType | |
---|---|
List<PType> |
AvroType.getSubTypes()
|
Methods in org.apache.crunch.types.avro with parameters of type PType | ||
---|---|---|
|
AvroTypeFamily.as(PType<T> ptype)
|
|
static
|
Avros.collections(PType<T> ptype)
|
|
|
AvroTypeFamily.collections(PType<T> ptype)
|
|
static
|
Avros.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
|
AvroTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
static
|
Avros.derivedImmutable(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
|
AvroTypeFamily.derivedImmutable(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
static
|
Avros.keyValueTableOf(PType<K> key,
PType<V> value)
A table type with an Avro type as key and value. |
|
static
|
Avros.keyValueTableOf(PType<K> key,
PType<V> value)
A table type with an Avro type as key and value. |
|
static
|
Avros.maps(PType<T> ptype)
|
|
|
AvroTypeFamily.maps(PType<T> ptype)
|
|
static AvroType<TupleN> |
Avros.namedTuples(String tupleName,
String[] fieldNames,
PType[] ptypes)
|
|
static
|
Avros.pairs(PType<V1> p1,
PType<V2> p2)
|
|
static
|
Avros.pairs(PType<V1> p1,
PType<V2> p2)
|
|
|
AvroTypeFamily.pairs(PType<V1> p1,
PType<V2> p2)
|
|
|
AvroTypeFamily.pairs(PType<V1> p1,
PType<V2> p2)
|
|
static
|
Avros.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
static
|
Avros.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
static
|
Avros.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
static
|
Avros.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
AvroTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
AvroTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
AvroTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
AvroTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
static
|
Avros.tableOf(PType<K> key,
PType<V> value)
A table type with an Avro type as key and as value. |
|
static
|
Avros.tableOf(PType<K> key,
PType<V> value)
A table type with an Avro type as key and as value. |
|
|
AvroTypeFamily.tableOf(PType<K> key,
PType<V> value)
|
|
|
AvroTypeFamily.tableOf(PType<K> key,
PType<V> value)
|
|
static
|
Avros.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
static
|
Avros.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
static
|
Avros.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
|
AvroTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
|
AvroTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
|
AvroTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
static
|
Avros.tuples(Class<T> clazz,
PType... ptypes)
|
|
|
AvroTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes)
|
|
static AvroType<TupleN> |
Avros.tuples(PType... ptypes)
|
|
PType<TupleN> |
AvroTypeFamily.tuples(PType<?>... ptypes)
|
|
static PType<Union> |
Avros.unionOf(PType<?>... ptypes)
|
|
PType<Union> |
AvroTypeFamily.unionOf(PType<?>... ptypes)
|
Constructors in org.apache.crunch.types.avro with parameters of type PType | |
---|---|
AvroType(Class<T> typeClass,
org.apache.avro.Schema schema,
DeepCopier<T> deepCopier,
PType... ptypes)
|
|
AvroType(Class<T> typeClass,
org.apache.avro.Schema schema,
MapFn inputMapFn,
MapFn outputMapFn,
DeepCopier<T> deepCopier,
AvroType.AvroRecordType recordType,
PType... ptypes)
|
Uses of PType in org.apache.crunch.types.orc |
---|
Methods in org.apache.crunch.types.orc that return PType | ||
---|---|---|
static PType<org.apache.hadoop.hive.ql.io.orc.OrcStruct> |
Orcs.orcs(org.apache.hadoop.hive.serde2.typeinfo.TypeInfo typeInfo)
Create a PType to directly use OrcStruct as the deserialized format. |
|
static
|
Orcs.reflects(Class<T> clazz)
Create a PType which uses reflection to serialize/deserialize java POJOs to/from ORC. |
|
static PType<TupleN> |
Orcs.tuples(PType... ptypes)
Create a tuple-based PType. |
Methods in org.apache.crunch.types.orc with parameters of type PType | |
---|---|
static PType<TupleN> |
Orcs.tuples(PType... ptypes)
Create a tuple-based PType. |
Constructors in org.apache.crunch.types.orc with parameters of type PType | |
---|---|
TupleObjectInspector(TupleFactory<T> tupleFactory,
PType... ptypes)
|
Uses of PType in org.apache.crunch.types.writable |
---|
Classes in org.apache.crunch.types.writable that implement PType | |
---|---|
class |
WritableType<T,W extends Writable>
|
Methods in org.apache.crunch.types.writable that return PType | ||
---|---|---|
|
WritableTypeFamily.as(PType<T> ptype)
|
|
PType<Boolean> |
WritableTypeFamily.booleans()
|
|
PType<ByteBuffer> |
WritableTypeFamily.bytes()
|
|
|
WritableTypeFamily.collections(PType<T> ptype)
|
|
static
|
Writables.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
|
WritableTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
static
|
Writables.derivedImmutable(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
|
WritableTypeFamily.derivedImmutable(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
PType<Double> |
WritableTypeFamily.doubles()
|
|
PType<Float> |
WritableTypeFamily.floats()
|
|
static
|
Writables.getPrimitiveType(Class<T> clazz)
|
|
PType<Integer> |
WritableTypeFamily.ints()
|
|
static
|
Writables.jsons(Class<T> clazz)
|
|
PType<Long> |
WritableTypeFamily.longs()
|
|
|
WritableTypeFamily.maps(PType<T> ptype)
|
|
PType<Void> |
WritableTypeFamily.nulls()
|
|
|
WritableTypeFamily.pairs(PType<V1> p1,
PType<V2> p2)
|
|
|
WritableTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
WritableTypeFamily.records(Class<T> clazz)
|
|
PType<String> |
WritableTypeFamily.strings()
|
|
|
WritableTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
static
|
Writables.tuples(Class<T> clazz,
PType... ptypes)
|
|
|
WritableTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes)
|
|
PType<TupleN> |
WritableTypeFamily.tuples(PType<?>... ptypes)
|
|
static PType<Union> |
Writables.unionOf(PType<?>... ptypes)
|
|
PType<Union> |
WritableTypeFamily.unionOf(PType<?>... ptypes)
|
|
|
WritableTypeFamily.writables(Class<W> clazz)
|
Methods in org.apache.crunch.types.writable that return types with arguments of type PType | |
---|---|
List<PType> |
WritableType.getSubTypes()
|
Methods in org.apache.crunch.types.writable with parameters of type PType | ||
---|---|---|
|
WritableTypeFamily.as(PType<T> ptype)
|
|
static
|
Writables.collections(PType<T> ptype)
|
|
|
WritableTypeFamily.collections(PType<T> ptype)
|
|
static
|
Writables.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
|
WritableTypeFamily.derived(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
static
|
Writables.derivedImmutable(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
|
WritableTypeFamily.derivedImmutable(Class<T> clazz,
MapFn<S,T> inputFn,
MapFn<T,S> outputFn,
PType<S> base)
|
|
static
|
WritableType.immutableType(Class<T> typeClass,
Class<W> writableClass,
MapFn<W,T> inputDoFn,
MapFn<T,W> outputDoFn,
PType... subTypes)
Factory method for a new WritableType instance whose type class is immutable. |
|
static
|
Writables.maps(PType<T> ptype)
|
|
|
WritableTypeFamily.maps(PType<T> ptype)
|
|
static
|
Writables.pairs(PType<V1> p1,
PType<V2> p2)
|
|
static
|
Writables.pairs(PType<V1> p1,
PType<V2> p2)
|
|
|
WritableTypeFamily.pairs(PType<V1> p1,
PType<V2> p2)
|
|
|
WritableTypeFamily.pairs(PType<V1> p1,
PType<V2> p2)
|
|
static
|
Writables.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
static
|
Writables.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
static
|
Writables.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
static
|
Writables.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
WritableTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
WritableTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
WritableTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
|
WritableTypeFamily.quads(PType<V1> p1,
PType<V2> p2,
PType<V3> p3,
PType<V4> p4)
|
|
static
|
Writables.tableOf(PType<K> key,
PType<V> value)
|
|
static
|
Writables.tableOf(PType<K> key,
PType<V> value)
|
|
|
WritableTypeFamily.tableOf(PType<K> key,
PType<V> value)
|
|
|
WritableTypeFamily.tableOf(PType<K> key,
PType<V> value)
|
|
static
|
Writables.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
static
|
Writables.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
static
|
Writables.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
|
WritableTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
|
WritableTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
|
WritableTypeFamily.triples(PType<V1> p1,
PType<V2> p2,
PType<V3> p3)
|
|
static
|
Writables.tuples(Class<T> clazz,
PType... ptypes)
|
|
|
WritableTypeFamily.tuples(Class<T> clazz,
PType<?>... ptypes)
|
|
static WritableType<TupleN,TupleWritable> |
Writables.tuples(PType... ptypes)
|
|
PType<TupleN> |
WritableTypeFamily.tuples(PType<?>... ptypes)
|
|
static PType<Union> |
Writables.unionOf(PType<?>... ptypes)
|
|
PType<Union> |
WritableTypeFamily.unionOf(PType<?>... ptypes)
|
Constructors in org.apache.crunch.types.writable with parameters of type PType | |
---|---|
WritableType(Class<T> typeClass,
Class<W> writableClass,
MapFn<W,T> inputDoFn,
MapFn<T,W> outputDoFn,
PType... subTypes)
|
|
|||||||||
PREV NEXT | FRAMES NO FRAMES |