|
|||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use PTable | |
---|---|
org.apache.crunch | Client-facing API and core abstractions. |
org.apache.crunch.examples | Example applications demonstrating various aspects of Crunch. |
org.apache.crunch.impl.mem | In-memory Pipeline implementation for rapid prototyping and testing. |
org.apache.crunch.impl.mr | A Pipeline implementation that runs on Hadoop MapReduce. |
org.apache.crunch.lib | Joining, sorting, aggregating, and other commonly used functionality. |
org.apache.crunch.lib.join | Inner and outer joins on collections. |
org.apache.crunch.util | An assorted set of utilities. |
Uses of PTable in org.apache.crunch |
---|
Methods in org.apache.crunch that return PTable | ||
---|---|---|
PTable<K,V> |
PTable.bottom(int count)
Returns a PTable made up of the pairs in this PTable with the smallest value field. |
|
|
PCollection.by(MapFn<S,K> extractKeyFn,
PType<K> keyType)
Apply the given map function to each element of this instance in order to create a PTable . |
|
|
PCollection.by(String name,
MapFn<S,K> extractKeyFn,
PType<K> keyType)
Apply the given map function to each element of this instance in order to create a PTable . |
|
|
PTable.cogroup(PTable<K,U> other)
Co-group operation with the given table on common keys. |
|
PTable<K,Collection<V>> |
PTable.collectValues()
Aggregate all of the values with the same key into a single key-value pair in the returned PTable. |
|
PTable<K,V> |
PGroupedTable.combineValues(CombineFn<K,V> combineFn)
Combines the values of this grouping using the given CombineFn . |
|
PTable<S,Long> |
PCollection.count()
Returns a PTable instance that contains the counts of each unique
element of this PCollection. |
|
|
PTable.join(PTable<K,U> other)
Perform an inner join on this table and the one passed in as an argument on their common keys. |
|
|
PCollection.parallelDo(DoFn<S,Pair<K,V>> doFn,
PTableType<K,V> type)
Similar to the other parallelDo instance, but returns a
PTable instance instead of a PCollection . |
|
|
PCollection.parallelDo(String name,
DoFn<S,Pair<K,V>> doFn,
PTableType<K,V> type)
Similar to the other parallelDo instance, but returns a
PTable instance instead of a PCollection . |
|
|
Pipeline.read(TableSource<K,V> tableSource)
A version of the read method for TableSource instances that map to
PTable s. |
|
PTable<K,V> |
PTable.top(int count)
Returns a PTable made up of the pairs in this PTable with the largest value field. |
|
PTable<K,V> |
PGroupedTable.ungroup()
Convert this grouping back into a multimap. |
|
PTable<K,V> |
PTable.union(PTable<K,V>... others)
Returns a PTable instance that acts as the union of this
PTable and the input PTable s. |
|
PTable<K,V> |
PTable.write(Target target)
Writes this PTable to the given Target . |
Methods in org.apache.crunch with parameters of type PTable | ||
---|---|---|
|
PTable.cogroup(PTable<K,U> other)
Co-group operation with the given table on common keys. |
|
|
PTable.join(PTable<K,U> other)
Perform an inner join on this table and the one passed in as an argument on their common keys. |
|
PTable<K,V> |
PTable.union(PTable<K,V>... others)
Returns a PTable instance that acts as the union of this
PTable and the input PTable s. |
Uses of PTable in org.apache.crunch.examples |
---|
Methods in org.apache.crunch.examples that return PTable | |
---|---|
PTable<String,String> |
WordAggregationHBase.extractText(PTable<org.apache.hadoop.hbase.io.ImmutableBytesWritable,org.apache.hadoop.hbase.client.Result> words)
Extract information from hbase |
Methods in org.apache.crunch.examples with parameters of type PTable | |
---|---|
PCollection<org.apache.hadoop.hbase.client.Put> |
WordAggregationHBase.createPut(PTable<String,String> extractedText)
Create puts in order to insert them in hbase. |
PTable<String,String> |
WordAggregationHBase.extractText(PTable<org.apache.hadoop.hbase.io.ImmutableBytesWritable,org.apache.hadoop.hbase.client.Result> words)
Extract information from hbase |
Uses of PTable in org.apache.crunch.impl.mem |
---|
Methods in org.apache.crunch.impl.mem that return PTable | ||
---|---|---|
|
MemPipeline.read(TableSource<K,V> source)
|
|
static
|
MemPipeline.tableOf(Iterable<Pair<S,T>> pairs)
|
|
static
|
MemPipeline.tableOf(S s,
T t,
Object... more)
|
|
static
|
MemPipeline.typedTableOf(PTableType<S,T> ptype,
Iterable<Pair<S,T>> pairs)
|
|
static
|
MemPipeline.typedTableOf(PTableType<S,T> ptype,
S s,
T t,
Object... more)
|
Uses of PTable in org.apache.crunch.impl.mr |
---|
Methods in org.apache.crunch.impl.mr that return PTable | ||
---|---|---|
|
MRPipeline.read(TableSource<K,V> source)
|
Uses of PTable in org.apache.crunch.lib |
---|
Methods in org.apache.crunch.lib that return PTable | ||
---|---|---|
static
|
Cogroup.cogroup(PTable<K,U> left,
PTable<K,V> right)
Co-groups the two PTable arguments. |
|
static
|
Aggregate.collectValues(PTable<K,V> collect)
|
|
static
|
Aggregate.count(PCollection<S> collect)
Returns a PTable that contains the unique elements of this collection mapped to a count
of their occurrences. |
|
static
|
Cartesian.cross(PTable<K1,U> left,
PTable<K2,V> right)
Performs a full cross join on the specified PTable s (using the same
strategy as Pig's CROSS operator). |
|
static
|
Cartesian.cross(PTable<K1,U> left,
PTable<K2,V> right,
int parallelism)
Performs a full cross join on the specified PTable s (using the same
strategy as Pig's CROSS operator). |
|
static
|
Join.fullJoin(PTable<K,U> left,
PTable<K,V> right)
Performs a full outer join on the specified PTable s. |
|
static
|
Join.innerJoin(PTable<K,U> left,
PTable<K,V> right)
Performs an inner join on the specified PTable s. |
|
static
|
Join.join(PTable<K,U> left,
PTable<K,V> right)
Performs an inner join on the specified PTable s. |
|
static
|
Join.join(PTable<K,U> left,
PTable<K,V> right,
JoinFn<K,U,V> joinFn)
|
|
static
|
Join.leftJoin(PTable<K,U> left,
PTable<K,V> right)
Performs a left outer join on the specified PTable s. |
|
static
|
Join.rightJoin(PTable<K,U> left,
PTable<K,V> right)
Performs a right outer join on the specified PTable s. |
|
static
|
Sort.sort(PTable<K,V> table)
Sorts the PTable using the natural ordering of its keys. |
|
static
|
Sort.sort(PTable<K,V> table,
Sort.Order key)
Sorts the PTable using the natural ordering of its keys in the
order specified. |
|
static
|
SecondarySort.sortAndApply(PTable<K,Pair<V1,V2>> input,
DoFn<Pair<K,Iterable<Pair<V1,V2>>>,Pair<U,V>> doFn,
PTableType<U,V> ptype)
Perform a secondary sort on the given PTable instance and then apply a
DoFn to the resulting sorted data to yield an output PTable<U, V> . |
|
static
|
Aggregate.top(PTable<K,V> ptable,
int limit,
boolean maximize)
|
Methods in org.apache.crunch.lib with parameters of type PTable | ||
---|---|---|
static
|
Cogroup.cogroup(PTable<K,U> left,
PTable<K,V> right)
Co-groups the two PTable arguments. |
|
static
|
Cogroup.cogroup(PTable<K,U> left,
PTable<K,V> right)
Co-groups the two PTable arguments. |
|
static
|
Aggregate.collectValues(PTable<K,V> collect)
|
|
static
|
Cartesian.cross(PTable<K1,U> left,
PTable<K2,V> right)
Performs a full cross join on the specified PTable s (using the same
strategy as Pig's CROSS operator). |
|
static
|
Cartesian.cross(PTable<K1,U> left,
PTable<K2,V> right)
Performs a full cross join on the specified PTable s (using the same
strategy as Pig's CROSS operator). |
|
static
|
Cartesian.cross(PTable<K1,U> left,
PTable<K2,V> right,
int parallelism)
Performs a full cross join on the specified PTable s (using the same
strategy as Pig's CROSS operator). |
|
static
|
Cartesian.cross(PTable<K1,U> left,
PTable<K2,V> right,
int parallelism)
Performs a full cross join on the specified PTable s (using the same
strategy as Pig's CROSS operator). |
|
static
|
Join.fullJoin(PTable<K,U> left,
PTable<K,V> right)
Performs a full outer join on the specified PTable s. |
|
static
|
Join.fullJoin(PTable<K,U> left,
PTable<K,V> right)
Performs a full outer join on the specified PTable s. |
|
static
|
Join.innerJoin(PTable<K,U> left,
PTable<K,V> right)
Performs an inner join on the specified PTable s. |
|
static
|
Join.innerJoin(PTable<K,U> left,
PTable<K,V> right)
Performs an inner join on the specified PTable s. |
|
static
|
Join.join(PTable<K,U> left,
PTable<K,V> right)
Performs an inner join on the specified PTable s. |
|
static
|
Join.join(PTable<K,U> left,
PTable<K,V> right)
Performs an inner join on the specified PTable s. |
|
static
|
Join.join(PTable<K,U> left,
PTable<K,V> right,
JoinFn<K,U,V> joinFn)
|
|
static
|
Join.join(PTable<K,U> left,
PTable<K,V> right,
JoinFn<K,U,V> joinFn)
|
|
static
|
PTables.keys(PTable<K,V> ptable)
|
|
static
|
Join.leftJoin(PTable<K,U> left,
PTable<K,V> right)
Performs a left outer join on the specified PTable s. |
|
static
|
Join.leftJoin(PTable<K,U> left,
PTable<K,V> right)
Performs a left outer join on the specified PTable s. |
|
static
|
Join.rightJoin(PTable<K,U> left,
PTable<K,V> right)
Performs a right outer join on the specified PTable s. |
|
static
|
Join.rightJoin(PTable<K,U> left,
PTable<K,V> right)
Performs a right outer join on the specified PTable s. |
|
static
|
Sort.sort(PTable<K,V> table)
Sorts the PTable using the natural ordering of its keys. |
|
static
|
Sort.sort(PTable<K,V> table,
Sort.Order key)
Sorts the PTable using the natural ordering of its keys in the
order specified. |
|
static
|
SecondarySort.sortAndApply(PTable<K,Pair<V1,V2>> input,
DoFn<Pair<K,Iterable<Pair<V1,V2>>>,Pair<U,V>> doFn,
PTableType<U,V> ptype)
Perform a secondary sort on the given PTable instance and then apply a
DoFn to the resulting sorted data to yield an output PTable<U, V> . |
|
static
|
SecondarySort.sortAndApply(PTable<K,Pair<V1,V2>> input,
DoFn<Pair<K,Iterable<Pair<V1,V2>>>,T> doFn,
PType<T> ptype)
Perform a secondary sort on the given PTable instance and then apply a
DoFn to the resulting sorted data to yield an output PCollection<T> . |
|
static
|
Aggregate.top(PTable<K,V> ptable,
int limit,
boolean maximize)
|
|
static
|
PTables.values(PTable<K,V> ptable)
|
Uses of PTable in org.apache.crunch.lib.join |
---|
Methods in org.apache.crunch.lib.join that return PTable | ||
---|---|---|
static
|
MapsideJoin.join(PTable<K,U> left,
PTable<K,V> right)
Join two tables using a map side join. |
Methods in org.apache.crunch.lib.join with parameters of type PTable | ||
---|---|---|
static
|
MapsideJoin.join(PTable<K,U> left,
PTable<K,V> right)
Join two tables using a map side join. |
|
static
|
MapsideJoin.join(PTable<K,U> left,
PTable<K,V> right)
Join two tables using a map side join. |
Uses of PTable in org.apache.crunch.util |
---|
Methods in org.apache.crunch.util that return PTable | ||
---|---|---|
|
CrunchTool.read(TableSource<K,V> tableSource)
|
|
|||||||||
PREV NEXT | FRAMES NO FRAMES |