|
|||||||||
PREV NEXT | FRAMES NO FRAMES |
Uses of PCollectionImpl in org.apache.crunch.impl.dist |
---|
Fields in org.apache.crunch.impl.dist with type parameters of type PCollectionImpl | |
---|---|
protected Map<PCollectionImpl<?>,Set<Target>> |
DistributedPipeline.outputTargets
|
protected Map<PCollectionImpl<?>,MaterializableIterable<?>> |
DistributedPipeline.outputTargetsToMaterialize
|
Uses of PCollectionImpl in org.apache.crunch.impl.dist.collect |
---|
Subclasses of PCollectionImpl in org.apache.crunch.impl.dist.collect | |
---|---|
class |
BaseDoCollection<S>
|
class |
BaseDoTable<K,V>
|
class |
BaseGroupedTable<K,V>
|
class |
BaseInputCollection<S>
|
class |
BaseInputTable<K,V>
|
class |
BaseUnionCollection<S>
|
class |
BaseUnionTable<K,V>
|
class |
PTableBase<K,V>
|
Methods in org.apache.crunch.impl.dist.collect that return PCollectionImpl | |
---|---|
protected PCollectionImpl<S> |
PCollectionImpl.getChainingCollection()
Retrieve the PCollectionImpl to be used for chaining within PCollectionImpls further down the pipeline. |
protected PCollectionImpl<Pair<K,Iterable<V>>> |
BaseGroupedTable.getChainingCollection()
|
PCollectionImpl<?> |
PCollectionImpl.getOnlyParent()
|
Methods in org.apache.crunch.impl.dist.collect that return types with arguments of type PCollectionImpl | |
---|---|
abstract List<PCollectionImpl<?>> |
PCollectionImpl.getParents()
|
List<PCollectionImpl<?>> |
BaseUnionTable.getParents()
|
List<PCollectionImpl<?>> |
BaseUnionCollection.getParents()
|
List<PCollectionImpl<?>> |
BaseInputTable.getParents()
|
List<PCollectionImpl<?>> |
BaseInputCollection.getParents()
|
List<PCollectionImpl<?>> |
BaseGroupedTable.getParents()
|
List<PCollectionImpl<?>> |
BaseDoTable.getParents()
|
List<PCollectionImpl<?>> |
BaseDoCollection.getParents()
|
Methods in org.apache.crunch.impl.dist.collect with parameters of type PCollectionImpl | ||
---|---|---|
|
PCollectionFactory.createDoCollection(String name,
PCollectionImpl<S> chainingCollection,
DoFn<S,T> fn,
PType<T> type,
ParallelDoOptions options)
|
|
|
PCollectionFactory.createDoTable(String name,
PCollectionImpl<S> chainingCollection,
CombineFn<K,V> combineFn,
DoFn<S,Pair<K,V>> fn,
PTableType<K,V> type)
|
|
|
PCollectionFactory.createDoTable(String name,
PCollectionImpl<S> chainingCollection,
DoFn<S,Pair<K,V>> fn,
PTableType<K,V> type,
ParallelDoOptions options)
|
Method parameters in org.apache.crunch.impl.dist.collect with type arguments of type PCollectionImpl | ||
---|---|---|
|
PCollectionFactory.createUnionCollection(List<? extends PCollectionImpl<S>> internal)
|
Constructors in org.apache.crunch.impl.dist.collect with parameters of type PCollectionImpl | |
---|---|
BaseDoCollection(String name,
PCollectionImpl<T> parent,
DoFn<T,S> fn,
PType<S> ptype,
ParallelDoOptions options)
|
|
BaseDoTable(String name,
PCollectionImpl<S> parent,
CombineFn<K,V> combineFn,
DoFn<S,Pair<K,V>> fn,
PTableType<K,V> ntype)
|
|
BaseDoTable(String name,
PCollectionImpl<S> parent,
CombineFn<K,V> combineFn,
DoFn<S,Pair<K,V>> fn,
PTableType<K,V> ntype,
ParallelDoOptions options)
|
|
BaseDoTable(String name,
PCollectionImpl<S> parent,
DoFn<S,Pair<K,V>> fn,
PTableType<K,V> ntype,
ParallelDoOptions options)
|
Constructor parameters in org.apache.crunch.impl.dist.collect with type arguments of type PCollectionImpl | |
---|---|
BaseUnionCollection(List<? extends PCollectionImpl<S>> collections)
|
Uses of PCollectionImpl in org.apache.crunch.impl.mr.collect |
---|
Subclasses of PCollectionImpl in org.apache.crunch.impl.mr.collect | |
---|---|
class |
DoCollection<S>
|
class |
DoTable<K,V>
|
class |
InputCollection<S>
|
class |
InputTable<K,V>
|
class |
PGroupedTableImpl<K,V>
|
class |
UnionCollection<S>
|
class |
UnionTable<K,V>
|
Methods in org.apache.crunch.impl.mr.collect with parameters of type PCollectionImpl | ||
---|---|---|
|
MRCollectionFactory.createDoCollection(String name,
PCollectionImpl<S> parent,
DoFn<S,T> fn,
PType<T> type,
ParallelDoOptions options)
|
|
|
MRCollectionFactory.createDoTable(String name,
PCollectionImpl<S> parent,
CombineFn<K,V> combineFn,
DoFn<S,Pair<K,V>> reduceFn,
PTableType<K,V> type)
|
|
|
MRCollectionFactory.createDoTable(String name,
PCollectionImpl<S> parent,
DoFn<S,Pair<K,V>> fn,
PTableType<K,V> type,
ParallelDoOptions options)
|
Method parameters in org.apache.crunch.impl.mr.collect with type arguments of type PCollectionImpl | ||
---|---|---|
|
MRCollectionFactory.createUnionCollection(List<? extends PCollectionImpl<S>> internal)
|
Uses of PCollectionImpl in org.apache.crunch.impl.mr.exec |
---|
Constructor parameters in org.apache.crunch.impl.mr.exec with type arguments of type PCollectionImpl | |
---|---|
MRExecutor(org.apache.hadoop.conf.Configuration conf,
Class<?> jarClass,
Map<PCollectionImpl<?>,Set<Target>> outputTargets,
Map<PCollectionImpl<?>,MaterializableIterable> toMaterialize)
|
|
MRExecutor(org.apache.hadoop.conf.Configuration conf,
Class<?> jarClass,
Map<PCollectionImpl<?>,Set<Target>> outputTargets,
Map<PCollectionImpl<?>,MaterializableIterable> toMaterialize)
|
Uses of PCollectionImpl in org.apache.crunch.impl.mr.plan |
---|
Constructor parameters in org.apache.crunch.impl.mr.plan with type arguments of type PCollectionImpl | |
---|---|
MSCRPlanner(MRPipeline pipeline,
Map<PCollectionImpl<?>,Set<Target>> outputs,
Map<PCollectionImpl<?>,MaterializableIterable> toMaterialize)
|
|
MSCRPlanner(MRPipeline pipeline,
Map<PCollectionImpl<?>,Set<Target>> outputs,
Map<PCollectionImpl<?>,MaterializableIterable> toMaterialize)
|
Uses of PCollectionImpl in org.apache.crunch.impl.spark |
---|
Constructor parameters in org.apache.crunch.impl.spark with type arguments of type PCollectionImpl | |
---|---|
SparkRuntime(SparkPipeline pipeline,
org.apache.spark.api.java.JavaSparkContext sparkContext,
org.apache.hadoop.conf.Configuration conf,
Map<PCollectionImpl<?>,Set<Target>> outputTargets,
Map<PCollectionImpl<?>,MaterializableIterable> toMaterialize,
Map<PCollection<?>,org.apache.spark.storage.StorageLevel> toCache)
|
|
SparkRuntime(SparkPipeline pipeline,
org.apache.spark.api.java.JavaSparkContext sparkContext,
org.apache.hadoop.conf.Configuration conf,
Map<PCollectionImpl<?>,Set<Target>> outputTargets,
Map<PCollectionImpl<?>,MaterializableIterable> toMaterialize,
Map<PCollection<?>,org.apache.spark.storage.StorageLevel> toCache)
|
Uses of PCollectionImpl in org.apache.crunch.impl.spark.collect |
---|
Methods in org.apache.crunch.impl.spark.collect with parameters of type PCollectionImpl | ||
---|---|---|
|
SparkCollectFactory.createDoCollection(String name,
PCollectionImpl<S> parent,
DoFn<S,T> fn,
PType<T> type,
ParallelDoOptions options)
|
|
|
SparkCollectFactory.createDoTable(String name,
PCollectionImpl<S> parent,
CombineFn<K,V> combineFn,
DoFn<S,Pair<K,V>> fn,
PTableType<K,V> type)
|
|
|
SparkCollectFactory.createDoTable(String name,
PCollectionImpl<S> parent,
DoFn<S,Pair<K,V>> fn,
PTableType<K,V> type,
ParallelDoOptions options)
|
Method parameters in org.apache.crunch.impl.spark.collect with type arguments of type PCollectionImpl | ||
---|---|---|
|
SparkCollectFactory.createUnionCollection(List<? extends PCollectionImpl<S>> internal)
|
|
|||||||||
PREV NEXT | FRAMES NO FRAMES |