org.apache.crunch.impl.spark.collect

Class InputTable<K,V>

java.lang.Object

org.apache.crunch.impl.dist.collect.PCollectionImpl<Pair<K,V>>

org.apache.crunch.impl.dist.collect.PTableBase<K,V>

org.apache.crunch.impl.dist.collect.BaseInputTable<K,V>

org.apache.crunch.impl.spark.collect.InputTable<K,V>

All Implemented Interfaces:

SparkCollection, PCollection<Pair<K,V>>, PTable<K,V>

public class InputTable<K,V>
extends BaseInputTable<K,V>
implements SparkCollection

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

PCollectionImpl.Visitor

Constructor Summary

Constructors

Constructor and Description
InputTable(TableSource<K,V> source, String named, DistributedPipeline pipeline, ParallelDoOptions doOpts)

Method Summary

Modifier and Type	Method and Description
org.apache.spark.api.java.JavaRDDLike<?,?>	getJavaRDDLike(SparkRuntime runtime)

Methods inherited from class org.apache.crunch.impl.dist.collect.BaseInputTable

equals, getLastModifiedAt, getParents, getPTableType, getPType, getSource, hashCode

Methods inherited from class org.apache.crunch.impl.dist.collect.PTableBase

asMap, bottom, cache, cache, cogroup, collectValues, filter, filter, getKeyType, getValueType, groupByKey, groupByKey, groupByKey, join, keys, mapKeys, mapKeys, mapValues, mapValues, materializeToMap, top, union, union, values, write, write

Methods inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

accept, aggregate, asCollection, asReadable, by, by, count, first, getDepth, getMaterializedAt, getName, getOnlyParent, getParallelDoOptions, getPipeline, getSize, getTargetDependencies, getTypeFamily, isBreakpoint, length, materialize, materializeAt, max, min, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, sequentialDo, setBreakpoint, toString, union, union

Methods inherited from class java.lang.Object

getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.crunch.PCollection

aggregate, asCollection, asReadable, by, by, count, first, getName, getPipeline, getSize, getTypeFamily, length, materialize, max, min, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, sequentialDo, union, union

Constructor Detail

InputTable

public InputTable(TableSource<K,V> source,
                  String named,
                  DistributedPipeline pipeline,
                  ParallelDoOptions doOpts)

Method Detail

getJavaRDDLike

public org.apache.spark.api.java.JavaRDDLike<?,?> getJavaRDDLike(SparkRuntime runtime)

Specified by:

getJavaRDDLike in interface SparkCollection