This project has retired. For details please refer to its Attic page.

org.apache.crunch.impl.spark.collect
Class InputTable<K,V>

java.lang.Object
  org.apache.crunch.impl.dist.collect.PCollectionImpl<Pair<K,V>>
      org.apache.crunch.impl.dist.collect.PTableBase<K,V>
          org.apache.crunch.impl.dist.collect.BaseInputTable<K,V>
              org.apache.crunch.impl.spark.collect.InputTable<K,V>

All Implemented Interfaces:

SparkCollection, PCollection<Pair<K,V>>, PTable<K,V>

public class InputTable<K,V>
extends BaseInputTable<K,V>
implements SparkCollection

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

PCollectionImpl.Visitor

Constructor Summary

InputTable(TableSource<K,V> source, DistributedPipeline pipeline)

Method Summary

org.apache.spark.api.java.JavaRDDLike<?,?>

getJavaRDDLike(SparkRuntime runtime)

Methods inherited from class org.apache.crunch.impl.dist.collect.BaseInputTable

equals, getLastModifiedAt, getParents, getPTableType, getPType, getSource, hashCode

Methods inherited from class org.apache.crunch.impl.dist.collect.PTableBase

asMap, bottom, cache, cache, cogroup, collectValues, filter, filter, getKeyType, getValueType, groupByKey, groupByKey, groupByKey, join, keys, mapKeys, mapKeys, mapValues, mapValues, materializeToMap, top, union, union, values, write, write

Methods inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

accept, aggregate, asCollection, asReadable, by, by, count, first, getDepth, getMaterializedAt, getName, getOnlyParent, getParallelDoOptions, getPipeline, getSize, getTargetDependencies, getTypeFamily, isBreakpoint, length, materialize, materializeAt, max, min, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, setBreakpoint, toString, union, union

Methods inherited from class java.lang.Object

getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.crunch.PCollection

aggregate, asCollection, asReadable, by, by, count, first, getName, getPipeline, getSize, getTypeFamily, length, materialize, max, min, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, union, union

Constructor Detail

InputTable

public InputTable(TableSource<K,V> source,
                  DistributedPipeline pipeline)

Method Detail

getJavaRDDLike

public org.apache.spark.api.java.JavaRDDLike<?,?> getJavaRDDLike(SparkRuntime runtime)

Specified by:

getJavaRDDLike in interface SparkCollection