This project has retired. For details please refer to its Attic page.

org.apache.crunch.impl.spark.collect
Class DoTable<K,V>

java.lang.Object
  org.apache.crunch.impl.dist.collect.PCollectionImpl<Pair<K,V>>
      org.apache.crunch.impl.dist.collect.PTableBase<K,V>
          org.apache.crunch.impl.dist.collect.BaseDoTable<K,V>
              org.apache.crunch.impl.spark.collect.DoTable<K,V>

All Implemented Interfaces:

SparkCollection, PCollection<Pair<K,V>>, PTable<K,V>

public class DoTable<K,V>
extends BaseDoTable<K,V>
implements SparkCollection

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

PCollectionImpl.Visitor

Field Summary

Fields inherited from class org.apache.crunch.impl.dist.collect.BaseDoTable

combineFn, fn, type

Fields inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

doOptions, materializedAt, pipeline

Method Summary

org.apache.spark.api.java.JavaRDDLike<?,?>

getJavaRDDLike(SparkRuntime runtime)

Methods inherited from class org.apache.crunch.impl.dist.collect.BaseDoTable

acceptInternal, getLastModifiedAt, getParents, getPTableType, getPType, getReadableDataInternal, getSizeInternal

Methods inherited from class org.apache.crunch.impl.dist.collect.PTableBase

asMap, bottom, cache, cache, cogroup, collectValues, filter, filter, getKeyType, getValueType, groupByKey, groupByKey, groupByKey, join, keys, mapKeys, mapKeys, mapValues, mapValues, materializeToMap, top, union, union, values, write, write

Methods inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

accept, asCollection, asReadable, by, by, count, getChainingCollection, getDepth, getMaterializedAt, getName, getOnlyParent, getParallelDoOptions, getPipeline, getSize, getTargetDependencies, getTypeFamily, isBreakpoint, length, materialize, materializeAt, materializedData, max, min, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, setBreakpoint, toString, union, union

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.crunch.PTable

asMap, bottom, cache, cache, cogroup, collectValues, filter, filter, getKeyType, getValueType, groupByKey, groupByKey, groupByKey, join, keys, mapKeys, mapKeys, mapValues, mapValues, materializeToMap, top, union, union, values, write, write

Methods inherited from interface org.apache.crunch.PCollection

asCollection, asReadable, by, by, count, getName, getPipeline, getSize, getTypeFamily, length, materialize, max, min, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, union, union

Method Detail

getJavaRDDLike

public org.apache.spark.api.java.JavaRDDLike<?,?> getJavaRDDLike(SparkRuntime runtime)

Specified by:

getJavaRDDLike in interface SparkCollection