This project has retired. For details please refer to its Attic page.

org.apache.crunch.impl.spark.collect
Class DoCollection<S>

java.lang.Object
  org.apache.crunch.impl.dist.collect.PCollectionImpl<S>
      org.apache.crunch.impl.dist.collect.BaseDoCollection<S>
          org.apache.crunch.impl.spark.collect.DoCollection<S>

All Implemented Interfaces:

SparkCollection, PCollection<S>

public class DoCollection<S>
extends BaseDoCollection<S>
implements SparkCollection

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

PCollectionImpl.Visitor

Field Summary

Fields inherited from class org.apache.crunch.impl.dist.collect.BaseDoCollection

fn, ptype

Fields inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

doOptions, materializedAt, pipeline

Method Summary

org.apache.spark.api.java.JavaRDDLike<?,?>

getJavaRDDLike(SparkRuntime runtime)

Methods inherited from class org.apache.crunch.impl.dist.collect.BaseDoCollection

acceptInternal, getLastModifiedAt, getParents, getPType, getReadableDataInternal, getSizeInternal

Methods inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

accept, asCollection, asReadable, by, by, cache, cache, count, filter, filter, getChainingCollection, getDepth, getMaterializedAt, getName, getOnlyParent, getParallelDoOptions, getPipeline, getSize, getTargetDependencies, getTypeFamily, isBreakpoint, length, materialize, materializeAt, materializedData, max, min, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, setBreakpoint, toString, union, union, write, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Method Detail

getJavaRDDLike

public org.apache.spark.api.java.JavaRDDLike<?,?> getJavaRDDLike(SparkRuntime runtime)

Specified by:

getJavaRDDLike in interface SparkCollection