This project has retired. For details please refer to its Attic page.

org.apache.crunch.impl.dist.collect
Class BaseDoCollection<S>

java.lang.Object
  org.apache.crunch.impl.dist.collect.PCollectionImpl<S>
      org.apache.crunch.impl.dist.collect.BaseDoCollection<S>

All Implemented Interfaces:

PCollection<S>

Direct Known Subclasses:

DoCollection, DoCollection

public class BaseDoCollection<S>
extends PCollectionImpl<S>

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

PCollectionImpl.Visitor

Field Summary

protected DoFn<Object,S>	fn
protected PType<S>	ptype

Fields inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

doOptions, materializedAt, pipeline

Constructor Summary

protected

BaseDoCollection(String name, PCollectionImpl<T> parent, DoFn<T,S> fn, PType<S> ptype, ParallelDoOptions options)

Method Summary

protected void	acceptInternal(PCollectionImpl.Visitor visitor)
long	getLastModifiedAt()
List<PCollectionImpl<?>>	getParents()
PType<S>	getPType() Returns the PType of this PCollection.
protected ReadableData<S>	getReadableDataInternal()
protected long	getSizeInternal()

Methods inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

accept, asCollection, asReadable, by, by, cache, cache, count, filter, filter, getChainingCollection, getDepth, getMaterializedAt, getName, getOnlyParent, getParallelDoOptions, getPipeline, getSize, getTargetDependencies, getTypeFamily, isBreakpoint, length, materialize, materializeAt, materializedData, max, min, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, setBreakpoint, toString, union, union, write, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

fn

protected final DoFn<Object,S> fn

ptype

protected final PType<S> ptype

Constructor Detail

BaseDoCollection

protected BaseDoCollection(String name,
                           PCollectionImpl<T> parent,
                           DoFn<T,S> fn,
                           PType<S> ptype,
                           ParallelDoOptions options)

Method Detail

getSizeInternal

protected long getSizeInternal()

Specified by:

getSizeInternal in class PCollectionImpl<S>

getReadableDataInternal

protected ReadableData<S> getReadableDataInternal()

Specified by:

getReadableDataInternal in class PCollectionImpl<S>

getPType

public PType<S> getPType()

Description copied from interface: PCollection

Returns the PType of this PCollection.

getParents

public List<PCollectionImpl<?>> getParents()

Specified by:

getParents in class PCollectionImpl<S>

getLastModifiedAt

public long getLastModifiedAt()

Specified by:

getLastModifiedAt in class PCollectionImpl<S>

acceptInternal

protected void acceptInternal(PCollectionImpl.Visitor visitor)

Specified by:

acceptInternal in class PCollectionImpl<S>