This project has retired. For details please refer to its Attic page.

org.apache.crunch.impl.dist.collect
Class BaseDoTable<K,V>

java.lang.Object
  org.apache.crunch.impl.dist.collect.PCollectionImpl<Pair<K,V>>
      org.apache.crunch.impl.dist.collect.PTableBase<K,V>
          org.apache.crunch.impl.dist.collect.BaseDoTable<K,V>

All Implemented Interfaces:

PCollection<Pair<K,V>>, PTable<K,V>

Direct Known Subclasses:

DoTable, DoTable

public class BaseDoTable<K,V>
extends PTableBase<K,V>
implements PTable<K,V>

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

PCollectionImpl.Visitor

Field Summary

protected DoFn<?,Pair<K,V>>	combineFn
protected DoFn<?,Pair<K,V>>	fn
protected PTableType<K,V>	type

Fields inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

doOptions, materializedAt, pipeline

Constructor Summary

protected	BaseDoTable(String name, PCollectionImpl<S> parent, CombineFn<K,V> combineFn, DoFn<S,Pair<K,V>> fn, PTableType<K,V> ntype)
protected	BaseDoTable(String name, PCollectionImpl<S> parent, CombineFn<K,V> combineFn, DoFn<S,Pair<K,V>> fn, PTableType<K,V> ntype, ParallelDoOptions options)
protected	BaseDoTable(String name, PCollectionImpl<S> parent, DoFn<S,Pair<K,V>> fn, PTableType<K,V> ntype, ParallelDoOptions options)

Method Summary

protected void	acceptInternal(PCollectionImpl.Visitor visitor)
long	getLastModifiedAt()
List<PCollectionImpl<?>>	getParents()
PTableType<K,V>	getPTableType() Returns the PTableType of this PTable.
PType<Pair<K,V>>	getPType() Returns the PType of this PCollection.
protected ReadableData<Pair<K,V>>	getReadableDataInternal()
protected long	getSizeInternal()

Methods inherited from class org.apache.crunch.impl.dist.collect.PTableBase

asMap, bottom, cache, cache, cogroup, collectValues, filter, filter, getKeyType, getValueType, groupByKey, groupByKey, groupByKey, join, keys, mapKeys, mapKeys, mapValues, mapValues, materializeToMap, top, union, union, values, write, write

Methods inherited from class org.apache.crunch.impl.dist.collect.PCollectionImpl

accept, asCollection, asReadable, by, by, count, getChainingCollection, getDepth, getMaterializedAt, getName, getOnlyParent, getParallelDoOptions, getPipeline, getSize, getTargetDependencies, getTypeFamily, isBreakpoint, length, materialize, materializeAt, materializedData, max, min, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, setBreakpoint, toString, union, union

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.crunch.PTable

asMap, bottom, cache, cache, cogroup, collectValues, filter, filter, getKeyType, getValueType, groupByKey, groupByKey, groupByKey, join, keys, mapKeys, mapKeys, mapValues, mapValues, materializeToMap, top, union, union, values, write, write

Methods inherited from interface org.apache.crunch.PCollection

asCollection, asReadable, by, by, count, getName, getPipeline, getSize, getTypeFamily, length, materialize, max, min, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, parallelDo, union, union

Field Detail

combineFn

protected final DoFn<?,Pair<K,V>> combineFn

fn

protected final DoFn<?,Pair<K,V>> fn

type

protected final PTableType<K,V> type

Constructor Detail

BaseDoTable

protected BaseDoTable(String name,
                      PCollectionImpl<S> parent,
                      DoFn<S,Pair<K,V>> fn,
                      PTableType<K,V> ntype,
                      ParallelDoOptions options)

BaseDoTable

protected BaseDoTable(String name,
                      PCollectionImpl<S> parent,
                      CombineFn<K,V> combineFn,
                      DoFn<S,Pair<K,V>> fn,
                      PTableType<K,V> ntype)

BaseDoTable

protected BaseDoTable(String name,
                      PCollectionImpl<S> parent,
                      CombineFn<K,V> combineFn,
                      DoFn<S,Pair<K,V>> fn,
                      PTableType<K,V> ntype,
                      ParallelDoOptions options)

Method Detail

getSizeInternal

protected long getSizeInternal()

Specified by:

getSizeInternal in class PCollectionImpl<Pair<K,V>>

getPTableType

public PTableType<K,V> getPTableType()

Description copied from interface: PTable

Returns the PTableType of this PTable.

Specified by:

getPTableType in interface PTable<K,V>

getReadableDataInternal

protected ReadableData<Pair<K,V>> getReadableDataInternal()

Specified by:

getReadableDataInternal in class PCollectionImpl<Pair<K,V>>

getPType

public PType<Pair<K,V>> getPType()

Description copied from interface: PCollection

Returns the PType of this PCollection.

Specified by:

getPType in interface PCollection<Pair<K,V>>

getParents

public List<PCollectionImpl<?>> getParents()

Specified by:

getParents in class PCollectionImpl<Pair<K,V>>

getLastModifiedAt

public long getLastModifiedAt()

Specified by:

getLastModifiedAt in class PCollectionImpl<Pair<K,V>>

acceptInternal

protected void acceptInternal(PCollectionImpl.Visitor visitor)

Specified by:

acceptInternal in class PCollectionImpl<Pair<K,V>>