Uses of Class
org.apache.crunch.PipelineCallable

Packages that use PipelineCallable

Package	Description
org.apache.crunch	Client-facing API and core abstractions.
org.apache.crunch.impl.dist
org.apache.crunch.impl.dist.collect
org.apache.crunch.impl.mem	In-memory Pipeline implementation for rapid prototyping and testing.
org.apache.crunch.impl.spark

Uses of PipelineCallable in org.apache.crunch

Methods in org.apache.crunch that return PipelineCallable

Modifier and Type	Method and Description
PipelineCallable<Output>	PipelineCallable.dependsOn(String label, PCollection<?> pcollect) Requires that the given PCollection be materialized to disk before this instance may be executed.
PipelineCallable<Output>	PipelineCallable.dependsOn(String label, Target t) Requires that the given Target exists before this instance may be executed.
PipelineCallable<Output>	PipelineCallable.named(String name) Use the given name to identify this instance in the logs.

Methods in org.apache.crunch with parameters of type PipelineCallable

Modifier and Type	Method and Description
<Output> Output	Pipeline.sequentialDo(PipelineCallable<Output> pipelineCallable) Executes the given PipelineCallable on the client after the Targets that the PipelineCallable depends on (if any) have been created by other pipeline processing steps.
<Output> Output	PCollection.sequentialDo(String label, PipelineCallable<Output> pipelineCallable) Adds the materialized data in this PCollection as a dependency to the given PipelineCallable and registers it with the Pipeline associated with this instance.

Uses of PipelineCallable in org.apache.crunch.impl.dist

Methods in org.apache.crunch.impl.dist with parameters of type PipelineCallable

Modifier and Type	Method and Description
<Output> Output	DistributedPipeline.sequentialDo(PipelineCallable<Output> pipelineCallable)

Uses of PipelineCallable in org.apache.crunch.impl.dist.collect

Methods in org.apache.crunch.impl.dist.collect with parameters of type PipelineCallable

Modifier and Type	Method and Description
<Output> Output	PCollectionImpl.sequentialDo(String label, PipelineCallable<Output> pipelineCallable)

Uses of PipelineCallable in org.apache.crunch.impl.mem

Methods in org.apache.crunch.impl.mem with parameters of type PipelineCallable

Modifier and Type	Method and Description
<Output> Output	MemPipeline.sequentialDo(PipelineCallable<Output> callable)

Uses of PipelineCallable in org.apache.crunch.impl.spark

Constructor parameters in org.apache.crunch.impl.spark with type arguments of type PipelineCallable

Constructor and Description

SparkRuntime(SparkPipeline pipeline, org.apache.spark.api.java.JavaSparkContext sparkContext, org.apache.hadoop.conf.Configuration conf, Map<PCollectionImpl<?>,Set<Target>> outputTargets, Map<PCollectionImpl<?>,org.apache.crunch.materialize.MaterializableIterable> toMaterialize, Map<PCollection<?>,org.apache.spark.storage.StorageLevel> toCache, Map<PipelineCallable<?>,Set<Target>> allPipelineCallables)