Package | Description |
---|---|
org.apache.crunch |
Client-facing API and core abstractions.
|
org.apache.crunch.impl.dist | |
org.apache.crunch.impl.mem |
In-memory Pipeline implementation for rapid prototyping and testing.
|
org.apache.crunch.impl.mr |
A Pipeline implementation that runs on Hadoop MapReduce.
|
org.apache.crunch.impl.spark |
Modifier and Type | Method and Description |
---|---|
Pipeline |
PCollection.getPipeline()
Returns the
Pipeline associated with this PCollection. |
Modifier and Type | Method and Description |
---|---|
Output |
PipelineCallable.generateOutput(Pipeline pipeline)
Called by the
Pipeline when this instance is registered with Pipeline#sequentialDo . |
Modifier and Type | Class and Description |
---|---|
class |
DistributedPipeline |
Modifier and Type | Class and Description |
---|---|
class |
MemPipeline |
Modifier and Type | Method and Description |
---|---|
static Pipeline |
MemPipeline.getInstance() |
Modifier and Type | Class and Description |
---|---|
class |
MRPipeline
Pipeline implementation that is executed within Hadoop MapReduce.
|
Modifier and Type | Class and Description |
---|---|
class |
SparkPipeline |
Copyright © 2016 The Apache Software Foundation. All rights reserved.