Package | Description |
---|---|
org.apache.crunch |
Client-facing API and core abstractions.
|
org.apache.crunch.impl.dist.collect | |
org.apache.crunch.impl.mem |
In-memory Pipeline implementation for rapid prototyping and testing.
|
org.apache.crunch.impl.mr |
A Pipeline implementation that runs on Hadoop MapReduce.
|
org.apache.crunch.impl.spark | |
org.apache.crunch.lambda |
Alternative Crunch API using Java 8 features to allow construction of pipelines using lambda functions and method
references.
|
Modifier and Type | Field and Description |
---|---|
static CachingOptions |
CachingOptions.DEFAULT
An instance of
CachingOptions with the default caching settings. |
Modifier and Type | Method and Description |
---|---|
CachingOptions |
CachingOptions.Builder.build() |
Modifier and Type | Method and Description |
---|---|
PTable<K,V> |
PTable.cache(CachingOptions options) |
PCollection<S> |
PCollection.cache(CachingOptions options)
Marks this data as cached using the given
CachingOptions . |
<T> void |
Pipeline.cache(PCollection<T> pcollection,
CachingOptions options)
Caches the given PCollection so that it will be processed at most once
during pipeline execution.
|
Modifier and Type | Method and Description |
---|---|
PTable<K,V> |
PTableBase.cache(CachingOptions options) |
PCollection<S> |
PCollectionImpl.cache(CachingOptions options) |
Modifier and Type | Method and Description |
---|---|
<T> void |
MemPipeline.cache(PCollection<T> pcollection,
CachingOptions options) |
Modifier and Type | Method and Description |
---|---|
<T> void |
MRPipeline.cache(PCollection<T> pcollection,
CachingOptions options) |
Modifier and Type | Method and Description |
---|---|
<T> void |
SparkPipeline.cache(PCollection<T> pcollection,
CachingOptions options) |
Modifier and Type | Method and Description |
---|---|
default LCollection<S> |
LCollection.cache(CachingOptions options)
Cache the underlying
PCollection |
Copyright © 2016 The Apache Software Foundation. All rights reserved.