| Package | Description |
|---|---|
| org.apache.crunch |
Client-facing API and core abstractions.
|
| org.apache.crunch.impl.dist.collect | |
| org.apache.crunch.impl.mem |
In-memory Pipeline implementation for rapid prototyping and testing.
|
| org.apache.crunch.impl.mr |
A Pipeline implementation that runs on Hadoop MapReduce.
|
| org.apache.crunch.impl.spark |
| Modifier and Type | Field and Description |
|---|---|
static CachingOptions |
CachingOptions.DEFAULT
An instance of
CachingOptions with the default caching settings. |
| Modifier and Type | Method and Description |
|---|---|
CachingOptions |
CachingOptions.Builder.build() |
| Modifier and Type | Method and Description |
|---|---|
PTable<K,V> |
PTable.cache(CachingOptions options) |
PCollection<S> |
PCollection.cache(CachingOptions options)
Marks this data as cached using the given
CachingOptions. |
<T> void |
Pipeline.cache(PCollection<T> pcollection,
CachingOptions options)
Caches the given PCollection so that it will be processed at most once
during pipeline execution.
|
| Modifier and Type | Method and Description |
|---|---|
PTable<K,V> |
PTableBase.cache(CachingOptions options) |
PCollection<S> |
PCollectionImpl.cache(CachingOptions options) |
| Modifier and Type | Method and Description |
|---|---|
<T> void |
MemPipeline.cache(PCollection<T> pcollection,
CachingOptions options) |
| Modifier and Type | Method and Description |
|---|---|
<T> void |
MRPipeline.cache(PCollection<T> pcollection,
CachingOptions options) |
| Modifier and Type | Method and Description |
|---|---|
<T> void |
SparkPipeline.cache(PCollection<T> pcollection,
CachingOptions options) |
Copyright © 2015 The Apache Software Foundation. All Rights Reserved.