Package | Description |
---|---|
org.apache.crunch |
Client-facing API and core abstractions.
|
org.apache.crunch.impl.dist | |
org.apache.crunch.impl.mem |
In-memory Pipeline implementation for rapid prototyping and testing.
|
org.apache.crunch.impl.spark | |
org.apache.crunch.impl.spark.collect |
Modifier and Type | Method and Description |
---|---|
static CreateOptions |
CreateOptions.name(String name) |
static CreateOptions |
CreateOptions.nameAndParallelism(String name,
int parallelism) |
static CreateOptions |
CreateOptions.none() |
static CreateOptions |
CreateOptions.parallelism(int parallelism) |
Modifier and Type | Method and Description |
---|---|
<K,V> PTable<K,V> |
Pipeline.create(Iterable<Pair<K,V>> contents,
PTableType<K,V> ptype,
CreateOptions options)
Creates a
PTable containing the values found in the given Iterable
using an implementation-specific distribution mechanism. |
<T> PCollection<T> |
Pipeline.create(Iterable<T> contents,
PType<T> ptype,
CreateOptions options)
Creates a
PCollection containing the values found in the given Iterable
using an implementation-specific distribution mechanism. |
Modifier and Type | Method and Description |
---|---|
<K,V> PTable<K,V> |
DistributedPipeline.create(Iterable<Pair<K,V>> contents,
PTableType<K,V> ptype,
CreateOptions options) |
<S> PCollection<S> |
DistributedPipeline.create(Iterable<S> contents,
PType<S> ptype,
CreateOptions options) |
Modifier and Type | Method and Description |
---|---|
<K,V> PTable<K,V> |
MemPipeline.create(Iterable<Pair<K,V>> contents,
PTableType<K,V> ptype,
CreateOptions options) |
<T> PCollection<T> |
MemPipeline.create(Iterable<T> iterable,
PType<T> ptype,
CreateOptions options) |
Modifier and Type | Method and Description |
---|---|
<K,V> PTable<K,V> |
SparkPipeline.create(Iterable<Pair<K,V>> contents,
PTableType<K,V> ptype,
CreateOptions options) |
<S> PCollection<S> |
SparkPipeline.create(Iterable<S> contents,
PType<S> ptype,
CreateOptions options) |
Constructor and Description |
---|
CreatedCollection(SparkPipeline p,
Iterable<T> contents,
PType<T> ptype,
CreateOptions options) |
CreatedTable(SparkPipeline pipeline,
Iterable<Pair<K,V>> contents,
PTableType<K,V> ptype,
CreateOptions options) |
Copyright © 2016 The Apache Software Foundation. All rights reserved.