| Package | Description |
|---|---|
| org.apache.crunch |
Client-facing API and core abstractions.
|
| org.apache.crunch.impl.dist | |
| org.apache.crunch.impl.dist.collect | |
| org.apache.crunch.impl.mem |
In-memory Pipeline implementation for rapid prototyping and testing.
|
| org.apache.crunch.lambda |
Alternative Crunch API using Java 8 features to allow construction of pipelines using lambda functions and method
references.
|
| Modifier and Type | Method and Description |
|---|---|
static Target.WriteMode |
Target.WriteMode.valueOf(String name)
Returns the enum constant of this type with the specified name.
|
static Target.WriteMode[] |
Target.WriteMode.values()
Returns an array containing the constants of this enum type, in
the order they are declared.
|
| Modifier and Type | Method and Description |
|---|---|
boolean |
Target.handleExisting(Target.WriteMode writeMode,
long lastModifiedAt,
org.apache.hadoop.conf.Configuration conf)
Apply the given
WriteMode to this Target instance. |
void |
Pipeline.write(PCollection<?> collection,
Target target,
Target.WriteMode writeMode)
Write the contents of the
PCollection to the given Target,
using the storage format specified by the target and the given
WriteMode for cases where the referenced Target
already exists. |
PTable<K,V> |
PTable.write(Target target,
Target.WriteMode writeMode)
Writes this
PTable to the given Target, using the
given Target.WriteMode to handle existing targets. |
PCollection<S> |
PCollection.write(Target target,
Target.WriteMode writeMode)
Write the contents of this
PCollection to the given Target,
using the given Target.WriteMode to handle existing
targets. |
| Modifier and Type | Method and Description |
|---|---|
void |
DistributedPipeline.write(PCollection<?> pcollection,
Target target,
Target.WriteMode writeMode) |
| Modifier and Type | Method and Description |
|---|---|
PTable<K,V> |
PTableBase.write(Target target,
Target.WriteMode writeMode) |
PCollection<S> |
PCollectionImpl.write(Target target,
Target.WriteMode writeMode) |
| Modifier and Type | Method and Description |
|---|---|
void |
MemPipeline.write(PCollection<?> collection,
Target target,
Target.WriteMode writeMode) |
| Modifier and Type | Method and Description |
|---|---|
default LTable<K,V> |
LTable.write(Target target,
Target.WriteMode writeMode)
Write this table to the
Target supplied. |
default LCollection<S> |
LCollection.write(Target target,
Target.WriteMode writeMode)
Write this collection to the specified
Target with the given Target.WriteMode |
Copyright © 2016 The Apache Software Foundation. All rights reserved.