Package | Description |
---|---|
org.apache.crunch.io |
Data input and output for Pipelines.
|
org.apache.crunch.types.avro |
Business object serialization using Apache Avro.
|
Modifier and Type | Field and Description |
---|---|
FormatBundle<org.apache.hadoop.mapreduce.OutputFormat<K,V>> |
CrunchOutputs.OutputConfig.bundle |
Modifier and Type | Method and Description |
---|---|
static <T extends org.apache.hadoop.mapreduce.InputFormat<?,?>> |
FormatBundle.forInput(Class<T> inputFormatClass) |
static <T extends org.apache.hadoop.mapreduce.OutputFormat<?,?>> |
FormatBundle.forOutput(Class<T> outputFormatClass) |
static <T> FormatBundle<T> |
FormatBundle.fromSerialized(String serialized,
org.apache.hadoop.conf.Configuration conf) |
FormatBundle<K> |
FormatBundle.set(String key,
String value) |
Modifier and Type | Method and Description |
---|---|
static Map<FormatBundle,Map<Integer,List<org.apache.hadoop.fs.Path>>> |
CrunchInputs.getFormatNodeMap(org.apache.hadoop.mapreduce.JobContext job) |
Modifier and Type | Method and Description |
---|---|
static void |
CrunchInputs.addInputPath(org.apache.hadoop.mapreduce.Job job,
org.apache.hadoop.fs.Path path,
FormatBundle inputBundle,
int nodeIndex) |
static void |
CrunchInputs.addInputPaths(org.apache.hadoop.mapreduce.Job job,
Collection<org.apache.hadoop.fs.Path> paths,
FormatBundle inputBundle,
int nodeIndex) |
static void |
CrunchOutputs.addNamedOutput(org.apache.hadoop.mapreduce.Job job,
String name,
FormatBundle<? extends org.apache.hadoop.mapreduce.OutputFormat> outputBundle,
Class keyClass,
Class valueClass) |
Constructor and Description |
---|
OutputConfig(FormatBundle<org.apache.hadoop.mapreduce.OutputFormat<K,V>> bundle,
Class<K> keyClass,
Class<V> valueClass) |
Modifier and Type | Method and Description |
---|---|
void |
AvroMode.configure(FormatBundle bundle)
Populates the
bundle with mode specific settings for the specific FormatBundle . |
Copyright © 2016 The Apache Software Foundation. All rights reserved.