| Package | Description | 
|---|---|
| org.apache.crunch.io | Data input and output for Pipelines. | 
| org.apache.crunch.kafka.inputformat | |
| org.apache.crunch.types.avro | Business object serialization using Apache Avro. | 
| Modifier and Type | Field and Description | 
|---|---|
| FormatBundle<org.apache.hadoop.mapreduce.OutputFormat<K,V>> | CrunchOutputs.OutputConfig. bundle | 
| Modifier and Type | Method and Description | 
|---|---|
| static <T extends org.apache.hadoop.mapreduce.InputFormat<?,?>> | FormatBundle. forInput(Class<T> inputFormatClass) | 
| static <T extends org.apache.hadoop.mapreduce.OutputFormat<?,?>> | FormatBundle. forOutput(Class<T> outputFormatClass) | 
| static <T> FormatBundle<T> | FormatBundle. fromSerialized(String serialized,
              org.apache.hadoop.conf.Configuration conf) | 
| FormatBundle<K> | FormatBundle. set(String key,
   String value) | 
| Modifier and Type | Method and Description | 
|---|---|
| static Map<FormatBundle,Map<Integer,List<org.apache.hadoop.fs.Path>>> | CrunchInputs. getFormatNodeMap(org.apache.hadoop.mapreduce.JobContext job) | 
| Modifier and Type | Method and Description | 
|---|---|
| static void | CrunchInputs. addInputPath(org.apache.hadoop.mapreduce.Job job,
            org.apache.hadoop.fs.Path path,
            FormatBundle inputBundle,
            int nodeIndex) | 
| static void | CrunchInputs. addInputPaths(org.apache.hadoop.mapreduce.Job job,
             Collection<org.apache.hadoop.fs.Path> paths,
             FormatBundle inputBundle,
             int nodeIndex) | 
| static void | CrunchOutputs. addNamedOutput(org.apache.hadoop.mapreduce.Job job,
              String name,
              FormatBundle<? extends org.apache.hadoop.mapreduce.OutputFormat> outputBundle,
              Class keyClass,
              Class valueClass) | 
| Constructor and Description | 
|---|
| OutputConfig(FormatBundle<org.apache.hadoop.mapreduce.OutputFormat<K,V>> bundle,
            Class<K> keyClass,
            Class<V> valueClass) | 
| Modifier and Type | Method and Description | 
|---|---|
| static void | KafkaInputFormat. writeConnectionPropertiesToBundle(Properties connectionProperties,
                                 FormatBundle bundle)Writes the Kafka connection properties to the  bundle. | 
| static void | KafkaInputFormat. writeOffsetsToBundle(Map<org.apache.kafka.common.TopicPartition,Pair<Long,Long>> offsets,
                    FormatBundle bundle)Writes the start and end offsets for the provided topic partitions to the  bundle. | 
| Modifier and Type | Method and Description | 
|---|---|
| void | AvroMode. configure(FormatBundle bundle)Populates the  bundlewith mode specific settings for the specificFormatBundle. | 
Copyright © 2017 The Apache Software Foundation. All rights reserved.