This project has retired. For details please refer to its Attic page.
Overview (Apache Crunch 0.9.0 API)

Apache Crunch 0.9.0 API

Core
org.apache.crunch Client-facing API and core abstractions.
org.apache.crunch.fn Commonly used functions for manipulating collections.
org.apache.crunch.impl  
org.apache.crunch.impl.mem In-memory Pipeline implementation for rapid prototyping and testing.
org.apache.crunch.impl.mr A Pipeline implementation that runs on Hadoop MapReduce.
org.apache.crunch.io Data input and output for Pipelines.
org.apache.crunch.io.avro  
org.apache.crunch.io.avro.trevni  
org.apache.crunch.io.parquet  
org.apache.crunch.io.seq  
org.apache.crunch.io.text  
org.apache.crunch.materialize  
org.apache.crunch.materialize.pobject  
org.apache.crunch.test Utilities for testing Crunch-based applications.
org.apache.crunch.types Common functionality for business object serialization.
org.apache.crunch.types.avro Business object serialization using Apache Avro.
org.apache.crunch.types.writable Business object serialization using Hadoop's Writables framework.
org.apache.crunch.util An assorted set of utilities.

 
HBase
org.apache.crunch.io.hbase  

 
Spark
org.apache.crunch.impl.spark  

 
Crunch Patterns
org.apache.crunch.lib Joining, sorting, aggregating, and other commonly used functionality.
org.apache.crunch.lib.join Inner and outer joins on collections.
org.apache.crunch.lib.sort  

 
User-contributed Functionality
org.apache.crunch.contrib User contributions that may be interesting for special applications.
org.apache.crunch.contrib.bloomfilter Support for creating Bloom Filters.
org.apache.crunch.contrib.io.jdbc Support for reading data from RDBMS using JDBC
org.apache.crunch.contrib.text  

 
Examples
org.apache.crunch.examples Example applications demonstrating various aspects of Crunch.

 
Other Packages
org.apache.crunch.impl.dist  
org.apache.crunch.impl.dist.collect  
org.apache.crunch.impl.mem.collect  
org.apache.crunch.impl.mem.emit  
org.apache.crunch.impl.mr.collect  
org.apache.crunch.impl.mr.emit  
org.apache.crunch.impl.mr.exec  
org.apache.crunch.impl.mr.plan  
org.apache.crunch.impl.mr.run  
org.apache.crunch.impl.spark.collect  
org.apache.crunch.impl.spark.fn  
org.apache.crunch.impl.spark.serde  
org.apache.crunch.io.impl  

 



Copyright © 2014 The Apache Software Foundation. All Rights Reserved.