org.apache.crunch.io

Class Compress

java.lang.Object

org.apache.crunch.io.Compress

public class Compress
extends Object

Helper functions for compressing output data.

Constructor Summary

Constructors

Constructor and Description
Compress()

Method Summary

Modifier and Type	Method and Description
static <T extends Target> T	compress(T target, Class<? extends org.apache.hadoop.io.compress.CompressionCodec> codecClass) Configure the given output target to be compressed using the given codec.
static <T extends Target> T	gzip(T target) Configure the given output target to be compressed using Gzip.
static <T extends Target> T	snappy(T target) Configure the given output target to be compressed using Snappy.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Compress

public Compress()

Method Detail

compress

public static <T extends Target> T compress(T target,
                                            Class<? extends org.apache.hadoop.io.compress.CompressionCodec> codecClass)

Configure the given output target to be compressed using the given codec.

gzip

public static <T extends Target> T gzip(T target)

Configure the given output target to be compressed using Gzip.

snappy

public static <T extends Target> T snappy(T target)

Configure the given output target to be compressed using Snappy. If the Target is one of the AvroParquet targets contained in Crunch, the Parquet-specific SnappyCodec will be used instead of the default Hadoop one.