org.apache.crunch.io

Class SourceTargetHelper

java.lang.Object

org.apache.crunch.io.SourceTargetHelper

public class SourceTargetHelper
extends Object

Functions for configuring the inputs/outputs of MapReduce jobs.

Constructor Summary

Constructors

Constructor and Description
SourceTargetHelper()

Method Summary

Modifier and Type	Method and Description
static long	getLastModifiedAt(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path)
static long	getPathSize(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path path)
static long	getPathSize(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SourceTargetHelper

public SourceTargetHelper()

Method Detail

getPathSize

public static long getPathSize(org.apache.hadoop.conf.Configuration conf,
                               org.apache.hadoop.fs.Path path)
                        throws IOException

Throws:

IOException

getPathSize

public static long getPathSize(org.apache.hadoop.fs.FileSystem fs,
                               org.apache.hadoop.fs.Path path)
                        throws IOException

Throws:

IOException

getLastModifiedAt

public static long getLastModifiedAt(org.apache.hadoop.fs.FileSystem fs,
                                     org.apache.hadoop.fs.Path path)
                              throws IOException

Throws:

IOException