org.apache.crunch.io

Interface PathTarget

All Superinterfaces:

MapReduceTarget, Target

public interface PathTarget
extends MapReduceTarget

A target whose output goes to a given path on a file system.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.crunch.Target

Target.WriteMode

Method Summary

Methods

Modifier and Type	Method and Description
FileNamingScheme	getFileNamingScheme() Get the naming scheme to be used for outputs being written to an output path.
org.apache.hadoop.fs.Path	getPath()
void	handleOutputs(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path workingPath, int index) Handles moving the output data for this target from a temporary location on the filesystem to its target path at the end of a MapReduce job.

Methods inherited from interface org.apache.crunch.io.MapReduceTarget

configureForMapReduce

Methods inherited from interface org.apache.crunch.Target

accept, asSourceTarget, getConverter, handleExisting, outputConf

Method Detail

getPath

org.apache.hadoop.fs.Path getPath()

getFileNamingScheme

FileNamingScheme getFileNamingScheme()

Get the naming scheme to be used for outputs being written to an output path.

Returns:

the naming scheme to be used

handleOutputs

void handleOutputs(org.apache.hadoop.conf.Configuration conf,
                 org.apache.hadoop.fs.Path workingPath,
                 int index)
                   throws IOException

Handles moving the output data for this target from a temporary location on the filesystem to its target path at the end of a MapReduce job.

Parameters:

conf - The job Configuration

workingPath - The temp directory that contains the output of the job

index - The index of this target for jobs that write multiple output files to a single directory

Throws:

IOException