This project has retired. For details please refer to its Attic page.

org.apache.crunch.tool
Class CrunchTool

java.lang.Object
  org.apache.hadoop.conf.Configured
      org.apache.crunch.tool.CrunchTool

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public abstract class CrunchTool
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.util.Tool

An extension of the Tool interface that creates a Pipeline instance and provides methods for working with the Pipeline from inside of the Tool's run method.

Constructor Summary

CrunchTool()

CrunchTool(boolean inMemory)

Method Summary

void	done()
void	enableDebug()
org.apache.hadoop.conf.Configuration	getConf()
<T> PCollection<T>	read(Source<T> source)
<K,V> PTable<K,V>	read(TableSource<K,V> tableSource)
PCollection<String>	readTextFile(String pathName)
void	run()
void	setConf(org.apache.hadoop.conf.Configuration conf)
void	write(PCollection<?> pcollection, Target target)
void	writeTextFile(PCollection<?> pcollection, String pathName)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.util.Tool

run

Constructor Detail

CrunchTool

public CrunchTool()
           throws IOException

Throws:

IOException

CrunchTool

public CrunchTool(boolean inMemory)
           throws IOException

Throws:

IOException

Method Detail

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Overrides:

setConf in class org.apache.hadoop.conf.Configured

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

Overrides:

getConf in class org.apache.hadoop.conf.Configured

enableDebug

public void enableDebug()

read

public <T> PCollection<T> read(Source<T> source)

read

public <K,V> PTable<K,V> read(TableSource<K,V> tableSource)

readTextFile

public PCollection<String> readTextFile(String pathName)

write

public void write(PCollection<?> pcollection,
                  Target target)

writeTextFile

public void writeTextFile(PCollection<?> pcollection,
                          String pathName)

run

public void run()

done

public void done()