This project has retired. For details please refer to its Attic page.

Uses of Interface
org.apache.crunch.Target

Packages that use Target

org.apache.crunch	Client-facing API and core abstractions.
org.apache.crunch.impl.dist
org.apache.crunch.impl.dist.collect
org.apache.crunch.impl.mem	In-memory Pipeline implementation for rapid prototyping and testing.
org.apache.crunch.impl.mem.collect
org.apache.crunch.impl.mr.exec
org.apache.crunch.impl.mr.plan
org.apache.crunch.impl.spark
org.apache.crunch.io	Data input and output for Pipelines.
org.apache.crunch.io.avro
org.apache.crunch.io.avro.trevni
org.apache.crunch.io.hbase
org.apache.crunch.io.impl
org.apache.crunch.io.parquet
org.apache.crunch.io.seq
org.apache.crunch.io.text
org.apache.crunch.util	An assorted set of utilities.

Uses of Target in org.apache.crunch

Subinterfaces of Target in org.apache.crunch

interface	SourceTarget<T> An interface for classes that implement both the Source and the Target interfaces.
interface	TableSourceTarget<K,V> An interface for classes that implement both the TableSource and the Target interfaces.

Methods in org.apache.crunch that return Target

Target

Target.outputConf(String key, String value) Adds the given key-value pair to the Configuration instance that is used to write this Target.

Methods in org.apache.crunch with parameters of type Target

void	Pipeline.write(PCollection<?> collection, Target target) Write the given collection to the given target on the next pipeline run.
void	Pipeline.write(PCollection<?> collection, Target target, Target.WriteMode writeMode) Write the contents of the PCollection to the given Target, using the storage format specified by the target and the given WriteMode for cases where the referenced Target already exists.
PTable<K,V>	PTable.write(Target target) Writes this PTable to the given Target.
PCollection<S>	PCollection.write(Target target) Write the contents of this PCollection to the given Target, using the storage format specified by the target.
PTable<K,V>	PTable.write(Target target, Target.WriteMode writeMode) Writes this PTable to the given Target, using the given Target.WriteMode to handle existing targets.
PCollection<S>	PCollection.write(Target target, Target.WriteMode writeMode) Write the contents of this PCollection to the given Target, using the given Target.WriteMode to handle existing targets.

Uses of Target in org.apache.crunch.impl.dist

Fields in org.apache.crunch.impl.dist with type parameters of type Target

protected Map<PCollectionImpl<?>,Set<Target>>

DistributedPipeline.outputTargets

Methods in org.apache.crunch.impl.dist with parameters of type Target

void	DistributedPipeline.write(PCollection<?> pcollection, Target target)
void	DistributedPipeline.write(PCollection<?> pcollection, Target target, Target.WriteMode writeMode)

Uses of Target in org.apache.crunch.impl.dist.collect

Methods in org.apache.crunch.impl.dist.collect with parameters of type Target

PTable<K,V>	PTableBase.write(Target target)
PCollection<S>	PCollectionImpl.write(Target target)
PTable<K,V>	PTableBase.write(Target target, Target.WriteMode writeMode)
PCollection<S>	PCollectionImpl.write(Target target, Target.WriteMode writeMode)

Uses of Target in org.apache.crunch.impl.mem

Methods in org.apache.crunch.impl.mem with parameters of type Target

void	MemPipeline.write(PCollection<?> collection, Target target)
void	MemPipeline.write(PCollection<?> collection, Target target, Target.WriteMode writeMode)

Uses of Target in org.apache.crunch.impl.mem.collect

Methods in org.apache.crunch.impl.mem.collect with parameters of type Target

PTable<K,V>	MemTable.write(Target target)
PCollection<S>	MemCollection.write(Target target)
PTable<K,V>	MemTable.write(Target target, Target.WriteMode writeMode)
PCollection<S>	MemCollection.write(Target target, Target.WriteMode writeMode)

Uses of Target in org.apache.crunch.impl.mr.exec

Constructor parameters in org.apache.crunch.impl.mr.exec with type arguments of type Target

MRExecutor(org.apache.hadoop.conf.Configuration conf, Class<?> jarClass, Map<PCollectionImpl<?>,Set<Target>> outputTargets, Map<PCollectionImpl<?>,MaterializableIterable> toMaterialize)

Uses of Target in org.apache.crunch.impl.mr.plan

Methods in org.apache.crunch.impl.mr.plan with parameters of type Target

boolean	MSCROutputHandler.configure(Target target, PType<?> ptype)
void	MSCROutputHandler.configureNode(DoNode node, Target target)

Constructor parameters in org.apache.crunch.impl.mr.plan with type arguments of type Target

MSCRPlanner(MRPipeline pipeline, Map<PCollectionImpl<?>,Set<Target>> outputs, Map<PCollectionImpl<?>,MaterializableIterable> toMaterialize)

Uses of Target in org.apache.crunch.impl.spark

Constructor parameters in org.apache.crunch.impl.spark with type arguments of type Target

SparkRuntime(SparkPipeline pipeline, org.apache.spark.api.java.JavaSparkContext sparkContext, org.apache.hadoop.conf.Configuration conf, Map<PCollectionImpl<?>,Set<Target>> outputTargets, Map<PCollectionImpl<?>,MaterializableIterable> toMaterialize, Map<PCollection<?>,org.apache.spark.storage.StorageLevel> toCache)

Uses of Target in org.apache.crunch.io

Subinterfaces of Target in org.apache.crunch.io

interface	MapReduceTarget
interface	PathTarget A target whose output goes to a given path on a file system.
interface	ReadableSourceTarget<T> An interface that indicates that a SourceTarget instance can be read into the local client.

Methods in org.apache.crunch.io that return Target

static Target	To.avroFile(org.apache.hadoop.fs.Path path) Creates a Target at the given Path that writes data to Avro files.
static Target	To.avroFile(String pathName) Creates a Target at the given path name that writes data to Avro files.
static <K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable> Target	To.formattedFile(org.apache.hadoop.fs.Path path, Class<? extends org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<K,V>> formatClass) Creates a Target at the given Path that writes data to a custom FileOutputFormat.
static <K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable> Target	To.formattedFile(String pathName, Class<? extends org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<K,V>> formatClass) Creates a Target at the given path name that writes data to a custom FileOutputFormat.
static Target	To.sequenceFile(org.apache.hadoop.fs.Path path) Creates a Target at the given Path that writes data to SequenceFiles.
static Target	To.sequenceFile(String pathName) Creates a Target at the given path name that writes data to SequenceFiles.
static Target	To.textFile(org.apache.hadoop.fs.Path path) Creates a Target at the given Path that writes data to text files.
static Target	To.textFile(String pathName) Creates a Target at the given path name that writes data to text files.

Methods in org.apache.crunch.io with parameters of type Target

boolean

OutputHandler.configure(Target target, PType<?> ptype)

Uses of Target in org.apache.crunch.io.avro

Classes in org.apache.crunch.io.avro that implement Target

class	AvroFileSourceTarget<T>
class	AvroFileTarget
class	AvroPathPerKeyTarget A Target that wraps AvroPathPerKeyOutputFormat to allow one file per key to be written as the output of a PTable<String, T>.

Uses of Target in org.apache.crunch.io.avro.trevni

Classes in org.apache.crunch.io.avro.trevni that implement Target

class	TrevniKeySourceTarget<T>
class	TrevniKeyTarget

Uses of Target in org.apache.crunch.io.hbase

Classes in org.apache.crunch.io.hbase that implement Target

class	HBaseSourceTarget
class	HBaseTarget
class	HFileTarget

Methods in org.apache.crunch.io.hbase that return Target

static Target	ToHBase.hfile(org.apache.hadoop.fs.Path path)
static Target	ToHBase.hfile(String path)
Target	HBaseTarget.outputConf(String key, String value)
static Target	ToHBase.table(String table)

Uses of Target in org.apache.crunch.io.impl

Classes in org.apache.crunch.io.impl that implement Target

class	FileTargetImpl
class	ReadableSourcePathTargetImpl<T>
class	ReadableSourceTargetImpl<T>
class	SourcePathTargetImpl<T>
class	TableSourcePathTargetImpl<K,V>
class	TableSourceTargetImpl<K,V>

Methods in org.apache.crunch.io.impl that return Target

Target

FileTargetImpl.outputConf(String key, String value)

Constructors in org.apache.crunch.io.impl with parameters of type Target

ReadableSourceTargetImpl(ReadableSource<T> source, Target target)

TableSourceTargetImpl(TableSource<K,V> source, Target target)

Uses of Target in org.apache.crunch.io.parquet

Classes in org.apache.crunch.io.parquet that implement Target

class	AvroParquetFileSourceTarget<T extends IndexedRecord>
class	AvroParquetFileTarget

Uses of Target in org.apache.crunch.io.seq

Classes in org.apache.crunch.io.seq that implement Target

class	SeqFileSourceTarget<T>
class	SeqFileTableSourceTarget<K,V>
class	SeqFileTarget

Uses of Target in org.apache.crunch.io.text

Classes in org.apache.crunch.io.text that implement Target

class	TextFileSourceTarget<T>
class	TextFileTableSourceTarget<K,V> A TableSource and SourceTarget implementation that uses the KeyValueTextInputFormat and TextOutputFormat to support reading and writing text files as PTable instances using a tab separator for the keys and the values.
class	TextFileTarget

Uses of Target in org.apache.crunch.util

Methods in org.apache.crunch.util with parameters of type Target

void	CrunchTool.write(PCollection<?> pcollection, Target target)