This project has retired. For details please refer to its Attic page.

Uses of Interface
org.apache.crunch.Source

Packages that use Source

org.apache.crunch	Client-facing API and core abstractions.
org.apache.crunch.contrib.io.jdbc	Support for reading data from RDBMS using JDBC
org.apache.crunch.impl.dist
org.apache.crunch.impl.dist.collect
org.apache.crunch.impl.mem	In-memory Pipeline implementation for rapid prototyping and testing.
org.apache.crunch.impl.mr.collect
org.apache.crunch.impl.mr.plan
org.apache.crunch.impl.spark.collect
org.apache.crunch.io	Data input and output for Pipelines.
org.apache.crunch.io.avro
org.apache.crunch.io.avro.trevni
org.apache.crunch.io.hbase
org.apache.crunch.io.impl
org.apache.crunch.io.parquet
org.apache.crunch.io.seq
org.apache.crunch.io.text
org.apache.crunch.util	An assorted set of utilities.

Uses of Source in org.apache.crunch

Subinterfaces of Source in org.apache.crunch

interface	SourceTarget<T> An interface for classes that implement both the Source and the Target interfaces.
interface	TableSource<K,V> The interface Source implementations that return a PTable.
interface	TableSourceTarget<K,V> An interface for classes that implement both the TableSource and the Target interfaces.

Methods in org.apache.crunch that return Source

Source<T>

Source.inputConf(String key, String value) Adds the given key-value pair to the Configuration instance that is used to read this Source<T></T>.

Methods in org.apache.crunch with parameters of type Source

<T> PCollection<T>	Pipeline.read(Source<T> source) Converts the given Source into a PCollection that is available to jobs run using this Pipeline instance.
ParallelDoOptions.Builder	ParallelDoOptions.Builder.sources(Source<?>... sources)

Method parameters in org.apache.crunch with type arguments of type Source

ParallelDoOptions.Builder

ParallelDoOptions.Builder.sources(Collection<Source<?>> sources)

Uses of Source in org.apache.crunch.contrib.io.jdbc

Classes in org.apache.crunch.contrib.io.jdbc that implement Source

class

DataBaseSource<T extends DBWritable & Writable> Source from reading from a database via a JDBC connection.

Uses of Source in org.apache.crunch.impl.dist

Methods in org.apache.crunch.impl.dist with parameters of type Source

<S> PCollection<S>

DistributedPipeline.read(Source<S> source)

Uses of Source in org.apache.crunch.impl.dist.collect

Fields in org.apache.crunch.impl.dist.collect declared as Source

protected Source<S>

BaseInputCollection.source

Methods in org.apache.crunch.impl.dist.collect that return Source

Source<S>

BaseInputCollection.getSource()

Methods in org.apache.crunch.impl.dist.collect with parameters of type Source

<S> BaseInputCollection<S>

PCollectionFactory.createInputCollection(Source<S> source, DistributedPipeline distributedPipeline)

Constructors in org.apache.crunch.impl.dist.collect with parameters of type Source

BaseInputCollection(Source<S> source, DistributedPipeline pipeline)

Uses of Source in org.apache.crunch.impl.mem

Methods in org.apache.crunch.impl.mem with parameters of type Source

<T> PCollection<T>

MemPipeline.read(Source<T> source)

Uses of Source in org.apache.crunch.impl.mr.collect

Methods in org.apache.crunch.impl.mr.collect with parameters of type Source

<S> BaseInputCollection<S>

MRCollectionFactory.createInputCollection(Source<S> source, DistributedPipeline pipeline)

Constructors in org.apache.crunch.impl.mr.collect with parameters of type Source

InputCollection(Source<S> source, MRPipeline pipeline)

Uses of Source in org.apache.crunch.impl.mr.plan

Methods in org.apache.crunch.impl.mr.plan that return Source

Source<?>

DoNode.getSource()

Methods in org.apache.crunch.impl.mr.plan with parameters of type Source

static <S> DoNode

DoNode.createInputNode(Source<S> source)

Uses of Source in org.apache.crunch.impl.spark.collect

Methods in org.apache.crunch.impl.spark.collect with parameters of type Source

<S> BaseInputCollection<S>

SparkCollectFactory.createInputCollection(Source<S> source, DistributedPipeline pipeline)

Uses of Source in org.apache.crunch.io

Subinterfaces of Source in org.apache.crunch.io

interface	ReadableSource<T> An extension of the Source interface that indicates that a Source instance may be read as a series of records by the client code.
interface	ReadableSourceTarget<T> An interface that indicates that a SourceTarget instance can be read into the local client.

Methods in org.apache.crunch.io that return Source

static <T> Source<T>	From.avroFile(org.apache.hadoop.fs.Path path, AvroType<T> avroType) Creates a Source<T> instance from the Avro file(s) at the given Path.
static <T extends org.apache.avro.specific.SpecificRecord> Source<T>	From.avroFile(org.apache.hadoop.fs.Path path, Class<T> avroClass) Creates a Source<T> instance from the Avro file(s) at the given Path.
static <T> Source<T>	From.avroFile(String pathName, AvroType<T> avroType) Creates a Source<T> instance from the Avro file(s) at the given path name.
static <T extends org.apache.avro.specific.SpecificRecord> Source<T>	From.avroFile(String pathName, Class<T> avroClass) Creates a Source<T> instance from the Avro file(s) at the given path name.
static <T extends org.apache.hadoop.io.Writable> Source<T>	From.sequenceFile(org.apache.hadoop.fs.Path path, Class<T> valueClass) Creates a Source<T> instance from the SequenceFile(s) at the given Path from the value field of each key-value pair in the SequenceFile(s).
static <T> Source<T>	From.sequenceFile(org.apache.hadoop.fs.Path path, PType<T> ptype) Creates a Source<T> instance from the SequenceFile(s) at the given Path from the value field of each key-value pair in the SequenceFile(s).
static <T extends org.apache.hadoop.io.Writable> Source<T>	From.sequenceFile(String pathName, Class<T> valueClass) Creates a Source<T> instance from the SequenceFile(s) at the given path name from the value field of each key-value pair in the SequenceFile(s).
static <T> Source<T>	From.sequenceFile(String pathName, PType<T> ptype) Creates a Source<T> instance from the SequenceFile(s) at the given path name from the value field of each key-value pair in the SequenceFile(s).
static Source<String>	From.textFile(org.apache.hadoop.fs.Path path) Creates a Source<String> instance for the text file(s) at the given Path.
static <T> Source<T>	From.textFile(org.apache.hadoop.fs.Path path, PType<T> ptype) Creates a Source<T> instance for the text file(s) at the given Path using the provided PType<T> to convert the input text.
static Source<String>	From.textFile(String pathName) Creates a Source<String> instance for the text file(s) at the given path name.
static <T> Source<T>	From.textFile(String pathName, PType<T> ptype) Creates a Source<T> instance for the text file(s) at the given path name using the provided PType<T> to convert the input text.

Uses of Source in org.apache.crunch.io.avro

Classes in org.apache.crunch.io.avro that implement Source

class	AvroFileSource<T>
class	AvroFileSourceTarget<T>

Uses of Source in org.apache.crunch.io.avro.trevni

Classes in org.apache.crunch.io.avro.trevni that implement Source

class	TrevniKeySource<T>
class	TrevniKeySourceTarget<T>

Uses of Source in org.apache.crunch.io.hbase

Classes in org.apache.crunch.io.hbase that implement Source

class	HBaseSourceTarget
class	HFileSource

Methods in org.apache.crunch.io.hbase that return Source

static Source<org.apache.hadoop.hbase.KeyValue>	FromHBase.hfile(org.apache.hadoop.fs.Path path)
static Source<org.apache.hadoop.hbase.KeyValue>	FromHBase.hfile(String path)
Source<Pair<org.apache.hadoop.hbase.io.ImmutableBytesWritable,org.apache.hadoop.hbase.client.Result>>	HBaseSourceTarget.inputConf(String key, String value)

Uses of Source in org.apache.crunch.io.impl

Classes in org.apache.crunch.io.impl that implement Source

class	FileSourceImpl<T>
class	FileTableSourceImpl<K,V>
class	ReadableSourcePathTargetImpl<T>
class	ReadableSourceTargetImpl<T>
class	SourcePathTargetImpl<T>
class	TableSourcePathTargetImpl<K,V>
class	TableSourceTargetImpl<K,V>

Methods in org.apache.crunch.io.impl that return Source

Source<T>

FileSourceImpl.inputConf(String key, String value)

Constructors in org.apache.crunch.io.impl with parameters of type Source

SourcePathTargetImpl(Source<T> source, PathTarget target, FileNamingScheme fileNamingScheme)

Uses of Source in org.apache.crunch.io.parquet

Classes in org.apache.crunch.io.parquet that implement Source

class	AvroParquetFileSource<T extends IndexedRecord>
class	AvroParquetFileSourceTarget<T extends IndexedRecord>

Uses of Source in org.apache.crunch.io.seq

Classes in org.apache.crunch.io.seq that implement Source

class	SeqFileSource<T>
class	SeqFileSourceTarget<T>
class	SeqFileTableSource<K,V> A TableSource that uses SequenceFileInputFormat to read the input file.
class	SeqFileTableSourceTarget<K,V>

Uses of Source in org.apache.crunch.io.text

Classes in org.apache.crunch.io.text that implement Source

class	NLineFileSource<T> A Source instance that uses the NLineInputFormat, which gives each map task a fraction of the lines in a text file as input.
class	TextFileSource<T>
class	TextFileSourceTarget<T>
class	TextFileTableSource<K,V> A Source that uses the KeyValueTextInputFormat to process input text.
class	TextFileTableSourceTarget<K,V> A TableSource and SourceTarget implementation that uses the KeyValueTextInputFormat and TextOutputFormat to support reading and writing text files as PTable instances using a tab separator for the keys and the values.

Uses of Source in org.apache.crunch.util

Methods in org.apache.crunch.util with parameters of type Source

<T> PCollection<T>

CrunchTool.read(Source<T> source)