This project has retired. For details please refer to its Attic page.

Uses of Interface
org.apache.crunch.Source

Packages that use Source

org.apache.crunch	Client-facing API and core abstractions.
org.apache.crunch.contrib.io.jdbc	Support for reading data from RDBMS using JDBC
org.apache.crunch.impl.mem	In-memory Pipeline implementation for rapid prototyping and testing.
org.apache.crunch.impl.mr	A Pipeline implementation that runs on Hadoop MapReduce.
org.apache.crunch.io	Data input and output for Pipelines.
org.apache.crunch.io.impl
org.apache.crunch.util	An assorted set of utilities.

Uses of Source in org.apache.crunch

Subinterfaces of Source in org.apache.crunch

interface	SourceTarget<T> An interface for classes that implement both the Source and the Target interfaces.
interface	TableSource<K,V> The interface Source implementations that return a PTable.
interface	TableSourceTarget<K,V> An interface for classes that implement both the TableSource and the Target interfaces.

Methods in org.apache.crunch that return Source

Source<T>

Source.inputConf(String key, String value) Adds the given key-value pair to the Configuration instance that is used to read this Source<T></T>.

Methods in org.apache.crunch with parameters of type Source

<T> PCollection<T>	Pipeline.read(Source<T> source) Converts the given Source into a PCollection that is available to jobs run using this Pipeline instance.
ParallelDoOptions.Builder	ParallelDoOptions.Builder.sources(Source<?>... sources)

Method parameters in org.apache.crunch with type arguments of type Source

ParallelDoOptions.Builder

ParallelDoOptions.Builder.sources(Collection<Source<?>> sources)

Uses of Source in org.apache.crunch.contrib.io.jdbc

Classes in org.apache.crunch.contrib.io.jdbc that implement Source

class

DataBaseSource<T extends DBWritable & Writable> Source from reading from a database via a JDBC connection.

Uses of Source in org.apache.crunch.impl.mem

Methods in org.apache.crunch.impl.mem with parameters of type Source

<T> PCollection<T>

MemPipeline.read(Source<T> source)

Uses of Source in org.apache.crunch.impl.mr

Methods in org.apache.crunch.impl.mr with parameters of type Source

<S> PCollection<S>

MRPipeline.read(Source<S> source)

Uses of Source in org.apache.crunch.io

Subinterfaces of Source in org.apache.crunch.io

interface	ReadableSource<T> An extension of the Source interface that indicates that a Source instance may be read as a series of records by the client code.
interface	ReadableSourceTarget<T> An interface that indicates that a SourceTarget instance can be read into the local client.

Methods in org.apache.crunch.io that return Source

static <T> Source<T>	From.avroFile(org.apache.hadoop.fs.Path path, AvroType<T> avroType) Creates a Source<T> instance from the Avro file(s) at the given Path.
static <T extends org.apache.avro.specific.SpecificRecord> Source<T>	From.avroFile(org.apache.hadoop.fs.Path path, Class<T> avroClass) Creates a Source<T> instance from the Avro file(s) at the given Path.
static <T> Source<T>	From.avroFile(String pathName, AvroType<T> avroType) Creates a Source<T> instance from the Avro file(s) at the given path name.
static <T extends org.apache.avro.specific.SpecificRecord> Source<T>	From.avroFile(String pathName, Class<T> avroClass) Creates a Source<T> instance from the Avro file(s) at the given path name.
static <T extends org.apache.hadoop.io.Writable> Source<T>	From.sequenceFile(org.apache.hadoop.fs.Path path, Class<T> valueClass) Creates a Source<T> instance from the SequenceFile(s) at the given Path from the value field of each key-value pair in the SequenceFile(s).
static <T> Source<T>	From.sequenceFile(org.apache.hadoop.fs.Path path, PType<T> ptype) Creates a Source<T> instance from the SequenceFile(s) at the given Path from the value field of each key-value pair in the SequenceFile(s).
static <T extends org.apache.hadoop.io.Writable> Source<T>	From.sequenceFile(String pathName, Class<T> valueClass) Creates a Source<T> instance from the SequenceFile(s) at the given path name from the value field of each key-value pair in the SequenceFile(s).
static <T> Source<T>	From.sequenceFile(String pathName, PType<T> ptype) Creates a Source<T> instance from the SequenceFile(s) at the given path name from the value field of each key-value pair in the SequenceFile(s).
static Source<String>	From.textFile(org.apache.hadoop.fs.Path path) Creates a Source<String> instance for the text file(s) at the given Path.
static <T> Source<T>	From.textFile(org.apache.hadoop.fs.Path path, PType<T> ptype) Creates a Source<T> instance for the text file(s) at the given Path using the provided PType<T> to convert the input text.
static Source<String>	From.textFile(String pathName) Creates a Source<String> instance for the text file(s) at the given path name.
static <T> Source<T>	From.textFile(String pathName, PType<T> ptype) Creates a Source<T> instance for the text file(s) at the given path name using the provided PType<T> to convert the input text.

Uses of Source in org.apache.crunch.io.impl

Classes in org.apache.crunch.io.impl that implement Source

class

org.apache.crunch.io.impl.FileSourceImpl<T>

Uses of Source in org.apache.crunch.util

Methods in org.apache.crunch.util with parameters of type Source

<T> PCollection<T>

CrunchTool.read(Source<T> source)