Uses of Interface org.apache.crunch.Source (Apache Crunch 0.7.0 API)

This project has retired. For details please refer to its Attic page.

Overview

Package

Class

Use

Tree

Deprecated

Index

PREV NEXT

FRAMES NO FRAMES

Uses of Interface
org.apache.crunch.Source

Packages that use Source
org.apache.crunch	Client-facing API and core abstractions.
org.apache.crunch.contrib.io.jdbc	Support for reading data from RDBMS using JDBC
org.apache.crunch.impl.mem	In-memory Pipeline implementation for rapid prototyping and testing.
org.apache.crunch.impl.mr	A Pipeline implementation that runs on Hadoop MapReduce.
org.apache.crunch.io	Data input and output for Pipelines.
org.apache.crunch.util	An assorted set of utilities.

Uses of Source in org.apache.crunch

Subinterfaces of Source in org.apache.crunch

interface SourceTarget<T>
          An interface for classes that implement both the Source and the Target interfaces.

interface TableSource<K,V>
          The interface Source implementations that return a PTable.

interface TableSourceTarget<K,V>
          An interface for classes that implement both the TableSource and the Target interfaces.

Subinterfaces of Source in org.apache.crunch
`interface`	`SourceTarget<T>` An interface for classes that implement both the `Source` and the `Target` interfaces.
`interface`	`TableSource<K,V>` The interface `Source` implementations that return a `PTable`.
`interface`	`TableSourceTarget<K,V>` An interface for classes that implement both the `TableSource` and the `Target` interfaces.

Methods in org.apache.crunch with parameters of type Source

<T> PCollection<T> Pipeline.read(Source<T> source)
Converts the given Source into a PCollection that is available to jobs run using this Pipeline instance.

Uses of Source in org.apache.crunch.contrib.io.jdbc

Classes in org.apache.crunch.contrib.io.jdbc that implement Source

class DataBaseSource<T extends DBWritable & Writable>
Source from reading from a database via a JDBC connection.

Classes in org.apache.crunch.contrib.io.jdbc that implement Source
`class`	`DataBaseSource<T extends DBWritable & Writable>` Source from reading from a database via a JDBC connection.

Uses of Source in org.apache.crunch.impl.mem

Methods in org.apache.crunch.impl.mem with parameters of type Source

<T> PCollection<T> MemPipeline.read(Source<T> source)

Uses of Source in org.apache.crunch.impl.mr

Methods in org.apache.crunch.impl.mr with parameters of type Source

<S> PCollection<S> MRPipeline.read(Source<S> source)

Uses of Source in org.apache.crunch.io

Subinterfaces of Source in org.apache.crunch.io

interface ReadableSource<T>
An extension of the Source interface that indicates that a Source instance may be read as a series of records by the client code.

interface ReadableSourceTarget<T>
An interface that indicates that a SourceTarget instance can be read into the local client.

Subinterfaces of Source in org.apache.crunch.io
`interface`	`ReadableSource<T>` An extension of the `Source` interface that indicates that a `Source` instance may be read as a series of records by the client code.
`interface`	`ReadableSourceTarget<T>` An interface that indicates that a `SourceTarget` instance can be read into the local client.

Methods in org.apache.crunch.io that return Source

static <T> Source<T> From.avroFile(org.apache.hadoop.fs.Path path, AvroType<T> avroType)
          Creates a Source<T> instance from the Avro file(s) at the given Path.

static <T extends org.apache.avro.specific.SpecificRecord> Source<T> From.avroFile(org.apache.hadoop.fs.Path path, Class<T> avroClass)
          Creates a Source<T> instance from the Avro file(s) at the given Path.

static <T> Source<T> From.avroFile(String pathName, AvroType<T> avroType)
          Creates a Source<T> instance from the Avro file(s) at the given path name.

static <T extends org.apache.avro.specific.SpecificRecord> Source<T> From.avroFile(String pathName, Class<T> avroClass)
          Creates a Source<T> instance from the Avro file(s) at the given path name.

static <T extends org.apache.hadoop.io.Writable> Source<T> From.sequenceFile(org.apache.hadoop.fs.Path path, Class<T> valueClass)
          Creates a Source<T> instance from the SequenceFile(s) at the given Path from the value field of each key-value pair in the SequenceFile(s).

static <T> Source<T> From.sequenceFile(org.apache.hadoop.fs.Path path, PType<T> ptype)
          Creates a Source<T> instance from the SequenceFile(s) at the given Path from the value field of each key-value pair in the SequenceFile(s).

static <T extends org.apache.hadoop.io.Writable> Source<T> From.sequenceFile(String pathName, Class<T> valueClass)
          Creates a Source<T> instance from the SequenceFile(s) at the given path name from the value field of each key-value pair in the SequenceFile(s).

static <T> Source<T> From.sequenceFile(String pathName, PType<T> ptype)
          Creates a Source<T> instance from the SequenceFile(s) at the given path name from the value field of each key-value pair in the SequenceFile(s).

static Source<String> From.textFile(org.apache.hadoop.fs.Path path)
          Creates a Source<String> instance for the text file(s) at the given Path.

static <T> Source<T> From.textFile(org.apache.hadoop.fs.Path path, PType<T> ptype)
          Creates a Source<T> instance for the text file(s) at the given Path using the provided PType<T> to convert the input text.

static Source<String> From.textFile(String pathName)
          Creates a Source<String> instance for the text file(s) at the given path name.

static <T> Source<T> From.textFile(String pathName, PType<T> ptype)
          Creates a Source<T> instance for the text file(s) at the given path name using the provided PType<T> to convert the input text.

Uses of Source in org.apache.crunch.util

Methods in org.apache.crunch.util with parameters of type Source

<T> PCollection<T> CrunchTool.read(Source<T> source)