|
|||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use Source | |
---|---|
org.apache.crunch | Client-facing API and core abstractions. |
org.apache.crunch.contrib.io.jdbc | Support for reading data from RDBMS using JDBC |
org.apache.crunch.impl.mem | In-memory Pipeline implementation for rapid prototyping and testing. |
org.apache.crunch.impl.mr | A Pipeline implementation that runs on Hadoop MapReduce. |
org.apache.crunch.io | Data input and output for Pipelines. |
org.apache.crunch.util | An assorted set of utilities. |
Uses of Source in org.apache.crunch |
---|
Subinterfaces of Source in org.apache.crunch | |
---|---|
interface |
SourceTarget<T>
An interface for classes that implement both the Source and the
Target interfaces. |
interface |
TableSource<K,V>
The interface Source implementations that return a PTable . |
interface |
TableSourceTarget<K,V>
An interface for classes that implement both the TableSource and the
Target interfaces. |
Methods in org.apache.crunch with parameters of type Source | ||
---|---|---|
|
Pipeline.read(Source<T> source)
Converts the given Source into a PCollection that is
available to jobs run using this Pipeline instance. |
Uses of Source in org.apache.crunch.contrib.io.jdbc |
---|
Classes in org.apache.crunch.contrib.io.jdbc that implement Source | |
---|---|
class |
DataBaseSource<T extends DBWritable & Writable>
Source from reading from a database via a JDBC connection. |
Uses of Source in org.apache.crunch.impl.mem |
---|
Methods in org.apache.crunch.impl.mem with parameters of type Source | ||
---|---|---|
|
MemPipeline.read(Source<T> source)
|
Uses of Source in org.apache.crunch.impl.mr |
---|
Methods in org.apache.crunch.impl.mr with parameters of type Source | ||
---|---|---|
|
MRPipeline.read(Source<S> source)
|
Uses of Source in org.apache.crunch.io |
---|
Subinterfaces of Source in org.apache.crunch.io | |
---|---|
interface |
ReadableSource<T>
An extension of the Source interface that indicates that a
Source instance may be read as a series of records by the client
code. |
interface |
ReadableSourceTarget<T>
An interface that indicates that a SourceTarget instance can be read
into the local client. |
Methods in org.apache.crunch.io that return Source | ||
---|---|---|
static
|
From.avroFile(org.apache.hadoop.fs.Path path,
AvroType<T> avroType)
Creates a Source<T> instance from the Avro file(s) at the given Path . |
|
static
|
From.avroFile(org.apache.hadoop.fs.Path path,
Class<T> avroClass)
Creates a Source<T> instance from the Avro file(s) at the given Path . |
|
static
|
From.avroFile(String pathName,
AvroType<T> avroType)
Creates a Source<T> instance from the Avro file(s) at the given path name. |
|
static
|
From.avroFile(String pathName,
Class<T> avroClass)
Creates a Source<T> instance from the Avro file(s) at the given path name. |
|
static
|
From.sequenceFile(org.apache.hadoop.fs.Path path,
Class<T> valueClass)
Creates a Source<T> instance from the SequenceFile(s) at the given Path
from the value field of each key-value pair in the SequenceFile(s). |
|
static
|
From.sequenceFile(org.apache.hadoop.fs.Path path,
PType<T> ptype)
Creates a Source<T> instance from the SequenceFile(s) at the given Path
from the value field of each key-value pair in the SequenceFile(s). |
|
static
|
From.sequenceFile(String pathName,
Class<T> valueClass)
Creates a Source<T> instance from the SequenceFile(s) at the given path name
from the value field of each key-value pair in the SequenceFile(s). |
|
static
|
From.sequenceFile(String pathName,
PType<T> ptype)
Creates a Source<T> instance from the SequenceFile(s) at the given path name
from the value field of each key-value pair in the SequenceFile(s). |
|
static Source<String> |
From.textFile(org.apache.hadoop.fs.Path path)
Creates a Source<String> instance for the text file(s) at the given Path . |
|
static
|
From.textFile(org.apache.hadoop.fs.Path path,
PType<T> ptype)
Creates a Source<T> instance for the text file(s) at the given Path using
the provided PType<T> to convert the input text. |
|
static Source<String> |
From.textFile(String pathName)
Creates a Source<String> instance for the text file(s) at the given path name. |
|
static
|
From.textFile(String pathName,
PType<T> ptype)
Creates a Source<T> instance for the text file(s) at the given path name using
the provided PType<T> to convert the input text. |
Uses of Source in org.apache.crunch.util |
---|
Methods in org.apache.crunch.util with parameters of type Source | ||
---|---|---|
|
CrunchTool.read(Source<T> source)
|
|
|||||||||
PREV NEXT | FRAMES NO FRAMES |