|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
public interface Source<T>
A Source
represents an input data set that is an input to one or more
MapReduce jobs.
Method Summary | |
---|---|
void |
configureSource(org.apache.hadoop.mapreduce.Job job,
int inputId)
Configure the given job to use this source as an input. |
Converter<?,?,?,?> |
getConverter()
Returns the Converter used for mapping the inputs from this instance
into PCollection or PTable values. |
long |
getLastModifiedAt(org.apache.hadoop.conf.Configuration configuration)
Returns the time (in milliseconds) that this Source was most recently
modified (e.g., because an input file was edited or new files were added to
a directory.) |
long |
getSize(org.apache.hadoop.conf.Configuration configuration)
Returns the number of bytes in this Source . |
PType<T> |
getType()
Returns the PType for this source. |
Method Detail |
---|
PType<T> getType()
PType
for this source.
Converter<?,?,?,?> getConverter()
Converter
used for mapping the inputs from this instance
into PCollection
or PTable
values.
void configureSource(org.apache.hadoop.mapreduce.Job job, int inputId) throws IOException
job
- The job to configureinputId
- For a multi-input job, an identifier for this input to the job
IOException
long getSize(org.apache.hadoop.conf.Configuration configuration)
Source
.
long getLastModifiedAt(org.apache.hadoop.conf.Configuration configuration)
Source
was most recently
modified (e.g., because an input file was edited or new files were added to
a directory.)
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |