Package | Description |
---|---|
org.apache.crunch.contrib.io.jdbc |
Support for reading data from RDBMS using JDBC
|
org.apache.crunch.impl.dist | |
org.apache.crunch.io |
Data input and output for Pipelines.
|
org.apache.crunch.io.impl | |
org.apache.crunch.types |
Common functionality for business object serialization.
|
org.apache.crunch.types.avro |
Business object serialization using Apache Avro.
|
org.apache.crunch.types.writable |
Business object serialization using Hadoop's Writables framework.
|
Modifier and Type | Class and Description |
---|---|
class |
DataBaseSource<T extends org.apache.hadoop.mapreduce.lib.db.DBWritable & org.apache.hadoop.io.Writable>
Source from reading from a database via a JDBC connection.
|
Modifier and Type | Method and Description |
---|---|
<T> ReadableSource<T> |
DistributedPipeline.getMaterializeSourceTarget(PCollection<T> pcollection)
Retrieve a ReadableSourceTarget that provides access to the contents of a
PCollection . |
Modifier and Type | Interface and Description |
---|---|
interface |
ReadableSourceTarget<T>
An interface that indicates that a
SourceTarget instance can be read
into the local client. |
Modifier and Type | Class and Description |
---|---|
class |
org.apache.crunch.io.impl.FileSourceImpl<T> |
Modifier and Type | Method and Description |
---|---|
ReadableSource<T> |
PType.createSourceTarget(org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.Path path,
Iterable<T> contents,
int parallelism)
Returns a
ReadableSource that contains the data in the given Iterable . |
Modifier and Type | Method and Description |
---|---|
ReadableSource<T> |
AvroType.createSourceTarget(org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.Path path,
Iterable<T> contents,
int parallelism) |
Modifier and Type | Method and Description |
---|---|
ReadableSource<T> |
WritableType.createSourceTarget(org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.Path path,
Iterable<T> contents,
int parallelism) |
Copyright © 2016 The Apache Software Foundation. All rights reserved.