Package | Description |
---|---|
org.apache.crunch |
Client-facing API and core abstractions.
|
org.apache.crunch.contrib.text | |
org.apache.crunch.impl.dist.collect | |
org.apache.crunch.lambda |
Alternative Crunch API using Java 8 features to allow construction of pipelines using lambda functions and method
references.
|
org.apache.crunch.lib.join |
Inner and outer joins on collections.
|
org.apache.crunch.types |
Common functionality for business object serialization.
|
org.apache.crunch.types.avro |
Business object serialization using Apache Avro.
|
org.apache.crunch.types.writable |
Business object serialization using Hadoop's Writables framework.
|
Modifier and Type | Method and Description |
---|---|
PTypeFamily |
PCollection.getTypeFamily()
Returns the
PTypeFamily of this PCollection . |
Modifier and Type | Method and Description |
---|---|
PType<T> |
Extractor.getPType(PTypeFamily ptf)
Returns the
PType associated with this data type for the
given PTypeFamily . |
static <T> PCollection<T> |
Parse.parse(String groupName,
PCollection<String> input,
PTypeFamily ptf,
Extractor<T> extractor)
Parses the lines of the input
PCollection<String> and returns a PCollection<T> using
the given Extractor<T> that uses the given PTypeFamily . |
static <K,V> PTable<K,V> |
Parse.parseTable(String groupName,
PCollection<String> input,
PTypeFamily ptf,
Extractor<Pair<K,V>> extractor)
Parses the lines of the input
PCollection<String> and returns a PTable<K, V> using
the given Extractor<Pair<K, V>> that uses the given PTypeFamily . |
Modifier and Type | Method and Description |
---|---|
PTypeFamily |
PCollectionImpl.getTypeFamily() |
Modifier and Type | Method and Description |
---|---|
default PTypeFamily |
LCollection.ptf()
Get the
PTypeFamily representing how elements of this collection may be serialized. |
Modifier and Type | Method and Description |
---|---|
static Class<? extends org.apache.hadoop.io.RawComparator> |
JoinUtils.getGroupingComparator(PTypeFamily typeFamily) |
static Class<? extends org.apache.hadoop.mapreduce.Partitioner> |
JoinUtils.getPartitionerClass(PTypeFamily typeFamily) |
Modifier and Type | Method and Description |
---|---|
PTypeFamily |
PType.getFamily()
Returns the
PTypeFamily that this PType belongs to. |
PTypeFamily |
PGroupedTableType.getFamily() |
Modifier and Type | Method and Description |
---|---|
static PType<BigDecimal> |
PTypes.bigDecimal(PTypeFamily typeFamily)
A PType for Java's
BigDecimal type. |
static PType<BigInteger> |
PTypes.bigInt(PTypeFamily typeFamily)
A PType for Java's
BigInteger type. |
static <T> PType<T> |
PTypeUtils.convert(PType<T> ptype,
PTypeFamily tf) |
static <T extends Enum> |
PTypes.enums(Class<T> type,
PTypeFamily typeFamily)
Constructs a PType for a Java
Enum type. |
static <T> PType<T> |
PTypes.jsonString(Class<T> clazz,
PTypeFamily typeFamily)
Constructs a PType for reading a Java type from a JSON string using Jackson's
ObjectMapper . |
static <T extends com.google.protobuf.Message> |
PTypes.protos(Class<T> clazz,
PTypeFamily typeFamily)
Constructs a PType for the given protocol buffer.
|
static <T extends com.google.protobuf.Message> |
PTypes.protos(Class<T> clazz,
PTypeFamily typeFamily,
SerializableSupplier<com.google.protobuf.ExtensionRegistry> supplier)
Constructs a PType for a protocol buffer, using the given
SerializableSupplier to provide
an ExtensionRegistry to use in reading the given protobuf. |
static <T extends org.apache.thrift.TBase> |
PTypes.thrifts(Class<T> clazz,
PTypeFamily typeFamily)
Constructs a PType for a Thrift record.
|
static PType<UUID> |
PTypes.uuid(PTypeFamily ptf)
A PType for Java's
UUID type. |
Modifier and Type | Class and Description |
---|---|
class |
AvroTypeFamily |
Modifier and Type | Method and Description |
---|---|
PTypeFamily |
AvroType.getFamily() |
Modifier and Type | Class and Description |
---|---|
class |
WritableTypeFamily
The
Writable -based implementation of the
PTypeFamily interface. |
Modifier and Type | Method and Description |
---|---|
PTypeFamily |
WritableType.getFamily() |
Copyright © 2016 The Apache Software Foundation. All rights reserved.