|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.crunch.types.avro.AvroType<T>
public class AvroType<T>
The implementation of the PType interface for Avro-based serialization.
Nested Class Summary | |
---|---|
static class |
AvroType.AvroRecordType
|
Constructor Summary | |
---|---|
AvroType(Class<T> typeClass,
org.apache.avro.Schema schema,
DeepCopier<T> deepCopier,
PType... ptypes)
|
|
AvroType(Class<T> typeClass,
org.apache.avro.Schema schema,
MapFn inputMapFn,
MapFn outputMapFn,
DeepCopier<T> deepCopier,
AvroType.AvroRecordType recordType,
PType... ptypes)
|
Method Summary | |
---|---|
boolean |
equals(Object other)
|
Converter |
getConverter()
|
ReadableSourceTarget<T> |
getDefaultFileSource(org.apache.hadoop.fs.Path path)
Returns a SourceTarget that is able to read/write data using the serialization format
specified by this PType . |
T |
getDetachedValue(T value)
Returns a copy of a value (or the value itself) that can safely be retained. |
PTypeFamily |
getFamily()
Returns the PTypeFamily that this PType belongs to. |
MapFn<Object,T> |
getInputMapFn()
|
MapFn<T,Object> |
getOutputMapFn()
|
AvroType.AvroRecordType |
getRecordType()
|
org.apache.avro.Schema |
getSchema()
|
List<PType> |
getSubTypes()
Returns the sub-types that make up this PType if it is a composite instance, such as a tuple. |
Class<T> |
getTypeClass()
Returns the Java type represented by this PType . |
int |
hashCode()
|
boolean |
hasReflect()
Determine if the wrapped type is a reflection-based avro type or wraps one. |
boolean |
hasSpecific()
Determine if the wrapped type is a specific data avro type or wraps one. |
void |
initialize(org.apache.hadoop.conf.Configuration conf)
Initialize this PType for use within a DoFn. |
boolean |
isGeneric()
Determine if the wrapped type is a generic data avro type. |
Methods inherited from class java.lang.Object |
---|
getClass, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public AvroType(Class<T> typeClass, org.apache.avro.Schema schema, DeepCopier<T> deepCopier, PType... ptypes)
public AvroType(Class<T> typeClass, org.apache.avro.Schema schema, MapFn inputMapFn, MapFn outputMapFn, DeepCopier<T> deepCopier, AvroType.AvroRecordType recordType, PType... ptypes)
Method Detail |
---|
public AvroType.AvroRecordType getRecordType()
public Class<T> getTypeClass()
PType
PType
.
getTypeClass
in interface PType<T>
public PTypeFamily getFamily()
PType
PTypeFamily
that this PType
belongs to.
getFamily
in interface PType<T>
public List<PType> getSubTypes()
PType
getSubTypes
in interface PType<T>
public org.apache.avro.Schema getSchema()
public boolean hasSpecific()
public boolean isGeneric()
public boolean hasReflect()
public MapFn<Object,T> getInputMapFn()
getInputMapFn
in interface PType<T>
public MapFn<T,Object> getOutputMapFn()
getOutputMapFn
in interface PType<T>
public Converter getConverter()
getConverter
in interface PType<T>
public ReadableSourceTarget<T> getDefaultFileSource(org.apache.hadoop.fs.Path path)
PType
SourceTarget
that is able to read/write data using the serialization format
specified by this PType
.
getDefaultFileSource
in interface PType<T>
public void initialize(org.apache.hadoop.conf.Configuration conf)
PType
PType.getDetachedValue(Object)
.
initialize
in interface PType<T>
conf
- Configuration objectPType.getDetachedValue(Object)
public T getDetachedValue(T value)
PType
This is useful when iterable values being processed in a DoFn (via a reducer) need to be held
on to for more than the scope of a single iteration, as a reducer (and therefore also a DoFn
that has an Iterable as input) re-use deserialized values. More information on object reuse is
available in the DoFn
class documentation.
getDetachedValue
in interface PType<T>
value
- The value to be deep-copied
public boolean equals(Object other)
equals
in class Object
public int hashCode()
hashCode
in class Object
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |