org.apache.crunch.impl.spark.fn

Class PartitionedMapOutputFunction<K,V>

java.lang.Object

org.apache.crunch.impl.spark.fn.PartitionedMapOutputFunction<K,V>

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.PairFunction<Pair<K,V>,IntByteArray,byte[]>

public class PartitionedMapOutputFunction<K,V>
extends Object
implements org.apache.spark.api.java.function.PairFunction<Pair<K,V>,IntByteArray,byte[]>

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
PartitionedMapOutputFunction(SerDe<K> keySerde, SerDe<V> valueSerde, PGroupedTableType<K,V> ptype, int numPartitions, GroupingOptions options, SparkRuntimeContext runtimeContext)

Method Summary

Modifier and Type	Method and Description
scala.Tuple2<IntByteArray,byte[]>	call(Pair<K,V> p)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PartitionedMapOutputFunction

public PartitionedMapOutputFunction(SerDe<K> keySerde,
                                    SerDe<V> valueSerde,
                                    PGroupedTableType<K,V> ptype,
                                    int numPartitions,
                                    GroupingOptions options,
                                    SparkRuntimeContext runtimeContext)

Method Detail

call

public scala.Tuple2<IntByteArray,byte[]> call(Pair<K,V> p)
                                       throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.PairFunction<Pair<K,V>,IntByteArray,byte[]>

Throws:

Exception