This project has retired. For details please refer to its Attic page.

org.apache.crunch.impl.spark.fn
Class PartitionedMapOutputFunction<K,V>

java.lang.Object
  org.apache.crunch.impl.spark.fn.PartitionedMapOutputFunction<K,V>

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.PairFunction<Pair<K,V>,IntByteArray,byte[]>

public class PartitionedMapOutputFunction<K,V>
extends Object
implements org.apache.spark.api.java.function.PairFunction<Pair<K,V>,IntByteArray,byte[]>

See Also:

Serialized Form

Constructor Summary

PartitionedMapOutputFunction(SerDe<K> keySerde, SerDe<V> valueSerde, PGroupedTableType<K,V> ptype, Class<? extends org.apache.hadoop.mapreduce.Partitioner> partitionerClass, int numPartitions, SparkRuntimeContext runtimeContext)

Method Summary

scala.Tuple2<IntByteArray,byte[]>

call(Pair<K,V> p)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PartitionedMapOutputFunction

public PartitionedMapOutputFunction(SerDe<K> keySerde,
                                    SerDe<V> valueSerde,
                                    PGroupedTableType<K,V> ptype,
                                    Class<? extends org.apache.hadoop.mapreduce.Partitioner> partitionerClass,
                                    int numPartitions,
                                    SparkRuntimeContext runtimeContext)

Method Detail

call

public scala.Tuple2<IntByteArray,byte[]> call(Pair<K,V> p)
                                       throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.PairFunction<Pair<K,V>,IntByteArray,byte[]>

Throws:

Exception