org.apache.crunch.impl.spark.fn

Class ReduceGroupingFunction

java.lang.Object

org.apache.crunch.impl.spark.fn.ReduceGroupingFunction

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.PairFlatMapFunction<Iterator<scala.Tuple2<ByteArray,List<byte[]>>>,ByteArray,List<byte[]>>

public class ReduceGroupingFunction
extends Object
implements org.apache.spark.api.java.function.PairFlatMapFunction<Iterator<scala.Tuple2<ByteArray,List<byte[]>>>,ByteArray,List<byte[]>>

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
ReduceGroupingFunction(GroupingOptions options, PGroupedTableType ptype, SparkRuntimeContext ctxt)

Method Summary

Modifier and Type	Method and Description
Iterable<scala.Tuple2<ByteArray,List<byte[]>>>	call(Iterator<scala.Tuple2<ByteArray,List<byte[]>>> iter)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ReduceGroupingFunction

public ReduceGroupingFunction(GroupingOptions options,
                              PGroupedTableType ptype,
                              SparkRuntimeContext ctxt)

Method Detail

call

public Iterable<scala.Tuple2<ByteArray,List<byte[]>>> call(Iterator<scala.Tuple2<ByteArray,List<byte[]>>> iter)
                                                    throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.PairFlatMapFunction<Iterator<scala.Tuple2<ByteArray,List<byte[]>>>,ByteArray,List<byte[]>>

Throws:

Exception