This project has retired. For details please refer to its Attic page.

org.apache.crunch.impl.spark.fn
Class ReduceGroupingFunction

java.lang.Object
  org.apache.crunch.impl.spark.fn.ReduceGroupingFunction

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.PairFlatMapFunction<Iterator<scala.Tuple2<ByteArray,List<byte[]>>>,ByteArray,List<byte[]>>

public class ReduceGroupingFunction
extends Object
implements org.apache.spark.api.java.function.PairFlatMapFunction<Iterator<scala.Tuple2<ByteArray,List<byte[]>>>,ByteArray,List<byte[]>>

See Also:

Serialized Form

Constructor Summary

ReduceGroupingFunction(GroupingOptions options, PGroupedTableType ptype, SparkRuntimeContext ctxt)

Method Summary

Iterable<scala.Tuple2<ByteArray,List<byte[]>>>

call(Iterator<scala.Tuple2<ByteArray,List<byte[]>>> iter)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ReduceGroupingFunction

public ReduceGroupingFunction(GroupingOptions options,
                              PGroupedTableType ptype,
                              SparkRuntimeContext ctxt)

Method Detail

call

public Iterable<scala.Tuple2<ByteArray,List<byte[]>>> call(Iterator<scala.Tuple2<ByteArray,List<byte[]>>> iter)
                                                    throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.PairFlatMapFunction<Iterator<scala.Tuple2<ByteArray,List<byte[]>>>,ByteArray,List<byte[]>>

Throws:

Exception