This project has retired. For details please refer to its Attic page.

org.apache.crunch.impl.spark.fn
Class ReduceGroupingFunction

java.lang.Object
  scala.runtime.AbstractFunction1<T,R>
      org.apache.spark.api.java.function.WrappedFunction1<T,Iterable<scala.Tuple2<K,V>>>
          org.apache.spark.api.java.function.PairFlatMapFunction<Iterator<scala.Tuple2<ByteArray,List<byte[]>>>,ByteArray,List<byte[]>>
              org.apache.crunch.impl.spark.fn.ReduceGroupingFunction

All Implemented Interfaces:

Serializable, scala.Function1<Iterator<scala.Tuple2<ByteArray,List<byte[]>>>,Iterable<scala.Tuple2<ByteArray,List<byte[]>>>>

public class ReduceGroupingFunction
extends org.apache.spark.api.java.function.PairFlatMapFunction<Iterator<scala.Tuple2<ByteArray,List<byte[]>>>,ByteArray,List<byte[]>>

See Also:

Serialized Form

Constructor Summary

ReduceGroupingFunction(GroupingOptions options, PGroupedTableType ptype, SparkRuntimeContext ctxt)

Method Summary

Iterable<scala.Tuple2<ByteArray,List<byte[]>>>

call(Iterator<scala.Tuple2<ByteArray,List<byte[]>>> iter)

Methods inherited from class org.apache.spark.api.java.function.PairFlatMapFunction

keyType, valueType

Methods inherited from class org.apache.spark.api.java.function.WrappedFunction1

apply

Methods inherited from class scala.runtime.AbstractFunction1

andThen, andThen$mcDD$sp, andThen$mcDF$sp, andThen$mcDI$sp, andThen$mcDJ$sp, andThen$mcFD$sp, andThen$mcFF$sp, andThen$mcFI$sp, andThen$mcFJ$sp, andThen$mcID$sp, andThen$mcIF$sp, andThen$mcII$sp, andThen$mcIJ$sp, andThen$mcJD$sp, andThen$mcJF$sp, andThen$mcJI$sp, andThen$mcJJ$sp, andThen$mcVD$sp, andThen$mcVF$sp, andThen$mcVI$sp, andThen$mcVJ$sp, andThen$mcZD$sp, andThen$mcZF$sp, andThen$mcZI$sp, andThen$mcZJ$sp, apply$mcDD$sp, apply$mcDF$sp, apply$mcDI$sp, apply$mcDJ$sp, apply$mcFD$sp, apply$mcFF$sp, apply$mcFI$sp, apply$mcFJ$sp, apply$mcID$sp, apply$mcIF$sp, apply$mcII$sp, apply$mcIJ$sp, apply$mcJD$sp, apply$mcJF$sp, apply$mcJI$sp, apply$mcJJ$sp, apply$mcVD$sp, apply$mcVF$sp, apply$mcVI$sp, apply$mcVJ$sp, apply$mcZD$sp, apply$mcZF$sp, apply$mcZI$sp, apply$mcZJ$sp, compose, compose$mcDD$sp, compose$mcDF$sp, compose$mcDI$sp, compose$mcDJ$sp, compose$mcFD$sp, compose$mcFF$sp, compose$mcFI$sp, compose$mcFJ$sp, compose$mcID$sp, compose$mcIF$sp, compose$mcII$sp, compose$mcIJ$sp, compose$mcJD$sp, compose$mcJF$sp, compose$mcJI$sp, compose$mcJJ$sp, compose$mcVD$sp, compose$mcVF$sp, compose$mcVI$sp, compose$mcVJ$sp, compose$mcZD$sp, compose$mcZF$sp, compose$mcZI$sp, compose$mcZJ$sp, toString

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

ReduceGroupingFunction

public ReduceGroupingFunction(GroupingOptions options,
                              PGroupedTableType ptype,
                              SparkRuntimeContext ctxt)

Method Detail

call

public Iterable<scala.Tuple2<ByteArray,List<byte[]>>> call(Iterator<scala.Tuple2<ByteArray,List<byte[]>>> iter)
                                                    throws Exception

Specified by:

call in class org.apache.spark.api.java.function.WrappedFunction1<Iterator<scala.Tuple2<ByteArray,List<byte[]>>>,Iterable<scala.Tuple2<ByteArray,List<byte[]>>>>

Throws:

Exception