This project has retired. For details please refer to its Attic page.

org.apache.crunch.impl.spark.fn
Class ReduceGroupingFunction

java.lang.Object
  scala.runtime.AbstractFunction1<T,R>
      org.apache.spark.api.java.function.WrappedFunction1<T,Iterable<scala.Tuple2<K,V>>>
          org.apache.spark.api.java.function.PairFlatMapFunction<Iterator<scala.Tuple2<ByteArray,List<byte[]>>>,ByteArray,List<byte[]>>
              org.apache.crunch.impl.spark.fn.ReduceGroupingFunction

All Implemented Interfaces:

Serializable, scala.Function1<Iterator<scala.Tuple2<ByteArray,List<byte[]>>>,Iterable<scala.Tuple2<ByteArray,List<byte[]>>>>, scala.ScalaObject

public class ReduceGroupingFunction
extends org.apache.spark.api.java.function.PairFlatMapFunction<Iterator<scala.Tuple2<ByteArray,List<byte[]>>>,ByteArray,List<byte[]>>

See Also:

Serialized Form

Constructor Summary

ReduceGroupingFunction(GroupingOptions options, PGroupedTableType ptype, SparkRuntimeContext ctxt)

Method Summary

Iterable<scala.Tuple2<ByteArray,List<byte[]>>>

call(Iterator<scala.Tuple2<ByteArray,List<byte[]>>> iter)

Methods inherited from class org.apache.spark.api.java.function.PairFlatMapFunction

keyType, valueType

Methods inherited from class org.apache.spark.api.java.function.WrappedFunction1

apply

Methods inherited from class scala.runtime.AbstractFunction1

andThen, andThen$mcDD$sp, andThen$mcDF$sp, andThen$mcDI$sp, andThen$mcDJ$sp, andThen$mcFD$sp, andThen$mcFF$sp, andThen$mcFI$sp, andThen$mcFJ$sp, andThen$mcID$sp, andThen$mcIF$sp, andThen$mcII$sp, andThen$mcIJ$sp, andThen$mcJD$sp, andThen$mcJF$sp, andThen$mcJI$sp, andThen$mcJJ$sp, andThen$mcVD$sp, andThen$mcVF$sp, andThen$mcVI$sp, andThen$mcVJ$sp, andThen$mcZD$sp, andThen$mcZF$sp, andThen$mcZI$sp, andThen$mcZJ$sp, apply$mcDD$sp, apply$mcDF$sp, apply$mcDI$sp, apply$mcDJ$sp, apply$mcFD$sp, apply$mcFF$sp, apply$mcFI$sp, apply$mcFJ$sp, apply$mcID$sp, apply$mcIF$sp, apply$mcII$sp, apply$mcIJ$sp, apply$mcJD$sp, apply$mcJF$sp, apply$mcJI$sp, apply$mcJJ$sp, apply$mcVD$sp, apply$mcVF$sp, apply$mcVI$sp, apply$mcVJ$sp, apply$mcZD$sp, apply$mcZF$sp, apply$mcZI$sp, apply$mcZJ$sp, compose, compose$mcDD$sp, compose$mcDF$sp, compose$mcDI$sp, compose$mcDJ$sp, compose$mcFD$sp, compose$mcFF$sp, compose$mcFI$sp, compose$mcFJ$sp, compose$mcID$sp, compose$mcIF$sp, compose$mcII$sp, compose$mcIJ$sp, compose$mcJD$sp, compose$mcJF$sp, compose$mcJI$sp, compose$mcJJ$sp, compose$mcVD$sp, compose$mcVF$sp, compose$mcVI$sp, compose$mcVJ$sp, compose$mcZD$sp, compose$mcZF$sp, compose$mcZI$sp, compose$mcZJ$sp, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

ReduceGroupingFunction

public ReduceGroupingFunction(GroupingOptions options,
                              PGroupedTableType ptype,
                              SparkRuntimeContext ctxt)

Method Detail

call

public Iterable<scala.Tuple2<ByteArray,List<byte[]>>> call(Iterator<scala.Tuple2<ByteArray,List<byte[]>>> iter)
                                                    throws Exception

Specified by:

call in class org.apache.spark.api.java.function.PairFlatMapFunction<Iterator<scala.Tuple2<ByteArray,List<byte[]>>>,ByteArray,List<byte[]>>

Throws:

Exception