This project has retired. For details please refer to its Attic page.
SparkRuntimeContext (Apache Crunch 0.10.0 API)

org.apache.crunch.impl.spark
Class SparkRuntimeContext

java.lang.Object
  extended by org.apache.crunch.impl.spark.SparkRuntimeContext
All Implemented Interfaces:
Serializable

public class SparkRuntimeContext
extends Object
implements Serializable

See Also:
Serialized Form

Constructor Summary
SparkRuntimeContext(org.apache.spark.Accumulator<Map<String,Map<String,Long>>> counters, org.apache.spark.broadcast.Broadcast<byte[]> broadConf)
           
 
Method Summary
 org.apache.hadoop.conf.Configuration getConfiguration()
           
 void initialize(DoFn<?,?> fn)
           
 void setConf(org.apache.spark.broadcast.Broadcast<byte[]> broadConf)
           
 
Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

SparkRuntimeContext

public SparkRuntimeContext(org.apache.spark.Accumulator<Map<String,Map<String,Long>>> counters,
                           org.apache.spark.broadcast.Broadcast<byte[]> broadConf)
Method Detail

setConf

public void setConf(org.apache.spark.broadcast.Broadcast<byte[]> broadConf)

initialize

public void initialize(DoFn<?,?> fn)

getConfiguration

public org.apache.hadoop.conf.Configuration getConfiguration()


Copyright © 2014 The Apache Software Foundation. All Rights Reserved.