Package | Description |
---|---|
org.apache.crunch.impl.spark | |
org.apache.crunch.impl.spark.collect |
Constructor and Description |
---|
SparkRuntime(SparkPipeline pipeline,
org.apache.spark.api.java.JavaSparkContext sparkContext,
org.apache.hadoop.conf.Configuration conf,
Map<PCollectionImpl<?>,Set<Target>> outputTargets,
Map<PCollectionImpl<?>,org.apache.crunch.materialize.MaterializableIterable> toMaterialize,
Map<PCollection<?>,org.apache.spark.storage.StorageLevel> toCache,
Map<PipelineCallable<?>,Set<Target>> allPipelineCallables) |
Constructor and Description |
---|
CreatedCollection(SparkPipeline p,
Iterable<T> contents,
PType<T> ptype,
CreateOptions options) |
CreatedTable(SparkPipeline pipeline,
Iterable<Pair<K,V>> contents,
PTableType<K,V> ptype,
CreateOptions options) |
Copyright © 2016 The Apache Software Foundation. All rights reserved.