Package | Description |
---|---|
org.apache.crunch.lambda |
Alternative Crunch API using Java 8 features to allow construction of pipelines using lambda functions and method
references.
|
Modifier and Type | Interface and Description |
---|---|
interface |
LGroupedTable<K,V>
Java 8 friendly version of the
PGroupedTable interface, allowing distributed operations to be expressed in
terms of lambda expressions and method references, instead of creating a new class implementation for each operation. |
interface |
LTable<K,V>
Java 8 friendly version of the
PTable interface, allowing distributed operations to be expressed in
terms of lambda expressions and method references, instead of creating a new class implementation for each operation. |
Modifier and Type | Method and Description |
---|---|
default LCollection<S> |
LCollection.cache()
Cache the underlying
PCollection |
default LCollection<S> |
LCollection.cache(CachingOptions options)
Cache the underlying
PCollection |
default LCollection<S> |
LCollection.filter(SPredicate<S> predicate)
Filter the collection using the supplied predicate.
|
default <T> LCollection<T> |
LCollection.filterMap(SFunction<S,Optional<T>> fn,
PType<T> pType)
Combination of a filter and map operation by using a function with
Optional return type. |
default <T> LCollection<T> |
LCollection.flatMap(SFunction<S,java.util.stream.Stream<T>> fn,
PType<T> pType)
Map each element to zero or more output elements using the provided stream-returning function.
|
default LCollection<S> |
LCollection.increment(Enum<?> counter)
Increment a counter for every element in the collection
|
default LCollection<S> |
LCollection.increment(String counterGroup,
String counterName)
Increment a counter for every element in the collection
|
default LCollection<S> |
LCollection.incrementIf(Enum<?> counter,
SPredicate<S> condition)
Increment a counter for every element satisfying the conditional predicate supplied.
|
default LCollection<S> |
LCollection.incrementIf(String counterGroup,
String counterName,
SPredicate<S> condition)
Increment a counter for every element satisfying the conditional predicate supplied.
|
default LCollection<K> |
LTable.keys()
Get an
LCollection containing just the keys from this table |
default <T> LCollection<T> |
LCollection.map(SFunction<S,T> fn,
PType<T> pType)
Map the elements of this collection 1-1 through the supplied function.
|
default <T> LCollection<T> |
LCollection.parallelDo(DoFn<S,T> fn,
PType<T> pType)
Transform this LCollection using a standard Crunch
DoFn |
default <T> LCollection<T> |
LCollection.parallelDo(LDoFn<S,T> fn,
PType<T> pType)
Transform this LCollection using a Lambda-friendly
LDoFn . |
default LCollection<S> |
LCollection.union(LCollection<S> other)
Union this LCollection with another LCollection of the same type
|
default LCollection<S> |
LCollection.union(PCollection<S> other)
Union this LCollection with a
PCollection of the same type |
default LCollection<V> |
LTable.values()
Get an
LCollection containing just the values from this table |
<S> LCollection<S> |
LCollectionFactory.wrap(PCollection<S> collection)
Wrap a PCollection into an LCollection
|
static <S> LCollection<S> |
Lambda.wrap(PCollection<S> collection) |
default LCollection<S> |
LCollection.write(Target target)
Write this collection to the specified
Target |
default LCollection<S> |
LCollection.write(Target target,
Target.WriteMode writeMode)
Write this collection to the specified
Target with the given Target.WriteMode |
Modifier and Type | Method and Description |
---|---|
default LCollection<S> |
LCollection.union(LCollection<S> other)
Union this LCollection with another LCollection of the same type
|
Copyright © 2016 The Apache Software Foundation. All rights reserved.