org.apache.crunch.kafka.offset

Interface OffsetWriter

All Superinterfaces:

AutoCloseable, Closeable

All Known Implementing Classes:

AbstractOffsetWriter, HDFSOffsetWriter

public interface OffsetWriter
extends Closeable

Writer for persisting offset information.

Method Summary

Modifier and Type	Method and Description
void	write(long asOfTime, Map<org.apache.kafka.common.TopicPartition,Long> offsets) Persists the offsets to a configured location with metadata of asOfTime indicating the time in milliseconds when the offsets were meaningful.
void	write(Map<org.apache.kafka.common.TopicPartition,Long> offsets) Persists the offsets to a configured location with the current time specified as the as of time.

Methods inherited from interface java.io.Closeable

close

Method Detail

write

void write(Map<org.apache.kafka.common.TopicPartition,Long> offsets)
    throws IOException

Persists the offsets to a configured location with the current time specified as the as of time.

Parameters:

offsets - the offsets to persist

Throws:

IllegalArgumentException - if the offsets are null.

IOException - if there is an error persisting the offsets.

write

void write(long asOfTime,
           Map<org.apache.kafka.common.TopicPartition,Long> offsets)
    throws IOException

Persists the offsets to a configured location with metadata of asOfTime indicating the time in milliseconds when the offsets were meaningful.

Parameters:

asOfTime - the metadata describing when the offsets are accurate as of a time given in milliseconds since epoch.

offsets - the offsets to persist

Throws:

IllegalArgumentException - if the offsets are null or the asOfTime is less than 0.

IOException - if there is an error persisting the offsets.