org.apache.crunch.kafka.inputformat

Class KafkaRecordReader<K,V>

java.lang.Object

org.apache.hadoop.mapreduce.RecordReader<K,V>

org.apache.crunch.kafka.inputformat.KafkaRecordReader<K,V>

Type Parameters:

K - the key of the records from Kafka

V - the value of the records from Kafka

All Implemented Interfaces:

Closeable, AutoCloseable

public class KafkaRecordReader<K,V>
extends org.apache.hadoop.mapreduce.RecordReader<K,V>

A RecordReader for pulling data from Kafka.

Constructor Summary

Constructors

Constructor and Description
KafkaRecordReader()

Method Summary

Modifier and Type	Method and Description
void	close()
K	getCurrentKey()
V	getCurrentValue()
float	getProgress()
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext)
boolean	nextKeyValue()

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KafkaRecordReader

public KafkaRecordReader()

Method Detail

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit,
                       org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext)
                throws IOException,
                       InterruptedException

Specified by:

initialize in class org.apache.hadoop.mapreduce.RecordReader<K,V>

Throws:

IOException

InterruptedException

nextKeyValue

public boolean nextKeyValue()
                     throws IOException,
                            InterruptedException

Specified by:

nextKeyValue in class org.apache.hadoop.mapreduce.RecordReader<K,V>

Throws:

IOException

InterruptedException

getCurrentKey

public K getCurrentKey()
                throws IOException,
                       InterruptedException

Specified by:

getCurrentKey in class org.apache.hadoop.mapreduce.RecordReader<K,V>

Throws:

IOException

InterruptedException

getCurrentValue

public V getCurrentValue()
                  throws IOException,
                         InterruptedException

Specified by:

getCurrentValue in class org.apache.hadoop.mapreduce.RecordReader<K,V>

Throws:

IOException

InterruptedException

getProgress

public float getProgress()
                  throws IOException,
                         InterruptedException

Specified by:

getProgress in class org.apache.hadoop.mapreduce.RecordReader<K,V>

Throws:

IOException

InterruptedException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Specified by:

close in class org.apache.hadoop.mapreduce.RecordReader<K,V>

Throws:

IOException