| Interface | Description |
|---|---|
| HasOffsetRanges |
:: Experimental ::
Represents any object that has a collection of
OffsetRanges. |
| Class | Description |
|---|---|
| Broker |
:: Experimental ::
Represent the host and port info for a Kafka broker.
|
| DirectKafkaInputDStream<K,V,U extends kafka.serializer.Decoder<K>,T extends kafka.serializer.Decoder<V>,R> |
A stream of
KafkaRDD where
each given Kafka topic/partition corresponds to an RDD partition. |
| KafkaCluster |
Convenience methods for interacting with a Kafka cluster.
|
| KafkaCluster.LeaderOffset | |
| KafkaCluster.LeaderOffset$ | |
| KafkaCluster.SimpleConsumerConfig |
High-level kafka consumers connect to ZK.
|
| KafkaCluster.SimpleConsumerConfig$ | |
| KafkaInputDStream<K,V,U extends kafka.serializer.Decoder<?>,T extends kafka.serializer.Decoder<?>> |
Input stream that pulls messages from a Kafka Broker.
|
| KafkaRDD<K,V,U extends kafka.serializer.Decoder<?>,T extends kafka.serializer.Decoder<?>,R> |
A batch-oriented interface for consuming from Kafka.
|
| KafkaRDDPartition | |
| KafkaReceiver<K,V,U extends kafka.serializer.Decoder<?>,T extends kafka.serializer.Decoder<?>> | |
| KafkaUtils | |
| KafkaUtilsPythonHelper |
This is a helper class that wraps the KafkaUtils.createStream() into more
Python-friendly class and function so that it can be easily
instantiated and called from Python's KafkaUtils (see SPARK-6027).
|
| OffsetRange |
:: Experimental ::
Represents a range of offsets from a single Kafka TopicAndPartition.
|
| ReliableKafkaReceiver<K,V,U extends kafka.serializer.Decoder<?>,T extends kafka.serializer.Decoder<?>> |
ReliableKafkaReceiver offers the ability to reliably store data into BlockManager without loss.
|