Jruby::Kafka

This is a fork of Jruby::Kafka that works with Kafka 0.7.x

Prerequisites

• Apache Kafka version 0.7 installed and running.

• JRuby installed.

About

This gem is primarily used to wrap most of the [Kafka 0.7 high level consumer] API into jruby. The [Kafka Consumer Group Example] is pretty much ported to this library.

Note: The following references are not entirely applicable to Kafka 0.7 [Kafka 0.8beta1 high level consumer]: http://kafka.apache.org/documentation.html#highlevelconsumerapi [Kafka Consumer Group Example]: https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Group+Example

Installation

This isn't distributed yet so you have to build the gem first. From the root of the project run:

$ rake package

You can run the following to install the resulting package:

$ gem install jruby-kafka*.gem

Add this line to your application's Gemfile:

gem 'jruby-kafka'

Usage

If you want to run the tests, make sure you already have downloaded Kafka 0.8beta1, followed the kafka quickstart instructions and have KAFKA_PATH set in the environment.

Using in logstash:

from the logstash root:

make clean && \
bin/logstash deps && \
make vendor-elasticsearch && \
cp $KAFKA_PATH/core/target/scala-2.8.0/*.jar vendor/jar &&  \
make flatjar && \
cd build && \
java -cp logstash-1.2.2-flatjar.jar logstash.runner agent -f kafkatest.conf

Contributing

1. Fork it
2. Create your feature branch (git checkout -b my-new-feature)
3. Commit your changes (git commit -am 'Add some feature')
4. Push to the branch (git push origin my-new-feature)
5. Create new Pull Request