camel-kafka-elasticsearch

An implementation of camel-ldp that consumes an activity stream from Kafka and writes the events to an Elasticsearch Index.

Build

$ gradle build
$ gradle docker

Configuration

• org.trellisldp.camel.kafka.elasticsearch.cfg

Docker

$ docker run -ti trellisldp/camel-kafka-elasticsearch

Use With Trellis:

• Start trellis-compose

• Start elasticsearch-compose

Kibana

• The Kibana interface can be accessed at http://localhost:5601

Example Query

$ curl -v "http://localhost:9200/trellis/_search?q=object.type:http\:\/\/www.w3.org\/ns\/ldp#RDFSource"

Elasticsearch Configuration

$ sudo sysctl -w vm.max_map_count=262144

TODO

• route request to ACTIVITY_STREAM_OBJECT_ID, retrieve body as JSON-LD, and index resource property values.