Splunk Amazon Kinesis Modular Input v1.3.4

Overview

This is a Splunk Modular Input Add-On for indexing records from Amazon Kinesis.

What is Kinesis ?

http://aws.amazon.com/kinesis/

Dependencies

Setup

Activation Key

You require an activation key to use this App. Visit http://www.baboonbones.com/#activation to obtain a non-expiring key

Logging

Any log entries/errors will get written to $SPLUNK_HOME/var/log/splunk/splunkd.log

These are also searchable in Splunk : index=_internal error kinesis.py

JVM Heap Size

The default heap maximum is 64MB. If you require a larger heap, then you can alter this in $SPLUNKHOME/etc/apps/kinesista/bin/kinesis.py on line 95

JVM System Properties

You can declare custom JVM System Properties when setting up new input stanzas. Note : these JVM System Properties will apply to the entire JVM context and all stanzas you have setup

Customized Message Handling

The way in which the Modular Input processes the received Kinesis records is enitrely pluggable with custom implementations should you wish.

To do this you code an implementation of the com.splunk.modinput.kinesis.AbstractMessageHandler class and jar it up.

Ensure that the necessary jars are in the $SPLUNKHOME/etc/apps/kinesista/bin/lib directory.

If you don't need a custom handler then the default handler com.splunk.modinput.kinesis.DefaultMessageHandler will be used.

Troubleshooting

Contact

This project was initiated by Damien Dallimore , damien@baboonbones.com