Receive Elasticsearch API connection with Logstash

Elastic Stack Logstash
1

Hi,

I have a tool (Icinga 2) that can write data into Elasticsearch. For a special project I need to reroute some of the data to Kafka.

Can I use Logstash to receive and reroute the data? I mean is there an input that can mimic Elasticsearch or would a simple http input be sufficient?

Thanks,
Thomas

2

There is no such input, you would need to test if the http input works or not, this is not something that is commonly done.

The http input may work, but one of the issues that you may have is related to authentcation.

This tool does not have other ways to output its data?

1 Like
3

Thanks for your extremely fast reply.

Yes, Icinga 2 has lots of different outputs. The problem is that most of them have a similar problem. Like an Influx Output, Graphite Output etc.

But just as I checked back to give you a reply with what Icinga can and can not do I found that it also has a GELF output and that's something Logstash can receive. So that should work!

Sorry for missing the GELF feature, otherwise I wouldn't have bothered you. I'll give it a try and let you know if it works.

4

Yeah, using GELF would be better I think, it would be more flexible than trying to do Logstash answer the requests as it were Elasticsearch.

5

If the tool expects per-document response codes in the response to a _bulk request then no, logstash cannot do that. If you just wanted to consume a _bulk request using logstash then this thread (and threads it spawned) may help convince you not to do that :smiley: .

2 Likes