elasticsearch - Kafka-Connect vs Filebeat & Logstash -
i'm looking consume kafka , save data hadoop , elasticsearch. i've seen 2 ways of doing currently: using filebeat consume kafka , send es , using kafka-connect framework. there kafka-connect-hdfs , kafka-connect-elasticsearch module.
i'm not sure 1 use send streaming data. though think if want @ point take data kafka , place cassandra can use kafka-connect module no such feature exists filebeat.
kafka connect can handle streaming data , bit more flexible. if going elastic, filebeat clean integration log sources. however, if going kafka number of different sinks, kafka connect want. i'd recommend checking out connector hub see examples of open source connectors @ disposal http://www.confluent.io/product/connectors/
Comments
Post a Comment