hdinsight.github.io

Where are Kafka logs on HDInsight cluster

Kafka logs in the cluster are located at: /var/log/kafka

kafka.out: stdout and stderr of the Kafka process. You will find Kafka startup and shutdown logs in this file.

server.log: The main Kafka server log. All Kafka broker logs end up here.

controller.log: Controlelr logs if the broker is acting as controller.

statechange.log: All state change events to brokers are logged in this file.

kafka-gc.log: Kafka Garbage Collection stats