Posts Tagged “kafka”

Kafka Kerberos Enable and Testing.

Apache Kafka is a distributed streaming platform. Kafka 2.0 supports Kerberos authentication, Enabling Kerberos Authentication Using the Wizard on cloudera manager. Courtesy - Apache Kafka

Written on May 16, 2017
linux centos redhat cloudera kafka kerberos cluster


Cloudera Manager - Duplicate entry 'zookeeper' for key 'NAME'.

We had recently built a cluster using cloudera API’s and had all the services running on it with Kerberos enabled. Next we had a requirement to add another kafka cluster to our already exsisting cluster in cloudera manager. Since it is a quick task to get the zookeeper and kafka up and running. We decided to get this done using the cloudera manager instead of the API’s. But we faced the Duplicate entry 'zookeeper' for key 'NAME' issue as described in the bug below.

https://issues.cloudera.org/browse/DISTRO-790

Written on May 14, 2017
linux centos redhat cloudera kafka zookeeper cluster


Ansible Playbook - Setup Kafka Cluster.

This is a simple Kafka setup. In this setup we are running kafka over a dedicated zookeeper service. (NOT the standalone zookeeper which comes with kafka)

Written on June 16, 2015
linux ansible kafka hadoop zookeeper


Integrating NODEJS and Kafka

Below are the list required to integrate NodeJS and Kafka. This is a simple HOWTO to get started.

Written on February 7, 2015
linux webserver nodejs kafka-node kafka integrate


Sending JSON to NodeJS to Multiple Topics in Kafka - using kafka-node.

Kafka-node is a Node.js client with Zookeeper integration for Apache Kafka 0.8.1 and later. The Zookeeper integration does the following jobs:

Written on February 7, 2015
linux webserver nodejs kafka-node json kafka


NodeJS Kafka Producer - Using `kafka-node`

Now that we have Kafka and NodeJS ready. Lets some data to our Kafka Cluster.

Written on February 6, 2015
linux webserver nodejs kafka-node kafka


Sending JSON to NodeJS to Kafka.

What we are trying to achieve ?

Written on February 6, 2015
linux webserver nodejs kafka kafka-node


Installing KAFKA Single Node - Quick Start.

Apache Kafka is publish-subscribe messaging rethought as a distributed commit log. Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system, but with a unique design. What does all that mean?

Written on February 6, 2015
linux hadoop kafka quick-start