This blog demonstrates a simple utility that I have built which spawns a multi-node Kafka cluster on a single machine via Docker with minimal user intervention. With a basic knowledge of Kafka and Docker; you can make the most of it.
A brief introduction to Apache Kafka.
Beginning a new blog series “Lessons learnt” where I would like to share my experiences while exploring tech that interests me and that I work almost on a daily basis. I am kick starting with lessons learnt while implementing Spark Native Columnar functions and supplementary concepts that I was exposed…
Launching spark application onto a cluster(yarn/mesos) typically requires the following common tasks