In this project, we will learn how to build a real-time analytics dashboard using Apache Spark Streaming, Kafka, Node.js, Socket.IO, and Highcharts.
There are many Big Data Solution stacks.
The first and most powerful stack is Apache Hadoop and Spark together. While Hadoop provides storage for structured and unstructured data, Spark provides the computational capability on top of Hadoop.
The second way could be to use Cassandra or MongoDB. The third could be to use Google Compute Engine or Microsoft Azure. In such cases, you would have to upload your data to Google or Microsoft which may not be acceptable to your organization sometimes.
In this post, we will understand the basics of: