Registrations Closing Soon for DevOps Certification Training by CloudxLab | Registrations Closing in

  Enroll Now
Showing results for ;

Applied Tags : Log Parsing

  • Spark Project - Log Parsing

    Topic
    1 Concept | 4 Questions | 4,034 Learners

    Whenever you make a request to a web server for a page, it records it in a file which is called logs.

    The logs of a webserver are the gold mines for gaining insights in the user behaviour. Every data scientists usually look at the logs first to understand the behaviour of the users. But since the logs are humongous in size, it takes a distributed framework like Hadoop or Spark to process it.

    As part of this project, you will learn to parse the text data stored in logs of a web server using the Apache Spark.