Now we will define the Wikipedia URL that we will scrape. We will also set the User-Agent request header which is a string that lets servers and network peers identify the application, operating system, vendor, and/or version of the requesting user agent.
Store the Wikipedia URL in the url variable:
<<your code goes here>> = "https://en.wikipedia.org/wiki/List_of_state_and_union_territory_capitals_in_India"
Store the User-Agent request header in the headers variable:
<<your code goes here>> = {'User-Agent': user_agent}
Note - Having trouble with the assessment engine? Follow the steps listed here
Loading comments...