Web Scraping with Python

In this chapter, we will cover the following recipes:

• Downloading web pages with Python scripts
• Changing the user agent
• Downloading files
• Using a regular expression to get the information from the downloaded web pages
• Requesting and downloading dynamic website pages
• Dynamic GET requests