Source: Online social media and website

Web Scraping

Web scraping is the term for using a program to download and process content from the Web. For example, Google runs many web scraping programs to index web pages for its search engine. In this chapter, you will learn about several modules that make it easy to scrape web pages in Python.

Web browser. Comes with Python and opens a browser to a specific page.


Requests. Downloads files and web pages from the Internet.


Beautiful Soup. Parses HTML, the format that web pages are written in.


Selenium. Launches and controls a web browser. Selenium is able to fill in forms and simulate mouse clicks in this browser.



No comments:

Post a Comment