Skip to content

Easily scrape dynamic, JavaScript-driven sites with Selenium! This repo guides you through ๐ŸŒ automated navigation, ๐Ÿ“ data extraction from complex page elements, and โš ๏ธ error handling to manage loading delays. Just install Selenium, ๐Ÿ”ง set up the WebDriver, and dive into the example scripts to get started! ๐Ÿš€๐Ÿ“Š

Notifications You must be signed in to change notification settings

Ojas-Arora/Web-Scrapping-Using-Selenium

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

3 Commits
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿ” Unleashing the Power of Selenium for ๐Ÿ•ธ๏ธWeb Scraping

image

๐Ÿ–ฅ๏ธ Selenium is basically a Web Browser Automation Tool, which simulates a user surfing the Internet. It allows โ€”

  1. ๐Ÿ–ฑ๏ธ Clicking buttons

  2. โŒจ๏ธ Entering information in forms

  3. ๐Ÿ” Searching for specific information on the web pages

๐Ÿ–ฅ๏ธ Selenium came into existence to overcome the limitations ๐Ÿšซ of Beautiful Soup, allowing for interaction with dynamic content and JavaScript-heavy websites.

๐Ÿ› ๏ธ Prerequisites

Before we begin, make sure you have the following tools set up ๐Ÿ”ง:

  1. Python ๐Ÿ

  2. Selenium WebDriver ๐Ÿ•ต๏ธโ€โ™€๏ธ

  3. Browser Driver (e.g., ChromeDriver) ๐ŸŒ

  • To install Selenium, use the following command:

    pip install selenium

  • ๐Ÿ”งRemeber to download the appropriate WebDriver for your browser from here ๐Ÿ–ฅ๏ธ.

  • โฌ‡๏ธ Download the appropriate version of ChromeDriver ๐Ÿ› ๏ธ compatible with your Chrome browser ๐ŸŒ version.

About

Easily scrape dynamic, JavaScript-driven sites with Selenium! This repo guides you through ๐ŸŒ automated navigation, ๐Ÿ“ data extraction from complex page elements, and โš ๏ธ error handling to manage loading delays. Just install Selenium, ๐Ÿ”ง set up the WebDriver, and dive into the example scripts to get started! ๐Ÿš€๐Ÿ“Š

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published