This Scraper project collects media information from Netflix using Selenium ChromeDriver. The application has been built to easily integrate additional scrapers such as for Amazon VOD.
I built this scraper out of fun and curiosity. Use at your own risk.
The collected information is stored in ConcurrentBag<IMedia>()
. You can specify locations to store log files and the ChromeDriver cache in the App.config.
- Clone this repo to your local machine using https://github.com/Tcheetox/Netflix-Scraper-Prototype.git
- Google Chrome version 85.0 or higher is required
- Selenium WebDriver
- Selenium WebDriver ChromeDriver
- Instantiate NetflixScraper
NetflixScraper netflixScraper = new NetflixScraper(MediaBag);
netflixScraper.Start();
netflixScraper.Wait();
netflixScraper.Stop();
- Driver wrapper class
netflixDriver.NavigateSafely($"https://www.netflix.com");
netflixDriver.TryFindElement((driver) => driver.FindElementByClassName("CLASSNAME"), out IWebElement element)
- WebElement wrapper class
webElement.Safely((e) => e.FindElements(By.ClassName("CLASSNAME")))