AgentQL is an AI-powered query language for web scraping and automation. It uses natural language selectors to find data on any page, including authenticated content. AgentQL queries are self-healing as UI changes and work across similar sites. Users can define structured data output, making AgentQL versatile for developers and data scientists.
The NSE has a website which displays the option chain in near real-time. This program retrieves this data from the NSE site and then generates useful analysis of the Option Chain for the specified Index or Stock. It also continuously refreshes the Option Chain and visually displays the trend in various indicators useful for Technical Analysis.
Proxy List Scrapper
All-in-one Web Scrapper for Python
Boost website hits by generating requests from multiple proxy IPs.
Unofficial python api for Erowid, PsychonautWiki and AskTheCaterpillar
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
🍀 Scraps data from Leafly and collects amazing weed-based meta-data.
Evaluate JavaScript on a URL through headless Chrome browser.
This Is A Web Scraping Projects With Covid-19 Data From 2 Very Popular & Authentic Websites
This repository contains the code for completely scraping the yellow pages website to get the details of all the categories from all the cities in America and then turning all of the data into an api to be used later.
Unoffical api to get comic books from various publishers. Published on NPM !
I was a little lazy in downloading the series I wanted. So I made it automatic.
This Repository is for scraping jobs from Indeed
Get all the resources like Notes and Notebooks provided in CampusX Courses.
🤖 An RPA-based tool for extracting information over JUCESP.
This Python script automates interactions with LinkedIn Sales Navigator using Selenium WebDriver. It can log into LinkedIn, navigate through lists of prospects, send messages, and manage contacts based on specific criteria.
O Rails WEB SCRAPER é um projeto com a finalidade de extrair dados de filmes do site YIFY Torrents - YTS.
Repository designed to help freshers easily grasp the basics of web scripting, offering simple guides and examples to build a strong foundation.
Add a description, image, and links to the web-scrapping topic page so that developers can more easily learn about it.
To associate your repository with the web-scrapping topic, visit your repo's landing page and select "manage topics."