Repositories list

• rag-chatbot

  Public
  A Python-based RAG chatbot leveraging GPT-4o and Bright Data's SERP API to deliver contextually rich and up-to-date AI responses using real-time search engine data.

  pythonapijson+ 11aichatbotchatbotsserphtml2textbeautifulsoup4rag+ 4

  0•2•0•0•Updated Aug 20, 2025Aug 20, 2025

• google-search-api

  Public
  Two methods to collect real Google SERP data—a free scraper for basic use and the enterprise-grade Bright Data API for high-volume demands.

  pythonhtmldata+ 3web-scrapinggoogle-scraperserp-api

  HTML

  •1•0•0•0•Updated Aug 20, 2025Aug 20, 2025

• yandex-api

  Public
  Yandex Search scraper offering a free Python tool for small-scale use and a powerful API for high-volume, real-time SERP data extraction.

  pythonweb-scrapingbeautifulsoup+ 6yandex-apiserp-apiplaywrightserp-scraperserp-scrapingyandex-scraper

  HTML

  •0•1•0•0•Updated Aug 20, 2025Aug 20, 2025

• duckduckgo-api

  Public
  Scrape DuckDuckGo search results using a free Python scraper or scale with Bright Data’s enterprise-grade DuckDuckGo SERP API.

  pythonhtmlselenium+ 6web-scrapingbeautifulsoupduckduckgo-apiduckduckgo-searchwebdriver-managerduckduckgo-scraper

  HTML

  •0•1•0•0•Updated Aug 20, 2025Aug 20, 2025

• serp-api

  Public
  An enterprise-grade Bright Data SERP API for large-scale, real-time search engine results extraction.

  pythonhtmlapi+ 4web-scrapinggoogle-scraperserp-apiserp-scraping

  HTML

  •1•0•0•0•Updated Aug 20, 2025Aug 20, 2025

• luminati-proxy

  Public
  Luminati HTTP/HTTPS Proxy manager

  JavaScript

  •200•783•13•15•Updated Aug 20, 2025Aug 20, 2025

• bright-data-web-unlocker-python-project

  Public
  Python

  •2•4•0•0•Updated Jul 21, 2025Jul 21, 2025

• bright-data-scraping-browser-nodejs-puppeteer-project

  Public
  Bright Data scraping Browser Nodejs puppeteer boilerplate code

  browserscrapingscraping-websites+ 3puppeteerbrightdatascrapingbrowser

  JavaScript

  •

  MIT License

  •1•4•0•0•Updated Jul 21, 2025Jul 21, 2025

• bright-data-scraping-browser-nodejs-playwright-project

  Public
  Bright Data scraping Browser Nodejs playwright boilerplate code

  JavaScript

  •

  MIT License

  •1•3•0•0•Updated Jul 21, 2025Jul 21, 2025

• bright-data-scraping-browser-nodejs-selenium-project

  Public
  Bright Data scraping Browser Nodejs Selenium boilerplate code

  nodejsscrapingselenium+ 1brightdata

  JavaScript

  •

  MIT License

  •1•1•0•0•Updated Jul 21, 2025Jul 21, 2025

• bright-data-serp-api-nodejs-project

  Public
  Bright Data SERP API Nodejs boilerplate code

  JavaScript

  •

  MIT License

  •1•0•0•0•Updated Jul 21, 2025Jul 21, 2025

• bright-data-web-unlocker-nodejs-project

  Public
  Bright Data Web Unlocker Nodejs boilerplate code

  scrapingunlockerbrightdata

  JavaScript

  •4•2•0•0•Updated Jul 21, 2025Jul 21, 2025

• sbr-examples

  Public
  Examples of BrightData's Scraping Browsers usage using common browser-control libraries.

  C#

  •

  MIT License

  •2•2•1•0•Updated Jul 12, 2025Jul 12, 2025

• mountebank

  Public
  Over the wire test doubles

  JavaScript

  •

  MIT License

  •295•0•0•0•Updated Jul 10, 2025Jul 10, 2025

• lol-html

  Public
  Low output latency streaming HTML parser/rewriter with CSS selector-based API

  Rust

  •

  BSD 3-Clause "New" or "Revised" License

  •88•0•0•0•Updated Jul 6, 2025Jul 6, 2025

• BrightData_Dify_Plugin

  Public
  A BrightData plugin for the Dify platform, the plugin contains all of Bright's web scraping, unlocking and dataset tools

  Python

  •

  Other

  •1•0•0•0•Updated Jun 3, 2025Jun 3, 2025

• ai-vector-dataset-pipeline

  Public
  A system for scraping, processing, and analyzing Walmart customer reviews using Pinecone, Sentence Transformers, and Google's Gemini AI for enhanced semantic search and response generation.

  Python

  •1•1•0•0•Updated May 14, 2025May 14, 2025

• web-scraping-with-regex

  Public
  Scrape websites in Python using regex, parse HTML effectively, and handle dynamic pages while overcoming regex’s inherent limitations

  pythonregexproxy-server+ 7web-scraperrequestsweb-scrapingbeautifulsoupbs4redynamic-scraping

  1•1•0•0•Updated May 11, 2025May 11, 2025

• curl-user-agent

  Public
  Customize and rotate the User-Agent header in cURL for more effective web scraping and better request management.

  httpuser-agentcurl+ 2proxy-serverweb-scraping

  1•1•0•0•Updated May 8, 2025May 8, 2025

• crunchbase-scraper

  Public
  Extract business intelligence from Crunchbase with Python scripts or the Bright Data API, offering scalable and reliable company data collection for any use case.

  pythonweb-scrapercrunchbase+ 2datasetsscraper-api

  Python

  •0•1•0•0•Updated May 8, 2025May 8, 2025

• parsing-xml-with-python

  Public
  Parse XML in Python using ElementTree, lxml, SAX, and more for efficient data processing and structured data integration.

  pythonparsingxml+ 8xml-parsingweb-scrapingxml-parserelementtreelxmlsax-parserminidom+ 1

  1•1•0•0•Updated May 7, 2025May 7, 2025

• finetune-gemma3-brightdata

  Public
  A modular pipeline for collecting, processing, and transforming Trustpilot reviews into high-quality QA datasets for LLM fine-tuning using Bright Data, OpenAI, and Hugging Face tools.

  datasetsfine-tuningscraper-api+ 3bright-datafine-tuning-llmgemma3

  Python

  •1•4•0•0•Updated May 5, 2025May 5, 2025

• langchain-brightdata

  Public
  Python

  •

  MIT License

  •1•4•0•0•Updated May 4, 2025May 4, 2025

• web-scraping-with-pydoll

  Public
  Use Pydoll to scrape JavaScript-heavy sites, bypass Cloudflare, and scale web scraping with rotating proxies like Bright Data.

  web-scraperweb-scrapingpython-scraper+ 1pydoll

  2•3•1•0•Updated Apr 28, 2025Apr 28, 2025

• laravel-with-proxy

  Public
  Configuring and using proxies in Laravel for web scraping, bypassing rate limits, and accessing geo-restricted content.

  laravelproxyproxy-server+ 2web-scraperweb-scraping

  0•1•0•0•Updated Apr 28, 2025Apr 28, 2025

• openai-sdk-with-web-unlocker

  Public
  Integrating OpenAI Agents SDK with Bright Data Web Unlocker, enabling AI agents to access, extract, and process structured data from protected web pages

  web-scraperai-agentweb-unblocker+ 4openai-sdkai-scrapingweb-unlockerscraping-agent

  1•1•0•0•Updated Apr 28, 2025Apr 28, 2025

• web-scraping-with-mcp

  Public
  Example MCP server and instructions for connecting Anthropic LLMs to external web scraping tools, with real-world examples and Bright Data integration.

  mcpweb-scrapingclaude+ 2anthropic-claudescraping-mcp

  1•4•0•0•Updated Apr 28, 2025Apr 28, 2025

• llama-3-web-scraping

  Public
  Use LLaMA 3 and Python to extract structured data from websites like Amazon, leveraging LLM-powered parsing for resilient, AI-driven web scraping.

  pythonweb-scrapingdata-collection+ 4python-scraperllama-3ai-scrapingllm-scraping

  0•2•0•0•Updated Apr 28, 2025Apr 28, 2025

• scrapy-web-scraping

  Public
  build a Scrapy web scraper to collect and organize school homework and meal information, with practical examples and real-world scraping tips.

  pythonscraperweb-scraping+ 2scrapypython-scraper

  0•1•0•0•Updated Apr 27, 2025Apr 27, 2025

• LinkedIn-Scraper

  Public
  Extract LinkedIn data with the #1 LinkedIn Scraper API, including profiles, job postings, company details, connections, and posts. Start your free trial now!

  linkedinweb-scraperlinkedin-profile+ 4datasetslinkedin-apilinkedin-scraperlinkedin-dataset

  Python

  •14•45•0•0•Updated Apr 24, 2025Apr 24, 2025