Website Data Searcher EXE Builder

A single Python script (site_searcher.py) that:

• fetches a page (requests) or (optionally) loads JS pages with Selenium,

• extracts elements by CSS selector or XPath,

• returns element text or attributes (href/src/etc.), writes results to CSV or JSON.

• a requirements.txt and the PyInstaller command to create the .exe.

• usage examples, packaging tips, and legal/ethical notes.

1) site_searcher.py

#!/usr/bin/env python3
...
# check ../webScraperExe/site_searcher.py

2) requirements.txt

check ../webScraperExe/requirements.txt

3) Testing locally

check ../webScraperExe/virtualEnv.bash

4) Build exe with PyInstaller

check ../webScrapperExe/pyinstaller.bash

5) Usage examples

• Extract links:

<!-- -->

site_searcher.exe --url "https://news.ycombinator.com" --selector "a.storylink" --attr "href" --output hn_links.csv

• Save titles as JSON:

<!-- -->

site_searcher.exe --url "https://example.com/blog" --selector ".post-title" --text --output titles.json

6) Packaging tips

• Use --onefile for single exe.
• Use --onedir for smaller build.
• Selenium + webdriver-manager requires Chrome.

7) Legal & Ethical Notes

• Respect robots.txt and TOS.
• Do not overload servers.
• Prefer official APIs for production use.