Skip to content

Rafid-Rahman/job_list_scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 

Repository files navigation

💼 Remote Job Listings Scraper

This Python-based web scraping project automatically collects remote full-stack programming jobs from WeWorkRemotely.com. It extracts key job details like title, company, job type, location, posting date, and application deadline, and saves the results in a structured Excel file.

This scraper is part of my Upwork portfolio and showcases my skills in web scraping, data parsing, and automation scripting using Python.


🚀 Features

  • 🔍 Scrapes listings from the Full-Stack Programming section of WeWorkRemotely
  • 📄 Extracts job information including:
    • Job Title
    • Company Name
    • Posted On
    • Apply Before
    • Job Type (e.g., Full-time, Part-time, Contract)
    • Region / Location
    • Direct Job Link
  • 🌐 Automatically follows links to job detail pages for deeper information
  • 📁 Saves all scraped data to an Excel file
  • ✅ Structured, clean, and ready for analysis or client delivery

🛠️ Technologies Used

  • Python 3
  • requests for HTTP communication
  • BeautifulSoup for HTML parsing
  • pandas for data handling and Excel export
  • openpyxl for Excel writing

📁 Project Structure

📦 Job Listings Scraper

  • ┣ 📜 job_list.py # Main Python script
  • ┗ 📄 Job_Lists.xlsx # Output Excel file (auto-generated)

🧪 How to Run This Project

  1. Clone the repository
    git clone https://github.com/yourusername/job-list-scraper.git
    cd job-listings-scraper
  2. Install required libraries
    pip install requests beautifulsoup4 pandas openpyxl
  3. Run the scraper
    python job_list.py
  4. The result will be saved in an Excel file.

🎯 Use Case

This project demonstrates my ability to:

  • 🔧 Scrape and parse nested HTML data
  • 🔁 Automate data collection from paginated and linked job listings
  • ✅ Cleanly format data for delivery or analysis
  • 💼 Build portfolio-grade freelance projects that can be reused or scaled

It is part of my Upwork portfolio and highlights my work as a web scraping specialist and Python automation developer.


📬 Contact

Want to collaborate or hire me?

About

I built a web scraper that extracts remote job listings from "We Work Remotely". This Python-based script uses BeautifulSoup to collect key job details, including: Job Titles & Companies, Job Posting Date & Application Deadline and Job Type & Location. The extracted data is structured and saved in an Excel file for easy access.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages