Skip to content

Latest commit

 

History

History
22 lines (14 loc) · 823 Bytes

README.md

File metadata and controls

22 lines (14 loc) · 823 Bytes

Please read my blogpost on this subject

https://taekunkim.wordpress.com/2020/08/22/web-scraping-craigslist/

⚠️

The Python script is dependant on the html structure of Craigslist.

The script may not work if Craigslist changes its html structure from what it had on August 11, 2020.

Let's Scrape Craigslist!

Objective

I will be recording the name, id, date posted, image url, location sold, price, and the url of every listing of desk chairs sold on Craigslist - San Diego, CA.

Recently, I had a sudden need to buy a new desk chair. While frequently browsing Craigslist, I wondered how frequently sellers change their listing prices and for how long they keep their listings posted! So, I decided to learn how to webscrape Craigslist.

Tools

I used Python, BeautifulSoup, and CronTab.