Data Scraper v2.3-alpha

Changelog

• Now will scrape all states in monthly data scraper. (Special thanks to GitHub for the free services)
• Updated script to scrape all listed prices (Previously only scrape properties listed with both sale and rent prices).
• Added argument parser function for the script.
• Added exceptions for old data file checking.

Data Scraper v2.2-alpha

Changelog

• Developed checkpoint for previous failed scraping with incomplete dataset
• General RAM and network optimization

Data Scraper v2.1-alpha

Changelog

• Create MD5 checksum hash for dataset validation
• Improve error handling while running GitHub workflow

Data Scraper v2.0-alpha

Changelog

• Major improvement on scraping efficiency (refactoring)
• Expand details on each property listed, ie no of rooms, sqft and author
• Data saved as property listing instead of property price summary to include more information
• Removed redundant data analysis to avoid complication
• Added a fail-safe to save out data and retry whenever scraping failed

Data Scraper v1.6-alpha

Changelog

v1.4-alpha

• Fixed request ConnectionTimeout error.
• Added example data for property listing.

v1.5-alpha

• Fixed not all listing pages being scraped.
• Improvement on ConnectionTimeout error handling.
• Added statistical analysis on StdDev and outlier detection.
• Data frame column rearrangement for better view.
• Added example raw data with all property prices listed.
• Removed example data for property listing.

v1.6-alpha

• Minor fix on scraper to locate total number of property.

Data Scraper v1.3-alpha

A simple python scraper to scrape and compare property price for sale or rent in Malaysia from PropertyGuru.com.

Package below includes:

• data-scraper.py: a python script to scrape PropertyGuru website based on your query search keyword.
• condo-kl-Mar2022.csv: Sample dataset for condo listing in KL updated on March 2022.

p/s Check the folder data for more updated condo-kl datasets.

Enjoy!

Data Scraper v1.0-alpha

A simple python scraper to scrape and compare property price for sale or rent in Malaysia from PropertyGuru.com.
Kindly check the files for latest script and data (data updated on bimonthly basis).