This repository contains two different ways of data extraction from Idealista site, from its API and by web scraping.
It was part of a collaborative project with a UX/UI design student, with the goal of analysing the available listings for people who could afford a maximum rent of 750 euroos.
Repository structure:
-- SRC
------ api_utils - python files to extract data from the api
---------- functions.py
---------- main.py
---------- variables.py
------ data - obtained datasets
---------- rent_madrid_api_dataset.csv - obtained data from the api
------ documentation - api documentation provided by Idealista
---------- authentication_documentation.pdf - documentation about the authentication
---------- search_documentation.pdf - documentation about the data extraction
------ notebooks
---------- data_extraction_api.ipynb - data extraction from api
------ scraping_utils
---------- classes.py
---------- functions.py
---------- main.py
---------- variables.py