rumetr-client

Python client and scrapy workflow for rumetr.com API.

Usage

Install it with pip

pip install rumetr-client

Add this to your scrapy/settings.py:

ITEM_PIPELINES = {
    'rumetr.scrapy.UploadPipeline': 300,
}

RUMETR_API_HOST = 'https://sandbox.rumetr.com/api/v11'
RUMETR_TOKEN = '<YOUR TOKEN>'
RUMETR_DEVELOPER = '<PARTICULAR DEVELOPER CODE>'

Now your parser should yield our pre-formatted item per each found appartment:

# developer/developerspider.py

from rumetr.scrapy import ApptItem as Item

def your_scrapy_callback(response):

      for appt in response.css('.your-appt[selector]):
         yield Item(
            complex_name=response.meta['complex_name'],
            complex_id=response.meta['complex_id'],
            complex_url=URL + response.meta['complex_url'] + '/',
            addr=response.meta['complex_addr'],

            house_id=appt['house_id'],
            house_name=appt['house_name'],
            house_url=URL + response.meta['complex_url'],

            id=appt['id'],
            floor=floor_number,
            room_count=appt['roomQuantity'] if appt['roomQuantity'] not in ['С', 'C'] else 1,
            is_studio=appt['roomQuantity'] in ['С', 'C'],
            square=appt['wholeAreaBti'],
            price=appt['wholePrice'],
         )