🕷️ Fix spider: Board of Estimate and Taxation

[SimmonsRitchie]

What's this PR do?

Includes meetings from one month ago with the final meeting payload.

Why are we doing this?

This is an attempt to fix a potential bug reported by our Minn site partners. Apparently sometimes meetings show up as "cancelled" when they're not cancelled. Based on my testing, it seems like our scraper is working correctly (we derive cancellation status directly from the Cancelled field in the city's meeting API). My best guess at the moment is that perhaps we're not capturing last minute changes to meeting statuses by the city. We're currently requesting meetings from today and onwards. Perhaps by requesting meetings from 30 days before day and onwards, we'll capture better data.

Steps to manually test

After installing the project using pipenv:

1. Activate the virtual environment:

pipenv shell

2. Run the spider:

scrapy crawl minn_bet -O test_output.csv

3. Monitor the stdout and ensure that the crawl proceeds without raising any errors. Pay attention to the final status report from scrapy.

4. Inspect test_output.csv to ensure the data looks valid. I suggest opening a few of the URLs under the source column of test_output.csv and comparing the data for the row with what you see on the page.

Are there any smells or added technical debt to note?

---

• To see the specific tasks where the Asana app for GitHub is being used, see below:
  • https://app.asana.com/0/0/1207175920077521