Used for testing uk_planning_scraper Ruby gem in the Morph environment
Nevar pievienot vairāk kā 25 tēmas
Tēmai ir jāsākas ar burtu vai ciparu, tā var saturēt domu zīmes ('-') un var būt līdz 35 simboliem gara.
Scrape planning applications for a single council/authority
- Fork this repo to your own GitHub account.
- Sign in to Morph with your GitHub account.
- Create a new scraper on Morph.
- Choose your forked repo (
single_authority_planning_applications
) as the scraper code.
- In the Settings page for your scraper on Morph, create two
Secret environment variables
:
- Set
MORPH_AUTHORITY_NAME
to the name of your council, eg Hackney
.
- Set
MORPH_DAYS
to the number of recent days you want to scrape, eg 7
.
- Run the scraper.
- Use the Morph API to grab your scraped data or download CSV/SQLite files straight from your scraper page. You must be signed in to do that.
- On your scraper’s Settings page, tick the
Auto run
box to make your scraper run once per day.