Used for testing uk_planning_scraper Ruby gem in the Morph environment
Du kan inte välja fler än 25 ämnen
Ämnen måste starta med en bokstav eller siffra, kan innehålla bindestreck ('-') och vara max 35 tecken långa.
Scrape planning applications for a single council/authority
- Fork this repo to your own GitHub account.
- Sign in to Morph with your GitHub account.
- Create a new scraper on Morph.
- Choose your forked repo (
single_authority_planning_applications
) as the scraper code.
- In the Settings page for your scraper on Morph, create two
Secret environment variables
:
- Set
MORPH_AUTHORITY_NAME
to the name of your council, eg Hackney
.
- Set
MORPH_DAYS
to the number of recent days you want to scrape, eg 7
.
- Run the scraper.
- Use the Morph API to grab your scraped data or download CSV/SQLite files straight from your scraper page. You must be signed in to do that.
- On your scraper’s Settings page, tick the
Auto run
box to make your scraper run once per day.