Used for testing uk_planning_scraper Ruby gem in the Morph environment
25'ten fazla konu seçemezsiniz
Konular bir harf veya rakamla başlamalı, kısa çizgiler ('-') içerebilir ve en fazla 35 karakter uzunluğunda olabilir.
Scrape planning applications for a single council/authority
- Fork this repo to your own GitHub account.
- Sign in to Morph with your GitHub account.
- Create a new scraper on Morph.
- Choose your forked repo (
single_authority_planning_applications) as the scraper code.
- In the Morph settings page, create two
Secret environment variables:
- Set
MORPH_AUTHORITY_NAME to the name of your council, eg Hackney.
- Set
MORPH_DAYS to the number of recent days you want to scrape, eg 7.
- Run the scraper.
- Use the Morph API to grab your scraped data or download CSV/SQLite files straight from your scraper page. You must be signed in to do that.
- On your scraper’s Settings page, tick the
Auto run box to make your scraper run once per day.