Used for testing uk_planning_scraper Ruby gem in the Morph environment
您最多选择25个主题
主题必须以字母或数字开头,可以包含连字符 (-),并且长度不得超过35个字符
Scrape planning applications for a single council/authority
- Fork this repo to your own GitHub account.
- Sign in to Morph with your GitHub account.
- Create a new scraper on Morph.
- Choose your forked repo (
single_authority_planning_applications
) as the scraper code.
- In the Morph settings page, create two
Secret environment variables
:
- Set
MORPH_AUTHORITY_NAME
to the name of your council, eg Hackney
.
- Set
MORPH_DAYS
to the number of recent days you want to scrape, eg 7
.
- Run the scraper.
- Use the Morph API to grab your scraped data or download CSV/SQLite files straight from your scraper page. You must be signed in to do that.
- On your scraper’s Settings page, tick the
Auto run
box to make your scraper run once per day.