Used for testing uk_planning_scraper Ruby gem in the Morph environment
25'ten fazla konu seçemezsiniz Konular bir harf veya rakamla başlamalı, kısa çizgiler ('-') içerebilir ve en fazla 35 karakter uzunluğunda olabilir.
Adrian Short 2d69fb2cb1 Update README 6 yıl önce
.gitignore Add template for morph.io scraper 6 yıl önce
Gemfile Always use the latest uk_planning_scraper gem 6 yıl önce
Gemfile.lock Always use the latest uk_planning_scraper gem 6 yıl önce
README.md Update README 6 yıl önce
scraper.rb First commit 6 yıl önce

README.md

Scrape planning applications for a single council/authority

  1. Fork this repo to your own GitHub account.
  2. Sign in to Morph with your GitHub account.
  3. Create a new scraper on Morph.
  4. Choose your forked repo (single_authority_planning_applications) as the scraper code.
  5. In the Morph settings page, create two Secret environment variables:
  6. Set MORPH_AUTHORITY_NAME to the name of your council, eg Hackney.
  7. Set MORPH_DAYS to the number of recent days you want to scrape, eg 7.
  8. Run the scraper.
  9. Use the Morph API to grab your scraped data or download CSV/SQLite files straight from your scraper page. You must be signed in to do that.
  10. On your scraper’s Settings page, tick the Auto run box to make your scraper run once per day.