adrianshort
/
single_authority_planning_applications
mirror of https://github.com/adrianshort/single_authority_planning_applications.git
1
0
Fork 0
Code Issues 0 Releases 0 Wiki Activity
Used for testing uk_planning_scraper Ruby gem in the Morph environment
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
8 Commits
1 Branch
30 KiB
Branch: master
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'master'
${ noResults }
single_authority_planning_a.../scraper.rb

scraper.rb 244 B
Raw Permalink Normal View History

First commit
6 years ago
​
Add template for morph.io scraper
6 years ago
Use chained scrape parameters
6 years ago
​
First commit
6 years ago
 123456 
  1. require 'uk_planning_scraper'

  2. require 'scraperwiki'

  3. 

  4. apps = UKPlanningScraper::Authority.named(ENV['MORPH_AUTHORITY_NAME']). \

  5.   validated_days(ENV['MORPH_DAYS'].to_i).scrape

  6. ScraperWiki.save_sqlite([:authority_name, :council_reference], apps)