浏览代码

Add PlanningExplorer scrapers:

* Blackburn
    * Camden - done (has OSGB)
    * Charnwood (done, but site has a problem with its info links)
    * Crewe and Nantwich
    * East Staffordshire
    * Epping Forest
    * Hackney - done
    * Kennet
    * Lincoln (also has WAM)
    * Liverpool
    * South Shropshire
    * South Tyneside
    * Stockport
    * Tamworth

I've included Camden, as the scraper works (their site is down today).
The scraper for Charnwood is fine (both the search results page and the info links fail to display in a browser, but 
we are getting all the info out fine, and the links are correct. This appears to be a missing template on their 
site).

I've included several authorities for which the scrapes work fine, but which don't have any postcodes. Some of these 
have OSGB coords for each app, which we could maybe use instead.

    * Broadland (no postcodes)
    * Forest Heath (no postcodes)
    * South Norfolk (appears to have WAM as well) (No postcodes - but has OSGB coords)
    * Trafford (no postcodes)
    * West Oxfordshire (no postcodes)

There are a few PlanningExplorer sites that are currently down, and which I haven't been able to do yet:

    * Merton (site down)
    * Shrewsbury (site is broken)
    * Swansea (site is broken)
    * Waltham Forest (currently giving an error)
import/raw
duncan.parkes 17 年前
父节点
当前提交
fe6d58bd05
共有 2 个文件被更改,包括 22 次插入1 次删除
  1. +2
    -1
      trunk/python_scrapers/OtherFilesToCopy.csv
  2. +20
    -0
      trunk/python_scrapers/SitesToGenerate.csv

+ 2
- 1
trunk/python_scrapers/OtherFilesToCopy.csv 查看文件

@@ -12,4 +12,5 @@
"NorthHerts.cgi", "493"
"Enfield.cgi", "493"
"RutlandLike.py", "420"
"AtriumePlanning.py", "420"
"AtriumePlanning.py", "420"
"PlanningExplorer.py", "420"

+ 20
- 0
trunk/python_scrapers/SitesToGenerate.csv 查看文件

@@ -147,3 +147,23 @@
"Bolton Metropolitan Borough Council", "Bolton", "http://www.planning.bolton.gov.uk/PlanningSearch/acolnetcgi.gov?ACTION=UNWRAP&RIPNAME=Root.pgesearch", "AcolnetParser", "BoltonParser"
"Exeter City Council", "Exeter", "http://pub.exeter.gov.uk/scripts/Acolnet/dataonlineplanning/acolnetcgi.gov?ACTION=UNWRAP&RIPNAME=Root.pgesearch", "AcolnetParser", "ExeterParser"
"Suffolk County Council", "Suffolk", "http://atrium.suffolkcc.gov.uk/ePlanning/loadResults.do", "AtriumePlanning", "AtriumePlanningParser"
"Blackburn with Darwen Borough Council", "Blackburn", "http://195.8.175.6/", "PlanningExplorer", "BlackburnParser"
"Broadland District Council", "Broadland", "http://www.broadland.gov.uk/", "PlanningExplorer", "BroadlandParser"
"London Borough of Camden", "Camden", "http://planningrecords.camden.gov.uk/", "PlanningExplorer", "CamdenParser"
"Charnwood Borough Council", "Charnwood", "http://portal.charnwoodbc.gov.uk/", "PlanningExplorer", "CharnwoodParser"
"Crewe and Nantwich Borough Council", "Crewe and Nantwich", "http://portal.crewe-nantwich.gov.uk/", "PlanningExplorer", "CreweParser"
"East Staffordshire District Council", "East Staffs", "http://www2.eaststaffsbc.gov.uk/", "PlanningExplorer", "EastStaffsParser"
"Epping Forest District Council", "Epping Forest", "http://plan1.eppingforestdc.gov.uk/", "PlanningExplorer", "EppingForestParser"
"Forest Heath District Council", "Forest Heath", "http://195.171.177.73/", "PlanningExplorer", "ForestHeathParser"
"London Borough of Hackney", "Hackney", "http://www.hackney.gov.uk/servapps/", "PlanningExplorer", "HackneyParser"
"Kennet District Council", "Kennet", "http://mvm-planning.kennet.gov.uk/", "PlanningExplorer", "KennetParser"
"Lincoln City Council", "Lincoln", "http://online.lincoln.gov.uk/", "PlanningExplorer", "LincolnParser"
"Liverpool City Council", "Liverpool", "http://www.liverpool.gov.uk/", "PlanningExplorer", "LiverpoolParser"
"South Norfolk Council", "South Norfolk", "http://planning.south-norfolk.gov.uk/", "PlanningExplorer", "SouthNorfolkParser"
"South Shropshire District Council", "South Shropshire", "http://194.201.44.102/", "PlanningExplorer", "SouthShropshireParser"
"South Tyneside Council", "South Tyneside", "http://poppy.southtyneside.gov.uk/", "PlanningExplorer", "SouthTynesideParser"
"Stockport Metropolitan Borough Council", "Stockport", "http://s1.stockport.gov.uk/council/eed/dc/planning/", "PlanningExplorer", "StockportParser"
"Tamworth Borough Council", "Tamworth", "http://80.1.64.77/", "PlanningExplorer", "TamworthParser"
"Trafford Council", "Trafford", "http://planning.trafford.gov.uk/", "PlanningExplorer", "TraffordParser"
"West Oxfordshire District Council", "West Oxfordshire", "http://planning.westoxon.gov.uk/", "PlanningExplorer", "WestOxfordshireParser"

正在加载...
取消
保存