adrianshort
/
planningalerts
mirror of https://github.com/adrianshort/planningalerts.git
1
0
Fork 0
Code Issues 0 Releases 0 Wiki Activity
Automatically exported from code.google.com/p/planningalerts
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
500 Commits
2 Branches
1.3 MiB
 
 
 
 
 
 
Tree: 84be3b75a9
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '84be3b75a9'
${ noResults }
planningalerts/wiki/ScraperDevelopment.wiki

76 lines
2.3 KiB
Raw Blame History 

  1. = Scrapers being worked on =

  2. 

  3.   * Bridgnorth (Duncan) - AcolNet. implemented, but returns error 400 when accessed by script

  4.   * Cambridgeshire (Duncan) - AcolNet. no advanced search page - will need some work

  5.   * Canterbury (Duncan) - AcolNet. results table is different from usual format

  6.   * Guildford (Duncan) - AcolNet, but odd.

  7.   * Isle of Man (Dan)

  8.   * Surrey Heath (Duncan) - AcolNet - The problem here looks like it might be cookie and javascript related.

  9.   * Wychavon (Duncan) - an AcolNet site, but slightly odd.

  10. 

  11. = Deployed by Duncan 07-08/10/2007 =

  12. 

  13.   * Bassetlaw

  14.   * Bracknell Forest

  15.   * Broads Authority

  16.   * Bromley (changed this to my python scraper, which seems to be working)

  17.   * Caradon

  18.   * Chelmsford

  19.   * Chiltern

  20.   * Craven

  21.   * Doncaster (now fixed, so enabled again)

  22.   * Dundee

  23.   * Eastleigh

  24.   * Eden

  25.   * Fenland

  26.   * Gloucestershire (don't be fooled into thinking there are no applications: see eg 20/8/2007)

  27.   * London Borough of Sutton

  28. 

  29. = Working and ready to deploy =

  30.   * East Devon (db not empty - see eg 11/7/2007) - downloads empty cgi file

  31.   * East Dorset - downloads empty cgi file

  32.   * Gateshead (not timing out today) - downloads empty cgi file

  33.   * Havant - not in SitesToGenerate.csv

  34.   * Hinckley and Bosworth - downloads empty cgi file

  35.   * Luton

  36.   * Mansfield

  37.   * Moray

  38.   * Newcastle (not timing out today)

  39.   * Newcastle-under-Lyme (not timing out today)

  40.   * New Forest DC

  41.   * North Hertfordshire (oops... I'd commented out the class it all depends on)

  42.   * North Wiltshire (not timing out today)

  43.   * Oldham

  44.   * Perthshire

  45.   * Renfrewshire

  46.   * South Lakeland

  47.   * Stratford

  48.   * Suffolk Coastal

  49.   * Teignbridge (This never times out for me... must investigate what goes wrong on the server)

  50.   * Watford

  51.   * Welwyn Hatfield

  52.   * Winchester

  53.   * Wyre Forest

  54. 

  55. Other things to do:

  56.   * Balby needs renaming to Blaby.

  57.   * Rename "District of Easington" to "Easington".

  58.   * Rename "London Borough off Ealing" to "London Borough of Ealing".

  59.   * Why does Hertsmere appear in the list of councils we've done twice?

  60. 

  61. 

  62. = Scrapes done, but sites/scrapers broken =

  63.   * Bury (script returns nothing)

  64.   * Dacorum (always returns no applications)

  65.   * Derby (no postcodes)

  66.   * Durham (Duncan) - works in browser - empty results for script

  67.   * Hambleton (Duncan) - works for browser - empty results for script

  68.   * South Bedfordshire - timing out

  69.   * Wolverhampton (empty database)

  70.  

  71.  

  72.  

  73.  

  74.  

  75.  

  76.