planningalerts/wiki/ScraperDevelopment.wiki

= Scrapers being worked on =

  * Broads Authority (Duncan) - publicaccess on https
  * Bromley (Duncan) - publicaccess site refuses access unless IE (not fooled by setting browser string in Konqueror)
  * Bracknell Forest (Duncan) - uses https
  * Bridgnorth (Duncan) - Acolnet. implemented, but returns error 400 when accessed by script
  * Cambridgeshire (Duncan) - Acolnet. no advanced search page - will need some work
  * Canterbury (Duncan) - Acolnet. results table is different from usual format
  * Caradon (Duncan) - works in browser, but not with my script
  * Chiltern (Duncan) - uses https
  * Durham (Duncan) - works in browser - empty results for script
  * Hambleton (Duncan) - works for browser - empty results for script
  * Havant (Duncan) - acolnet - not sure why this doesn't work...
  * Hinckley-Bosworth (Duncan) - uses https
  * Isle of Man (Dan)
  * Moray (Duncan) - causes an error in my script
  * Perthshire (Duncan) - causes an error in my parser
  * Surrey Heath (Duncan) - causes an error in my parser
  * Watford (Duncan) - site is broken
  * West Oxfordshire (Duncan) - not working yet
  * Wychavon (Duncan) - an acolnet site, but slightly odd.

= Working and ready to deploy =

  * Craven
  * Dundee
  * Eastleigh
  * Eden
  * East Devon (db not empty - see eg 11/7/2007)
  * Gateshead (not timing out today)
  * Hammersmith and Fulham (not timing out today)
  * London Borough of Sutton
  * Mansfield
  * Newcastle (not timing out today)
  * Newcastle-under-Lyme (not timing out today)
  * New Forest DC
  * North Hertfordshire (oops... I'd commented out the class it all depends on)
  * North Wiltshire (not timing out today)
  * South Lakeland
  * Teignbridge (This never times out for me... must investigate what goes wrong on the server)
  * Welwyn Hatfield
  * Wyre Forest

= Scrapes done, but sites/scrapers broken =
  * Bassetlaw (no postcodes)
  * Bromley (their site is totally nacked)
  * Derby (no postcodes)
  * Doncaster (site down when attempted to test?)
  * Durham (City) - database appears to be empty though...
  * East Dorset (data not comming though)
  * Fenland (data not comming though)
  * Wolverhampton (empty database)
  * Stratford (timing out?)
  * Winchester (timing out?)
  * Dacorum (always returns no applications)
  * Luton (script returns nothing)
  * Bury (script returns nothing)
  * Gloucestershire (no applications returned)