planningalerts/wiki/ScraperDevelopment.wiki

= Scrapers being worked on =

  * Bridgnorth (Duncan) - AcolNet. implemented, but returns error 400 when accessed by script
  * Cambridgeshire (Duncan) - AcolNet. no advanced search page - will need some work
  * Canterbury (Duncan) - AcolNet. results table is different from usual format
  * Guildford (Duncan) - AcolNet, but odd.
  * Isle of Man (Dan)
  * Surrey Heath (Duncan) - AcolNet - The problem here looks like it might be cookie and javascript related.
  * Wychavon (Duncan) - an AcolNet site, but slightly odd.

= Scrapes done, but sites/scrapers broken =
  * Bury (script returns nothing)
  * Dacorum (always returns no applications)
  * Derby (no postcodes)
  * Durham (Duncan) - works in browser - empty results for script
  * East Devon (db not empty - see eg 11/7/2007) - downloads empty cgi file
  * East Dorset - downloads empty cgi file
  * Gateshead (not timing out today) - downloads empty cgi file
  * Hambleton (Duncan) - works for browser - empty results for script
  * Hinckley and Bosworth - downloads empty cgi file
  * Luton - downloads empty cgi file
  * Moray - downloads empty cgi file
  * Newcastle (not timing out today) - downloads empty cgi file
  * Newcastle-under-Lyme (not timing out today) - downloads empty cgi file
  * Perthshire - downloads empty cgi file
  * Renfrewshire - downloads empty cgi file
  * South Bedfordshire - downloads empty cgi file
  * Stratford - internal server error
  * Teignbridge (This never times out for me... must investigate what goes wrong on the server) - downloads empty cgi file
  * Winchester - downloads empty cgi file
  * Wolverhampton (empty database)