planningalerts/wiki/ScraperDevelopment.wiki

= Scrapers being worked on =

  * Broads Authority (Duncan) - publicaccess on https
  * Bromley (Duncan) - publicaccess site refuses access unless IE (not fooled by setting browser string in Konqueror)
  * Bracknell Forest (Duncan) - uses https
  * Bridgnorth (Duncan) - Acolnet. implemented, but returns error 400 when accessed by script
  * Cambridgeshire (Duncan) - Acolnet. no advanced search page - will need some work
  * Canterbury (Duncan) - Acolnet. results table is different from usual format
  * Caradon (Duncan) - works in browser, but not with my script
  * Chiltern (Duncan) - uses https
  * Durham (Duncan) - works in browser - empty results for script
  * Hambleton (Duncan) - works for browser - empty results for script
  * Havant (Duncan) - acolnet - not sure why this doesn't work...
  * Hinckley-Bosworth (Duncan) - uses https
  * Isle of Man (Dan)
  * Moray (Duncan) - causes an error in my script
  * Perthshire (Duncan) - causes an error in my parser
  * Surrey Heath (Duncan) - causes an error in my parser
  * Watford (Duncan) - site is broken
  * West Oxfordshire (Duncan) - not working yet

= Working and ready to deploy =
  * Babergh
  * Basingstoke and Deane
  * Bassetlaw
  * Broxbourne (missing perl module on server)
  * Bury  
  * Carlisle
  * Croydon
  * Derby
  * East Dorset
  * East Lindsey
  * Edinburgh
  * Epsom and Ewell Borough Council
  * Fenland
  * Fylde
  * Gateshead
  * Gedling
  * Gloucestershire
  * Hammersmith and Fulham
  * Harlow
  * Hertsmere
  * Lewisham
  * Manchester
  * New Forest
  * Newcastle
  * Newcastle-under-Lyme
  * North Hertfordshire
  * North West Leicestershire
  * North Wiltshire
  * Northumberland (Not that many applications - minerals, and waste only)
  * Selby
  * Stratford
  * Suffolk Coastal
  * Vale Royal
  * Winchester

= Scrapes done, but sites broken =
  * Bromley (their site is totally nacked)
  * Doncaster (site down when attempted to test?)
  * Dundee (site down when attempted to test?)
  * Durham (City) - database appears to be empty though...
  * East Devon (Db Empty?)
  * Teignbridge (site down when attempted to test?)
  * West Berkshire (site down when attempted to test?)
  * Wolverhampton (empty database)