This allows us to do lots of sites without custom scrapers.
We also get a few that we didn't have before:

Bridgnorth
Canterbury
Guildford
Mid Suffolk (no postcodes)
Southwark

We still need to sort out comment urls here.

We already have scrapers for Islington and East Herts, but I'm adding the new ones as well - we can then see if we 
get the same results :-)

* Blackburn
    * Camden - done (has OSGB)
    * Charnwood (done, but site has a problem with its info links)
    * Crewe and Nantwich
    * East Staffordshire
    * Epping Forest
    * Hackney - done
    * Kennet
    * Lincoln (also has WAM)
    * Liverpool
    * South Shropshire
    * South Tyneside
    * Stockport
    * Tamworth

I've included Camden, as the scraper works (their site is down today).
The scraper for Charnwood is fine (both the search results page and the info links fail to display in a browser, but 
we are getting all the info out fine, and the links are correct. This appears to be a missing template on their 
site).

I've included several authorities for which the scrapes work fine, but which don't have any postcodes. Some of these 
have OSGB coords for each app, which we could maybe use instead.

    * Broadland (no postcodes)
    * Forest Heath (no postcodes)
    * South Norfolk (appears to have WAM as well) (No postcodes - but has OSGB coords)
    * Trafford (no postcodes)
    * West Oxfordshire (no postcodes)

There are a few PlanningExplorer sites that are currently down, and which I haven't been able to do yet:

    * Merton (site down)
    * Shrewsbury (site is broken)
    * Swansea (site is broken)
    * Waltham Forest (currently giving an error)

This includes:
Cumbria
Lincolnshire
West Sussex

It should also include:
Dorset
Somerset

but they are both down.

All of these sites are county councils which are only responsible for a small number of apps, many of which are not 
at sites which have postcodes, so don't expect too much from these scrapers!

This will handle Rutland, Melton, and any other sites 
we find which look like them.
East Northants and Harborough both also have sites of this sort, but I suspect they are
being replaced by PublicAccess...

Rochford - not sure of problem - works with python scraper
Chester-le-Street - not sure of problem - works with python scraper
Vale of the White Horse not sure of problem - works with python scraper
Corby - changed to https, so using python scraper
North East Derbyshire - now tdc not dc
Haringey - this can never have worked as it was... the url was wrong.
Gravesham - new url
Suffolk Coastal - new url (old server still up so no error...)

and api.

automatically a while back. Sorry!

Delete some files from cgi-bin which are now moved in my the deployment 
script.

permissions...

slightly different style after 21/06/2006

fix reason in deployment log

23/08/2007)
add reason to log and email.