This allows us to do lots of sites without custom scrapers.
We also get a few that we didn't have before:
Bridgnorth
Canterbury
Guildford
Mid Suffolk (no postcodes)
Southwark
* Blackburn
* Camden - done (has OSGB)
* Charnwood (done, but site has a problem with its info links)
* Crewe and Nantwich
* East Staffordshire
* Epping Forest
* Hackney - done
* Kennet
* Lincoln (also has WAM)
* Liverpool
* South Shropshire
* South Tyneside
* Stockport
* Tamworth
I've included Camden, as the scraper works (their site is down today).
The scraper for Charnwood is fine (both the search results page and the info links fail to display in a browser, but
we are getting all the info out fine, and the links are correct. This appears to be a missing template on their
site).
I've included several authorities for which the scrapes work fine, but which don't have any postcodes. Some of these
have OSGB coords for each app, which we could maybe use instead.
* Broadland (no postcodes)
* Forest Heath (no postcodes)
* South Norfolk (appears to have WAM as well) (No postcodes - but has OSGB coords)
* Trafford (no postcodes)
* West Oxfordshire (no postcodes)
There are a few PlanningExplorer sites that are currently down, and which I haven't been able to do yet:
* Merton (site down)
* Shrewsbury (site is broken)
* Swansea (site is broken)
* Waltham Forest (currently giving an error)
This includes:
Cumbria
Lincolnshire
West Sussex
It should also include:
Dorset
Somerset
but they are both down.
All of these sites are county councils which are only responsible for a small number of apps, many of which are not
at sites which have postcodes, so don't expect too much from these scrapers!
This will handle Rutland, Melton, and any other sites
we find which look like them.
East Northants and Harborough both also have sites of this sort, but I suspect they are
being replaced by PublicAccess...
Rochford - not sure of problem - works with python scraper
Chester-le-Street - not sure of problem - works with python scraper
Vale of the White Horse not sure of problem - works with python scraper
Corby - changed to https, so using python scraper
North East Derbyshire - now tdc not dc
Haringey - this can never have worked as it was... the url was wrong.
Gravesham - new url
Suffolk Coastal - new url (old server still up so no error...)