The info url situation here is not really good enough.
All we get is a page with the last 7 days apps on it with no info urls.
I'm using that page as the info url for the moment, but it will obviously
be no use after seven days...
This site is absolutely rubbish:
1) It's impossible to link to the info page - needs a cookie. I've put a link to the search page for the moment.
2) Many applications have no description. I've put the text "Description Missing" when this happens.
* Blackburn
* Camden - done (has OSGB)
* Charnwood (done, but site has a problem with its info links)
* Crewe and Nantwich
* East Staffordshire
* Epping Forest
* Hackney - done
* Kennet
* Lincoln (also has WAM)
* Liverpool
* South Shropshire
* South Tyneside
* Stockport
* Tamworth
I've included Camden, as the scraper works (their site is down today).
The scraper for Charnwood is fine (both the search results page and the info links fail to display in a browser, but
we are getting all the info out fine, and the links are correct. This appears to be a missing template on their
site).
I've included several authorities for which the scrapes work fine, but which don't have any postcodes. Some of these
have OSGB coords for each app, which we could maybe use instead.
* Broadland (no postcodes)
* Forest Heath (no postcodes)
* South Norfolk (appears to have WAM as well) (No postcodes - but has OSGB coords)
* Trafford (no postcodes)
* West Oxfordshire (no postcodes)
There are a few PlanningExplorer sites that are currently down, and which I haven't been able to do yet:
* Merton (site down)
* Shrewsbury (site is broken)
* Swansea (site is broken)
* Waltham Forest (currently giving an error)
This includes:
Cumbria
Lincolnshire
West Sussex
It should also include:
Dorset
Somerset
but they are both down.
All of these sites are county councils which are only responsible for a small number of apps, many of which are not
at sites which have postcodes, so don't expect too much from these scrapers!
This will handle Rutland, Melton, and any other sites
we find which look like them.
East Northants and Harborough both also have sites of this sort, but I suspect they are
being replaced by PublicAccess...