duncan.parkes
d030ce81db
Add scraper for Exmoor. Fix name of Herefordshire.
pirms 16 gadiem
duncan.parkes
48ec82b485
Add scraper for Herefordshire.
Alter PlanningUtils to CDATA everything, scrapping the xmlquote function.
pirms 16 gadiem
duncan.parkes
2bacbbb25a
Add scraper for Hastings. Sadly, no decent info urls again. Had to use the search page. The real info url is only
accessible with a referer.
pirms 16 gadiem
duncan.parkes
77b46a033d
Add Hampshire scraper.
pirms 16 gadiem
duncan.parkes
420356966c
Adding scraper for Halton.
Also adding the pycurl scraper for Westminster, just in case it is useful to remind us how to do stuff later.
pirms 16 gadiem
duncan.parkes
7f7c8a00bc
Go back to the urllib2 version of Westminster. This works on disruptiveproactivity.
pirms 16 gadiem
duncan.parkes
d303944e39
Add the debug back in.
pirms 16 gadiem
duncan.parkes
7410196fdd
Try a pycurl version of the Westminster scraper.
pirms 16 gadiem
duncan.parkes
ef6d27ee0a
Fix Lewisham comments email address.
pirms 16 gadiem
duncan.parkes
28aaf2eba5
Oops - printing the sutton results twice...
pirms 16 gadiem
duncan.parkes
ec5b631342
Add more debug.
pirms 16 gadiem
duncan.parkes
775b7f8cbc
Try moving prints to above the scrape (for Haringey and Westminster problem).
pirms 16 gadiem
duncan.parkes
f12fa60f29
Add newlines to the debug stuff in Westminster.
pirms 16 gadiem
duncan.parkes
3cc4d48397
Some debug (mostly for westminster).
pirms 16 gadiem
duncan.parkes
827f6a3c53
Carlisle url changed.
pirms 16 gadiem
duncan.parkes
cc961b2bce
Daventry have replaced their nice url with an IP address...
pirms 16 gadiem
duncan.parkes
797cedf1d3
Try declaring the charset as utf-8
pirms 16 gadiem
duncan.parkes
0e21adea7e
Fix Sutton parser.
pirms 16 gadiem
duncan.parkes
fa73ab577a
Add scraper for Westminster.
pirms 16 gadiem
duncan.parkes
7b5165b8bf
Adding scraper for Harrow.
The info url situation here is not really good enough.
All we get is a page with the last 7 days apps on it with no info urls.
I'm using that page as the info url for the moment, but it will obviously
be no use after seven days...
pirms 16 gadiem
duncan.parkes
da2be2c394
Add scraper for Hounslow.
pirms 16 gadiem
duncan.parkes
3c85f0d0dd
Add scraper for Kingston upon Thames.
pirms 16 gadiem
duncan.parkes
08e63c7566
Add scraper for Birmingham.
pirms 16 gadiem
duncan.parkes
06a293dc26
Add Berwick scraper.
pirms 16 gadiem
duncan.parkes
fcd3543d40
Add Carmarthenshire scraper.
pirms 16 gadiem
duncan.parkes
af50d991f3
Add scraper for Brent.
pirms 16 gadiem
duncan.parkes
782947887e
Add Aberdeenshire parser.
pirms 16 gadiem
duncan.parkes
80039af48c
Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so
have had to give the search url in all the info urls. Comment url works fine for each app.
pirms 16 gadiem
duncan.parkes
28bd0c8e2d
Fix Carlisle. It may still fail as it takes a stupid amount of time to come back.
pirms 16 gadiem
duncan.parkes
daba08d7c8
Fix Barking and Dagenham, which now has a PublicAccess site.
pirms 16 gadiem
pcc03@doc.ic.ac.uk
e28b89840c
North Ayrshire, Redbridge: added
pirms 16 gadiem
duncan.parkes
85d4e06064
Use the SwiftLG parser for Enfield.
pirms 16 gadiem
duncan.parkes
65719ee6ad
Add perl scraper from Peter for Newport.
Add scrapers for Merton and Conwy (PlanningExplorer)
pirms 16 gadiem
duncan.parkes
65cd63b54e
Add Peter's scrapers for Highland, Glasgow, and Brentwood.
pirms 16 gadiem
duncan.parkes
29076cb994
Fix Stockport (which is now acolnet, not PlanningExplorer).
Add Blackburn and Greenwich (acolnet sites - patch from Peter Collingbourne.
Fixes to Ocella parser (also from Peter). Adds Bridgend, Castle Point, Great Yarmouth, Havering).
Fix typo and escaping in getinvolved (patch from David Sheldon).
pirms 16 gadiem
duncan.parkes
c8a536e114
Add the Olympic Delivery Authority, which has a PublicAccess...
pirms 16 gadiem
duncan.parkes
1c366edbcf
Add Warrington.
pirms 16 gadiem
duncan.parkes
9909d744e3
Add Scraper for Lewes (which now has PublicAccess).
pirms 16 gadiem
duncan.parkes
b4aa0923bc
Add Shropshire, North Yorkshire and South Northamptonshire.
pirms 16 gadiem
duncan.parkes
c468a3e395
Add Pendle scraper (this is basically the same as Maldon).
pirms 16 gadiem
duncan.parkes
520a81c2c2
Add Medway scraper.
pirms 16 gadiem
duncan.parkes
927754c132
add scraper for Maldon.
This site is absolutely rubbish:
1) It's impossible to link to the info page - needs a cookie. I've put a link to the search page for the moment.
2) Many applications have no description. I've put the text "Description Missing" when this happens.
pirms 16 gadiem
duncan.parkes
b5dcd82e60
Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where
we don't have postcodes.
pirms 16 gadiem
duncan.parkes
821296b942
Add Forest of Dean and Fife parsers.
pirms 16 gadiem
duncan.parkes
65f70a3f06
Add East Hampshire parser.
pirms 16 gadiem
duncan.parkes
2b8228cfca
Add Comhairle Nan Eilean Siar scraper.
pirms 16 gadiem
duncan.parkes
2a0fe9d90a
Add Kensington and Chelsea Scraper.
pirms 16 gadiem
duncan.parkes
c7e8c06d7b
Add scraper for Shetland Islands.
Encode all output as UTF-8.
pirms 16 gadiem
duncan.parkes
c532bc1be2
Add mostly done shetland scraper.
pirms 16 gadiem
duncan.parkes
b44fb1db20
Add Daventry parser.
pirms 16 gadiem