duncan.parkes
2bacbbb25a
Add scraper for Hastings. Sadly, no decent info urls again. Had to use the search page. The real info url is only
accessible with a referer.
16 роки тому
duncan.parkes
77b46a033d
Add Hampshire scraper.
16 роки тому
duncan.parkes
420356966c
Adding scraper for Halton.
Also adding the pycurl scraper for Westminster, just in case it is useful to remind us how to do stuff later.
16 роки тому
duncan.parkes
7f7c8a00bc
Go back to the urllib2 version of Westminster. This works on disruptiveproactivity.
16 роки тому
duncan.parkes
d303944e39
Add the debug back in.
16 роки тому
duncan.parkes
7410196fdd
Try a pycurl version of the Westminster scraper.
16 роки тому
duncan.parkes
ef6d27ee0a
Fix Lewisham comments email address.
16 роки тому
duncan.parkes
28aaf2eba5
Oops - printing the sutton results twice...
16 роки тому
duncan.parkes
ec5b631342
Add more debug.
16 роки тому
duncan.parkes
775b7f8cbc
Try moving prints to above the scrape (for Haringey and Westminster problem).
16 роки тому
duncan.parkes
f12fa60f29
Add newlines to the debug stuff in Westminster.
16 роки тому
duncan.parkes
3cc4d48397
Some debug (mostly for westminster).
16 роки тому
duncan.parkes
827f6a3c53
Carlisle url changed.
16 роки тому
duncan.parkes
cc961b2bce
Daventry have replaced their nice url with an IP address...
16 роки тому
duncan.parkes
797cedf1d3
Try declaring the charset as utf-8
16 роки тому
duncan.parkes
0e21adea7e
Fix Sutton parser.
16 роки тому
duncan.parkes
fa73ab577a
Add scraper for Westminster.
16 роки тому
duncan.parkes
7b5165b8bf
Adding scraper for Harrow.
The info url situation here is not really good enough.
All we get is a page with the last 7 days apps on it with no info urls.
I'm using that page as the info url for the moment, but it will obviously
be no use after seven days...
16 роки тому
duncan.parkes
da2be2c394
Add scraper for Hounslow.
16 роки тому
duncan.parkes
3c85f0d0dd
Add scraper for Kingston upon Thames.
16 роки тому
duncan.parkes
08e63c7566
Add scraper for Birmingham.
16 роки тому
duncan.parkes
06a293dc26
Add Berwick scraper.
16 роки тому
duncan.parkes
fcd3543d40
Add Carmarthenshire scraper.
16 роки тому
duncan.parkes
af50d991f3
Add scraper for Brent.
16 роки тому
duncan.parkes
782947887e
Add Aberdeenshire parser.
16 роки тому
duncan.parkes
80039af48c
Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so
have had to give the search url in all the info urls. Comment url works fine for each app.
16 роки тому
duncan.parkes
28bd0c8e2d
Fix Carlisle. It may still fail as it takes a stupid amount of time to come back.
16 роки тому
duncan.parkes
daba08d7c8
Fix Barking and Dagenham, which now has a PublicAccess site.
16 роки тому
pcc03@doc.ic.ac.uk
e28b89840c
North Ayrshire, Redbridge: added
16 роки тому
duncan.parkes
85d4e06064
Use the SwiftLG parser for Enfield.
16 роки тому
duncan.parkes
65719ee6ad
Add perl scraper from Peter for Newport.
Add scrapers for Merton and Conwy (PlanningExplorer)
16 роки тому
duncan.parkes
65cd63b54e
Add Peter's scrapers for Highland, Glasgow, and Brentwood.
16 роки тому
duncan.parkes
29076cb994
Fix Stockport (which is now acolnet, not PlanningExplorer).
Add Blackburn and Greenwich (acolnet sites - patch from Peter Collingbourne.
Fixes to Ocella parser (also from Peter). Adds Bridgend, Castle Point, Great Yarmouth, Havering).
Fix typo and escaping in getinvolved (patch from David Sheldon).
16 роки тому
duncan.parkes
c8a536e114
Add the Olympic Delivery Authority, which has a PublicAccess...
16 роки тому
duncan.parkes
1c366edbcf
Add Warrington.
16 роки тому
duncan.parkes
9909d744e3
Add Scraper for Lewes (which now has PublicAccess).
16 роки тому
duncan.parkes
b4aa0923bc
Add Shropshire, North Yorkshire and South Northamptonshire.
16 роки тому
duncan.parkes
c468a3e395
Add Pendle scraper (this is basically the same as Maldon).
16 роки тому
duncan.parkes
520a81c2c2
Add Medway scraper.
16 роки тому
duncan.parkes
927754c132
add scraper for Maldon.
This site is absolutely rubbish:
1) It's impossible to link to the info page - needs a cookie. I've put a link to the search page for the moment.
2) Many applications have no description. I've put the text "Description Missing" when this happens.
16 роки тому
duncan.parkes
b5dcd82e60
Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where
we don't have postcodes.
16 роки тому
duncan.parkes
821296b942
Add Forest of Dean and Fife parsers.
16 роки тому
duncan.parkes
65f70a3f06
Add East Hampshire parser.
16 роки тому
duncan.parkes
2b8228cfca
Add Comhairle Nan Eilean Siar scraper.
16 роки тому
duncan.parkes
2a0fe9d90a
Add Kensington and Chelsea Scraper.
16 роки тому
duncan.parkes
c7e8c06d7b
Add scraper for Shetland Islands.
Encode all output as UTF-8.
16 роки тому
duncan.parkes
c532bc1be2
Add mostly done shetland scraper.
16 роки тому
duncan.parkes
b44fb1db20
Add Daventry parser.
16 роки тому
duncan.parkes
320b641760
Add scraper for Barnsley.
16 роки тому
duncan.parkes
7930ed9b67
Add Scraper for the Isle of Wight.
16 роки тому