duncan.parkes@gmail.com
442459bb05
Get rid of quoting.
пре 15 година
duncan.parkes@gmail.com
4ec1094887
Get rid of Mendip line.
пре 15 година
duncan.parkes@gmail.com
ee425b23b5
Add scraper for Crawley from Andre.
пре 15 година
duncan.parkes@gmail.com
e51eab174b
Add Wychavon scraper from Thomas.
пре 15 година
duncan.parkes
af6aea014f
This is a big refactor of the scrapers.
The database table which says which scrapers are where will now be filled in automatically,
which should result in rather less in the way of manual editing errors.
I've also redone the python PublicAccess scraper and set all the PublicAccess sites to use
it (removing the PHP PublicAccess scrapers).
пре 16 година
duncan.parkes
f37d02d3de
Add Thomas' scraper for Solihull.
пре 16 година
duncan.parkes
70a94ec280
Add scraper for Weymouth and Portland.
пре 16 година
duncan.parkes
887abe9652
Add scraper for Mendip.
Make display method on a planningapplication work out the postcode if it isn't set.
пре 16 година
duncan.parkes
77e9d3388f
Add scraper for Broxtowe.
пре 16 година
duncan.parkes
7810f01d83
Add scraper for Calderdale.
пре 16 година
duncan.parkes
689474a703
Add scraper for the Cairngorms National Park.
пре 16 година
duncan.parkes
70c0650637
Add scraper for Leicestershire County Council.
пре 16 година
duncan.parkes
f076ecc304
Add scraper for Lichfield. Remove another unused import.
пре 16 година
duncan.parkes
f0a0912836
Add parser for Kirklees. Get rid of some unnecessary imports.
пре 16 година
duncan.parkes
1761fa79b8
Add python parser for West Dorset, and remove the non-working perl one.
пре 16 година
duncan.parkes
ddc81f06ea
Add scraper for Gosport.
Factor out CookieAddingHTTPRedirectHandler.
пре 16 година
duncan.parkes
6cf496dfb9
Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go
back to them once you have the cookie, you're fine...
пре 16 година
duncan.parkes
d030ce81db
Add scraper for Exmoor. Fix name of Herefordshire.
пре 16 година
duncan.parkes
48ec82b485
Add scraper for Herefordshire.
Alter PlanningUtils to CDATA everything, scrapping the xmlquote function.
пре 16 година
duncan.parkes
2bacbbb25a
Add scraper for Hastings. Sadly, no decent info urls again. Had to use the search page. The real info url is only
accessible with a referer.
пре 16 година
duncan.parkes
77b46a033d
Add Hampshire scraper.
пре 16 година
duncan.parkes
420356966c
Adding scraper for Halton.
Also adding the pycurl scraper for Westminster, just in case it is useful to remind us how to do stuff later.
пре 16 година
duncan.parkes
fa73ab577a
Add scraper for Westminster.
пре 16 година
duncan.parkes
7b5165b8bf
Adding scraper for Harrow.
The info url situation here is not really good enough.
All we get is a page with the last 7 days apps on it with no info urls.
I'm using that page as the info url for the moment, but it will obviously
be no use after seven days...
пре 16 година
duncan.parkes
da2be2c394
Add scraper for Hounslow.
пре 16 година
duncan.parkes
3c85f0d0dd
Add scraper for Kingston upon Thames.
пре 16 година
duncan.parkes
08e63c7566
Add scraper for Birmingham.
пре 16 година
duncan.parkes
06a293dc26
Add Berwick scraper.
пре 16 година
duncan.parkes
fcd3543d40
Add Carmarthenshire scraper.
пре 16 година
duncan.parkes
af50d991f3
Add scraper for Brent.
пре 16 година
duncan.parkes
782947887e
Add Aberdeenshire parser.
пре 16 година
duncan.parkes
80039af48c
Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so
have had to give the search url in all the info urls. Comment url works fine for each app.
пре 16 година
pcc03@doc.ic.ac.uk
e28b89840c
North Ayrshire, Redbridge: added
пре 16 година
duncan.parkes
85d4e06064
Use the SwiftLG parser for Enfield.
пре 16 година
duncan.parkes
65719ee6ad
Add perl scraper from Peter for Newport.
Add scrapers for Merton and Conwy (PlanningExplorer)
пре 16 година
duncan.parkes
65cd63b54e
Add Peter's scrapers for Highland, Glasgow, and Brentwood.
пре 16 година
duncan.parkes
b4aa0923bc
Add Shropshire, North Yorkshire and South Northamptonshire.
пре 16 година
duncan.parkes
520a81c2c2
Add Medway scraper.
пре 16 година
duncan.parkes
927754c132
add scraper for Maldon.
This site is absolutely rubbish:
1) It's impossible to link to the info page - needs a cookie. I've put a link to the search page for the moment.
2) Many applications have no description. I've put the text "Description Missing" when this happens.
пре 16 година
duncan.parkes
b5dcd82e60
Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where
we don't have postcodes.
пре 16 година
duncan.parkes
821296b942
Add Forest of Dean and Fife parsers.
пре 16 година
duncan.parkes
2a0fe9d90a
Add Kensington and Chelsea Scraper.
пре 16 година
duncan.parkes
c7e8c06d7b
Add scraper for Shetland Islands.
Encode all output as UTF-8.
пре 16 година
duncan.parkes
320b641760
Add scraper for Barnsley.
пре 16 година
duncan.parkes
7930ed9b67
Add Scraper for the Isle of Wight.
пре 16 година
duncan.parkes
fff87cdfb3
Working scrapers for 8 Ocella sites.
пре 16 година
duncan.parkes
9018285d28
Set up planet scraper. This get's us 5 new councils (though one, Tewkesbury, has no postcodes)
пре 16 година
duncan.parkes
cdcf82022a
Use the python scraper for North Hertfordshire.
пре 17 година
duncan.parkes
96070fd3a1
Add scraper for the WAM sites (apart from Westminster, which is a bit different).
пре 17 година
duncan.parkes
593e9d8272
Add SouthSomerset, Christchurch and West Dorset.
We still need to sort out comment urls here.
пре 17 година