duncan.parkes@gmail.com
442459bb05
Get rid of quoting.
15 년 전
duncan.parkes@gmail.com
4ec1094887
Get rid of Mendip line.
15 년 전
duncan.parkes@gmail.com
ee425b23b5
Add scraper for Crawley from Andre.
15 년 전
duncan.parkes@gmail.com
e51eab174b
Add Wychavon scraper from Thomas.
15 년 전
duncan.parkes
af6aea014f
This is a big refactor of the scrapers.
The database table which says which scrapers are where will now be filled in automatically,
which should result in rather less in the way of manual editing errors.
I've also redone the python PublicAccess scraper and set all the PublicAccess sites to use
it (removing the PHP PublicAccess scrapers).
16 년 전
duncan.parkes
f37d02d3de
Add Thomas' scraper for Solihull.
16 년 전
duncan.parkes
70a94ec280
Add scraper for Weymouth and Portland.
16 년 전
duncan.parkes
887abe9652
Add scraper for Mendip.
Make display method on a planningapplication work out the postcode if it isn't set.
16 년 전
duncan.parkes
77e9d3388f
Add scraper for Broxtowe.
16 년 전
duncan.parkes
7810f01d83
Add scraper for Calderdale.
16 년 전
duncan.parkes
689474a703
Add scraper for the Cairngorms National Park.
16 년 전
duncan.parkes
70c0650637
Add scraper for Leicestershire County Council.
16 년 전
duncan.parkes
f076ecc304
Add scraper for Lichfield. Remove another unused import.
16 년 전
duncan.parkes
f0a0912836
Add parser for Kirklees. Get rid of some unnecessary imports.
16 년 전
duncan.parkes
1761fa79b8
Add python parser for West Dorset, and remove the non-working perl one.
16 년 전
duncan.parkes
ddc81f06ea
Add scraper for Gosport.
Factor out CookieAddingHTTPRedirectHandler.
16 년 전
duncan.parkes
6cf496dfb9
Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go
back to them once you have the cookie, you're fine...
16 년 전
duncan.parkes
d030ce81db
Add scraper for Exmoor. Fix name of Herefordshire.
16 년 전
duncan.parkes
48ec82b485
Add scraper for Herefordshire.
Alter PlanningUtils to CDATA everything, scrapping the xmlquote function.
16 년 전
duncan.parkes
2bacbbb25a
Add scraper for Hastings. Sadly, no decent info urls again. Had to use the search page. The real info url is only
accessible with a referer.
16 년 전
duncan.parkes
77b46a033d
Add Hampshire scraper.
16 년 전
duncan.parkes
420356966c
Adding scraper for Halton.
Also adding the pycurl scraper for Westminster, just in case it is useful to remind us how to do stuff later.
16 년 전
duncan.parkes
fa73ab577a
Add scraper for Westminster.
16 년 전
duncan.parkes
7b5165b8bf
Adding scraper for Harrow.
The info url situation here is not really good enough.
All we get is a page with the last 7 days apps on it with no info urls.
I'm using that page as the info url for the moment, but it will obviously
be no use after seven days...
16 년 전
duncan.parkes
da2be2c394
Add scraper for Hounslow.
16 년 전
duncan.parkes
3c85f0d0dd
Add scraper for Kingston upon Thames.
16 년 전
duncan.parkes
08e63c7566
Add scraper for Birmingham.
16 년 전
duncan.parkes
06a293dc26
Add Berwick scraper.
16 년 전
duncan.parkes
fcd3543d40
Add Carmarthenshire scraper.
16 년 전
duncan.parkes
af50d991f3
Add scraper for Brent.
16 년 전
duncan.parkes
782947887e
Add Aberdeenshire parser.
16 년 전
duncan.parkes
80039af48c
Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so
have had to give the search url in all the info urls. Comment url works fine for each app.
16 년 전
pcc03@doc.ic.ac.uk
e28b89840c
North Ayrshire, Redbridge: added
16 년 전
duncan.parkes
85d4e06064
Use the SwiftLG parser for Enfield.
16 년 전
duncan.parkes
65719ee6ad
Add perl scraper from Peter for Newport.
Add scrapers for Merton and Conwy (PlanningExplorer)
16 년 전
duncan.parkes
65cd63b54e
Add Peter's scrapers for Highland, Glasgow, and Brentwood.
16 년 전
duncan.parkes
b4aa0923bc
Add Shropshire, North Yorkshire and South Northamptonshire.
16 년 전
duncan.parkes
520a81c2c2
Add Medway scraper.
16 년 전
duncan.parkes
927754c132
add scraper for Maldon.
This site is absolutely rubbish:
1) It's impossible to link to the info page - needs a cookie. I've put a link to the search page for the moment.
2) Many applications have no description. I've put the text "Description Missing" when this happens.
16 년 전
duncan.parkes
b5dcd82e60
Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where
we don't have postcodes.
16 년 전
duncan.parkes
821296b942
Add Forest of Dean and Fife parsers.
16 년 전
duncan.parkes
2a0fe9d90a
Add Kensington and Chelsea Scraper.
16 년 전
duncan.parkes
c7e8c06d7b
Add scraper for Shetland Islands.
Encode all output as UTF-8.
16 년 전
duncan.parkes
320b641760
Add scraper for Barnsley.
16 년 전
duncan.parkes
7930ed9b67
Add Scraper for the Isle of Wight.
16 년 전
duncan.parkes
fff87cdfb3
Working scrapers for 8 Ocella sites.
16 년 전
duncan.parkes
9018285d28
Set up planet scraper. This get's us 5 new councils (though one, Tewkesbury, has no postcodes)
16 년 전
duncan.parkes
cdcf82022a
Use the python scraper for North Hertfordshire.
17 년 전
duncan.parkes
96070fd3a1
Add scraper for the WAM sites (apart from Westminster, which is a bit different).
17 년 전
duncan.parkes
593e9d8272
Add SouthSomerset, Christchurch and West Dorset.
We still need to sort out comment urls here.
17 년 전