duncan.parkes
fff87cdfb3
Working scrapers for 8 Ocella sites.
před 16 roky
duncan.parkes
6c75c672a6
Add Ocella scraper that works for seven councils. Woop!
před 16 roky
duncan.parkes
e511044601
Add partially done Ocella scraper
před 16 roky
duncan.parkes
864636b9f0
Add scraper for Barnet.
před 16 roky
duncan.parkes
9018285d28
Set up planet scraper. This get's us 5 new councils (though one, Tewkesbury, has no postcodes)
před 16 roky
duncan.parkes
21b149f909
Adding Planet scraper (not quite finished, but this time I don't want to lose it!)
před 16 roky
duncan.parkes
7b054163f0
Fix Gloucestershire publicaccess (its moved)
před 16 roky
duncan.parkes
663ab4e604
Fix Wolverhampton
před 16 roky
duncan.parkes
e448d8d14a
Fix sheffield and moray.
před 16 roky
duncan.parkes
77403b597d
Adding hambleton scraper in php to see if it works :-)
před 16 roky
duncan.parkes
a8ab1c0491
New URL for Bolton - Bolton has ceased to be BoltonLike!
před 16 roky
duncan.parkes
02828bee32
Stockport has changed from planningexplorer to Acolnet.
před 16 roky
duncan.parkes
71c95fdf7f
Fix Kennet, which now has an interface like Broadland.
před 16 roky
duncan.parkes
2ddc86130d
Actually fix lincolnshire...
před 16 roky
duncan.parkes
42a53d6d41
Fix Lincolnshire (url has changed).
před 16 roky
duncan.parkes
a3d4b81b43
Fix Lincoln parser.
před 16 roky
duncan.parkes
e3671edb9c
Fix Melton - they have moved over to a PublicAccess.
před 16 roky
duncan.parkes
43c6eb25cf
Quote the & for Harlow comment url.
před 16 roky
duncan.parkes
28dbf0d579
Sort out Harlow comment url.
před 16 roky
duncan.parkes
70d7218bfd
Fix problem with Harlow. Council had moved the acolnet site to a different obscure location.
před 16 roky
duncan.parkes
cdcf82022a
Use the python scraper for North Hertfordshire.
před 17 roky
duncan.parkes
a124a4c3cd
Fix more acolnet parsers.
před 17 roky
duncan.parkes
bb6e536a73
Fix Hertsmere parser.
před 17 roky
duncan.parkes
e5c1a97d9c
Fix Bassetlaw parser.
před 17 roky
duncan.parkes
0f199a9a93
Fix Fylde parser.
před 17 roky
duncan.parkes
ce7bad8492
As usual, I forgot to make this work with python 2.4.
před 17 roky
duncan.parkes
96070fd3a1
Add scraper for the WAM sites (apart from Westminster, which is a bit different).
před 17 roky
duncan.parkes
b23bf56f12
Add Chichester, which now has a PublicAccess site.
před 17 roky
duncan.parkes
aa7d2b9914
Change the comments for Lewisham to use their email address, as per request.
před 17 roky
duncan.parkes
2be99c221e
Start implementing Merton Parser. There are going to be a few commits for a bit, as this doesn't work properly from
my machine...
před 17 roky
duncan.parkes
685f9f185a
Fix Edinburgh scraper.
před 17 roky
duncan.parkes
c1dc167ea9
Fix Canterbury parser.
před 17 roky
duncan.parkes
b5f1b1ae89
Fix a bug in almost all of the Acolnet scrapers.
Repeat to self: haggis is on python 2.4, haggis is on python 2.4, ...
před 17 roky
duncan.parkes
bd05c50ae6
Fix the Lewisham scraper.
It looks like there has been an update to most of the Acolnet sites.
I'll need to go through and look at the rest...
před 17 roky
duncan.parkes
76e5ec8732
Fix New Forest NPA.
před 17 roky
duncan.parkes
d54bb032b7
fix:
New Forest DC
Bolton
před 17 roky
duncan.parkes
b076e29712
Rather embarrassing import failure...
před 17 roky
duncan.parkes
e3e449e12c
Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser.
This allows us to do lots of sites without custom scrapers.
We also get a few that we didn't have before:
Bridgnorth
Canterbury
Guildford
Mid Suffolk (no postcodes)
Southwark
před 17 roky
duncan.parkes
b32aee3c1c
Add Somerset scraper
před 17 roky
duncan.parkes
711f1961f9
New version of South Somerset from Tom.
před 17 roky
duncan.parkes
593e9d8272
Add SouthSomerset, Christchurch and West Dorset.
We still need to sort out comment urls here.
před 17 roky
duncan.parkes
38f431bed1
Add Dacorum scraper.
před 17 roky
duncan.parkes
5e8781a7a9
Add Dorset CC scraper
před 17 roky
duncan.parkes
b98c452684
Add shrewsbury scraper.
před 17 roky
duncan.parkes
8b76d0fe99
Add Swansea scraper.
před 17 roky
duncan.parkes
c2684e39c8
Spell Hinckley correctly - this will need a change in the db too.
před 17 roky
duncan.parkes
5b3c561894
Add Boston, which I missed for some reason when I was doing the SwiftLG sites.
před 17 roky
duncan.parkes
cc07cc88ae
Add scrapers for the SwiftLG sites (apart from Daventry which is not responding today).
We already have scrapers for Islington and East Herts, but I'm adding the new ones as well - we can then see if we
get the same results :-)
před 17 roky
duncan.parkes
eab1ffa328
Oops. Forgot to add a file.
před 17 roky
duncan.parkes
fe6d58bd05
Add PlanningExplorer scrapers:
* Blackburn
* Camden - done (has OSGB)
* Charnwood (done, but site has a problem with its info links)
* Crewe and Nantwich
* East Staffordshire
* Epping Forest
* Hackney - done
* Kennet
* Lincoln (also has WAM)
* Liverpool
* South Shropshire
* South Tyneside
* Stockport
* Tamworth
I've included Camden, as the scraper works (their site is down today).
The scraper for Charnwood is fine (both the search results page and the info links fail to display in a browser, but
we are getting all the info out fine, and the links are correct. This appears to be a missing template on their
site).
I've included several authorities for which the scrapes work fine, but which don't have any postcodes. Some of these
have OSGB coords for each app, which we could maybe use instead.
* Broadland (no postcodes)
* Forest Heath (no postcodes)
* South Norfolk (appears to have WAM as well) (No postcodes - but has OSGB coords)
* Trafford (no postcodes)
* West Oxfordshire (no postcodes)
There are a few PlanningExplorer sites that are currently down, and which I haven't been able to do yet:
* Merton (site down)
* Shrewsbury (site is broken)
* Swansea (site is broken)
* Waltham Forest (currently giving an error)
před 17 roky