duncan.parkes
fff87cdfb3
Working scrapers for 8 Ocella sites.
16 lat temu
duncan.parkes
6c75c672a6
Add Ocella scraper that works for seven councils. Woop!
16 lat temu
duncan.parkes
e511044601
Add partially done Ocella scraper
16 lat temu
duncan.parkes
864636b9f0
Add scraper for Barnet.
16 lat temu
duncan.parkes
9018285d28
Set up planet scraper. This get's us 5 new councils (though one, Tewkesbury, has no postcodes)
16 lat temu
duncan.parkes
21b149f909
Adding Planet scraper (not quite finished, but this time I don't want to lose it!)
16 lat temu
duncan.parkes
7b054163f0
Fix Gloucestershire publicaccess (its moved)
16 lat temu
duncan.parkes
663ab4e604
Fix Wolverhampton
16 lat temu
duncan.parkes
e448d8d14a
Fix sheffield and moray.
16 lat temu
duncan.parkes
77403b597d
Adding hambleton scraper in php to see if it works :-)
16 lat temu
duncan.parkes
a8ab1c0491
New URL for Bolton - Bolton has ceased to be BoltonLike!
16 lat temu
duncan.parkes
02828bee32
Stockport has changed from planningexplorer to Acolnet.
16 lat temu
duncan.parkes
71c95fdf7f
Fix Kennet, which now has an interface like Broadland.
16 lat temu
duncan.parkes
2ddc86130d
Actually fix lincolnshire...
16 lat temu
duncan.parkes
42a53d6d41
Fix Lincolnshire (url has changed).
16 lat temu
duncan.parkes
a3d4b81b43
Fix Lincoln parser.
16 lat temu
duncan.parkes
e3671edb9c
Fix Melton - they have moved over to a PublicAccess.
16 lat temu
duncan.parkes
43c6eb25cf
Quote the & for Harlow comment url.
16 lat temu
duncan.parkes
28dbf0d579
Sort out Harlow comment url.
16 lat temu
duncan.parkes
70d7218bfd
Fix problem with Harlow. Council had moved the acolnet site to a different obscure location.
16 lat temu
duncan.parkes
cdcf82022a
Use the python scraper for North Hertfordshire.
17 lat temu
duncan.parkes
a124a4c3cd
Fix more acolnet parsers.
17 lat temu
duncan.parkes
bb6e536a73
Fix Hertsmere parser.
17 lat temu
duncan.parkes
e5c1a97d9c
Fix Bassetlaw parser.
17 lat temu
duncan.parkes
0f199a9a93
Fix Fylde parser.
17 lat temu
duncan.parkes
ce7bad8492
As usual, I forgot to make this work with python 2.4.
17 lat temu
duncan.parkes
96070fd3a1
Add scraper for the WAM sites (apart from Westminster, which is a bit different).
17 lat temu
duncan.parkes
b23bf56f12
Add Chichester, which now has a PublicAccess site.
17 lat temu
duncan.parkes
aa7d2b9914
Change the comments for Lewisham to use their email address, as per request.
17 lat temu
duncan.parkes
2be99c221e
Start implementing Merton Parser. There are going to be a few commits for a bit, as this doesn't work properly from
my machine...
17 lat temu
duncan.parkes
685f9f185a
Fix Edinburgh scraper.
17 lat temu
duncan.parkes
c1dc167ea9
Fix Canterbury parser.
17 lat temu
duncan.parkes
b5f1b1ae89
Fix a bug in almost all of the Acolnet scrapers.
Repeat to self: haggis is on python 2.4, haggis is on python 2.4, ...
17 lat temu
duncan.parkes
bd05c50ae6
Fix the Lewisham scraper.
It looks like there has been an update to most of the Acolnet sites.
I'll need to go through and look at the rest...
17 lat temu
duncan.parkes
76e5ec8732
Fix New Forest NPA.
17 lat temu
duncan.parkes
d54bb032b7
fix:
New Forest DC
Bolton
17 lat temu
duncan.parkes
b076e29712
Rather embarrassing import failure...
17 lat temu
duncan.parkes
e3e449e12c
Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser.
This allows us to do lots of sites without custom scrapers.
We also get a few that we didn't have before:
Bridgnorth
Canterbury
Guildford
Mid Suffolk (no postcodes)
Southwark
17 lat temu
duncan.parkes
b32aee3c1c
Add Somerset scraper
17 lat temu
duncan.parkes
711f1961f9
New version of South Somerset from Tom.
17 lat temu
duncan.parkes
593e9d8272
Add SouthSomerset, Christchurch and West Dorset.
We still need to sort out comment urls here.
17 lat temu
duncan.parkes
38f431bed1
Add Dacorum scraper.
17 lat temu
duncan.parkes
5e8781a7a9
Add Dorset CC scraper
17 lat temu
duncan.parkes
b98c452684
Add shrewsbury scraper.
17 lat temu
duncan.parkes
8b76d0fe99
Add Swansea scraper.
17 lat temu
duncan.parkes
c2684e39c8
Spell Hinckley correctly - this will need a change in the db too.
17 lat temu
duncan.parkes
5b3c561894
Add Boston, which I missed for some reason when I was doing the SwiftLG sites.
17 lat temu
duncan.parkes
cc07cc88ae
Add scrapers for the SwiftLG sites (apart from Daventry which is not responding today).
We already have scrapers for Islington and East Herts, but I'm adding the new ones as well - we can then see if we
get the same results :-)
17 lat temu
duncan.parkes
eab1ffa328
Oops. Forgot to add a file.
17 lat temu
duncan.parkes
fe6d58bd05
Add PlanningExplorer scrapers:
* Blackburn
* Camden - done (has OSGB)
* Charnwood (done, but site has a problem with its info links)
* Crewe and Nantwich
* East Staffordshire
* Epping Forest
* Hackney - done
* Kennet
* Lincoln (also has WAM)
* Liverpool
* South Shropshire
* South Tyneside
* Stockport
* Tamworth
I've included Camden, as the scraper works (their site is down today).
The scraper for Charnwood is fine (both the search results page and the info links fail to display in a browser, but
we are getting all the info out fine, and the links are correct. This appears to be a missing template on their
site).
I've included several authorities for which the scrapes work fine, but which don't have any postcodes. Some of these
have OSGB coords for each app, which we could maybe use instead.
* Broadland (no postcodes)
* Forest Heath (no postcodes)
* South Norfolk (appears to have WAM as well) (No postcodes - but has OSGB coords)
* Trafford (no postcodes)
* West Oxfordshire (no postcodes)
There are a few PlanningExplorer sites that are currently down, and which I haven't been able to do yet:
* Merton (site down)
* Shrewsbury (site is broken)
* Swansea (site is broken)
* Waltham Forest (currently giving an error)
17 lat temu