adrianshort
/
planningalerts
peilaus alkaen https://github.com/adrianshort/planningalerts.git
1
0
Fork 0
Koodi Ongelmat 0 Julkaisut 0 Wiki Toiminta
Automatically exported from code.google.com/p/planningalerts
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
1240 Commitit
2 Branchit
21 MiB
 
 
 
 
 
 
Puu: 726cde1511
Branchit Tagit
${ item.name }
Create branch ${ searchTerm }
from '726cde1511'
${ noResults }
planningalerts/trunk/python_scrapers
duncan.parkes@gmail.com 726cde1511 Fix Cannock Chase, though still no postcodes :-( 15 vuotta sitten
..
Aberdeenshire.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 vuotta sitten
AcolnetParser.py Fix Bassetlaw - slight change in url and results format. 15 vuotta sitten
AcolnetParser_HTMLParser.py Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser. 17 vuotta sitten
AmberValley.py Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so 16 vuotta sitten
ApplicationSearchServletParser.py Fix High Peak - extra column in results. 15 vuotta sitten
AtriumePlanning.py Fix Dorset County Council scraper (the council seem to be using an IP address now rather than the domain they had 16 vuotta sitten
Barnsley.py Add scraper for Barnsley. 16 vuotta sitten
Berwick.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 vuotta sitten
Birmingham.py Add scraper for Birmingham. 16 vuotta sitten
Brent.py Add scraper for Brent. 16 vuotta sitten
Brentwood.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 vuotta sitten
Brentwood.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 vuotta sitten
Broxbourne.cgi Rename Broxbourne scraper so that it matches the database. 17 vuotta sitten
Broxtowe.py Add scraper for Broxtowe. 16 vuotta sitten
CGITemplate.py This is a big refactor of the scrapers. 15 vuotta sitten
Cairngorms.py Add scraper for the Cairngorms National Park. 16 vuotta sitten
Calderdale.py Add scraper for Calderdale. 16 vuotta sitten
Carmarthenshire.py Fix Lichfield scraper. 16 vuotta sitten
Christchurch.cgi Add Somerset scraper 17 vuotta sitten
Crawley.py Make Crawley scraper work with python 2.5... 15 vuotta sitten
Dacorum.cgi Fix Lichfield scraper. 16 vuotta sitten
EastHerts.cgi Move some cgi scripts so that I can copy them in with the right file 17 vuotta sitten
Eastbourne.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go 16 vuotta sitten
Enfield.cgi Add back in the Enfield scraper which I probably deleted 17 vuotta sitten
Exmoor.py Add scraper for Exmoor. Fix name of Herefordshire. 16 vuotta sitten
FastWeb.py Oops - printing the sutton results twice... 16 vuotta sitten
Fife.py Add Forest of Dean and Fife parsers. 16 vuotta sitten
Flintshire.py Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where 16 vuotta sitten
ForestOfDean.py Add Forest of Dean and Fife parsers. 16 vuotta sitten
Glasgow.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 vuotta sitten
Glasgow.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 vuotta sitten
Gosport.py Gosport has been hardcoded for the last year to check one date in 2008 - woops! 15 vuotta sitten
HTTPHandlers.py Add scraper for Gosport. 16 vuotta sitten
Halton.py Adding scraper for Halton. 16 vuotta sitten
Hampshire.py Add Hampshire scraper. 16 vuotta sitten
Harrow.py Adding scraper for Harrow. 16 vuotta sitten
Hastings.py Add scraper for Hastings. Sadly, no decent info urls again. Had to use the search page. The real info url is only 16 vuotta sitten
Herefordshire.py Add scraper for Exmoor. Fix name of Herefordshire. 16 vuotta sitten
Highland.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 vuotta sitten
Highland.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 vuotta sitten
Hounslow.py Add scraper for Hounslow. 16 vuotta sitten
IsleOfWight.py Add Scraper for the Isle of Wight. 16 vuotta sitten
Kensington.py Add Kensington and Chelsea Scraper. 16 vuotta sitten
KingstonUponThames.py Add scraper for Kingston upon Thames. 16 vuotta sitten
Kirklees.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 vuotta sitten
Leicestershire.py Add scraper for Leicestershire County Council. 16 vuotta sitten
Lichfield.py Fix Lichfield scraper. 16 vuotta sitten
Maldon.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. 15 vuotta sitten
Medway.py Add Medway scraper. 16 vuotta sitten
MultipartPostHandler.py add some Acolnet sites: 17 vuotta sitten
Newport.cgi Add perl scraper from Peter for Newport. 16 vuotta sitten
Newport.pl Add perl scraper from Peter for Newport. 16 vuotta sitten
NorthAyrshire.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 vuotta sitten
NorthAyrshire.pl North Ayrshire, Redbridge: added 16 vuotta sitten
NorthHerts.cgi Move some cgi scripts so that I can copy them in with the right file 17 vuotta sitten
Ocella.py Fix Middlesbrough scraper. 15 vuotta sitten
Planet.py Add info url for Elmbridge. 15 vuotta sitten
PlanningExplorer.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. 15 vuotta sitten
PlanningUtils.py Add scraper for Mendip. 16 vuotta sitten
PublicAccess.py Bit of a refactor of PublicAccess in order to fix Hambleton. 15 vuotta sitten
README adding fastweb 17 vuotta sitten
Redbridge.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 vuotta sitten
Redbridge.pl North Ayrshire, Redbridge: added 16 vuotta sitten
RutlandLike.py Fix Lincoln parser. 16 vuotta sitten
Shetland.py Add scraper for Shetland Islands. 16 vuotta sitten
Shropshire.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. 15 vuotta sitten
Solihull.py Add Thomas' scraper for Solihull. 16 vuotta sitten
SouthOxfordshire.cgi expanded the api (still need to test some stuff) 17 vuotta sitten
SouthOxfordshireParser.py add the south oxfordshire scraper, and code to generate 17 vuotta sitten
SouthSomerset.cgi New version of South Somerset from Tom. 17 vuotta sitten
SwiftLG.py Fix Cannock Chase, though still no postcodes :-( 15 vuotta sitten
WAM.py Oops - remove pdb from AcolnetParser. 15 vuotta sitten
WestDorset.py Fix Tamworth scraper (change of IP address) 16 vuotta sitten
Westminster.py Go back to the urllib2 version of Westminster. This works on disruptiveproactivity. 16 vuotta sitten
Westminster_pycurl.py Adding scraper for Halton. 16 vuotta sitten
Weymouth.py Add scraper for Weymouth and Portland. 16 vuotta sitten
Wychavon.py Add Wychavon scraper from Thomas. 15 vuotta sitten
createCGI.sh remove offending svn rm line... 17 vuotta sitten

README 

In order to generate the contents of the CGI directory (../cgi-bin/)
run

./createCGI.sh

This script generates new cgi files in the CGI directory,
copies in some other files that are needed,
and commits all these changes to svn.

There is currently something very nasty in the permissions
column in the file OtherFilesToCopy.csv

Until version 2.6 of python, there appears to be no convenient
way to convert a string like 0755 into an octal. I am therefore
using integers to specify permissions of the copied files...

420 is 0644
493 is 0755

This is horrid, and must change in the future...