adrianshort
/
planningalerts
miroir de https://github.com/adrianshort/planningalerts.git
1
0
Bifurcation 0
Code Tickets 0 Versions 0 Wiki Activité
Automatically exported from code.google.com/p/planningalerts
Vous ne pouvez pas sélectionner plus de 25 sujets Les noms de sujets doivent commencer par une lettre ou un nombre, peuvent contenir des tirets ('-') et peuvent comporter jusqu'à 35 caractères.
1234 Révisions
2 Branches
21 MiB
 
 
 
 
 
 
Aborescence: 39113540bf
Branches Tags
${ item.name }
Créer la branche ${ searchTerm }
de '39113540bf'
${ noResults }
planningalerts/trunk/python_scrapers
duncan.parkes@gmail.com 9259758c93 Fix High Peak - extra column in results. il y a 15 ans
..
Aberdeenshire.py Add parser for Kirklees. Get rid of some unnecessary imports. il y a 16 ans
AcolnetParser.py Fix Greenwich - just the council moving things around in a pointless fashion. il y a 15 ans
AcolnetParser_HTMLParser.py Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser. il y a 17 ans
AmberValley.py Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so il y a 16 ans
ApplicationSearchServletParser.py Fix High Peak - extra column in results. il y a 15 ans
AtriumePlanning.py Fix Dorset County Council scraper (the council seem to be using an IP address now rather than the domain they had il y a 16 ans
Barnsley.py Add scraper for Barnsley. il y a 16 ans
Berwick.py Add parser for Kirklees. Get rid of some unnecessary imports. il y a 16 ans
Birmingham.py Add scraper for Birmingham. il y a 16 ans
Brent.py Add scraper for Brent. il y a 16 ans
Brentwood.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. il y a 16 ans
Brentwood.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. il y a 16 ans
Broxbourne.cgi Rename Broxbourne scraper so that it matches the database. il y a 17 ans
Broxtowe.py Add scraper for Broxtowe. il y a 16 ans
CGITemplate.py This is a big refactor of the scrapers. il y a 15 ans
Cairngorms.py Add scraper for the Cairngorms National Park. il y a 16 ans
Calderdale.py Add scraper for Calderdale. il y a 16 ans
Carmarthenshire.py Fix Lichfield scraper. il y a 16 ans
Christchurch.cgi Add Somerset scraper il y a 17 ans
Crawley.py Make Crawley scraper work with python 2.5... il y a 15 ans
Dacorum.cgi Fix Lichfield scraper. il y a 16 ans
EastHerts.cgi Move some cgi scripts so that I can copy them in with the right file il y a 17 ans
Eastbourne.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go il y a 16 ans
Enfield.cgi Add back in the Enfield scraper which I probably deleted il y a 17 ans
Exmoor.py Add scraper for Exmoor. Fix name of Herefordshire. il y a 16 ans
FastWeb.py Oops - printing the sutton results twice... il y a 16 ans
Fife.py Add Forest of Dean and Fife parsers. il y a 16 ans
Flintshire.py Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where il y a 16 ans
ForestOfDean.py Add Forest of Dean and Fife parsers. il y a 16 ans
Glasgow.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. il y a 16 ans
Glasgow.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. il y a 16 ans
Gosport.py Fix Mole Valley scraper. il y a 16 ans
HTTPHandlers.py Add scraper for Gosport. il y a 16 ans
Halton.py Adding scraper for Halton. il y a 16 ans
Hampshire.py Add Hampshire scraper. il y a 16 ans
Harrow.py Adding scraper for Harrow. il y a 16 ans
Hastings.py Add scraper for Hastings. Sadly, no decent info urls again. Had to use the search page. The real info url is only il y a 16 ans
Herefordshire.py Add scraper for Exmoor. Fix name of Herefordshire. il y a 16 ans
Highland.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites il y a 16 ans
Highland.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. il y a 16 ans
Hounslow.py Add scraper for Hounslow. il y a 16 ans
IsleOfWight.py Add Scraper for the Isle of Wight. il y a 16 ans
Kensington.py Add Kensington and Chelsea Scraper. il y a 16 ans
KingstonUponThames.py Add scraper for Kingston upon Thames. il y a 16 ans
Kirklees.py Add parser for Kirklees. Get rid of some unnecessary imports. il y a 16 ans
Leicestershire.py Add scraper for Leicestershire County Council. il y a 16 ans
Lichfield.py Fix Lichfield scraper. il y a 16 ans
Maldon.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. il y a 15 ans
Medway.py Add Medway scraper. il y a 16 ans
MultipartPostHandler.py add some Acolnet sites: il y a 17 ans
Newport.cgi Add perl scraper from Peter for Newport. il y a 16 ans
Newport.pl Add perl scraper from Peter for Newport. il y a 16 ans
NorthAyrshire.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites il y a 16 ans
NorthAyrshire.pl North Ayrshire, Redbridge: added il y a 16 ans
NorthHerts.cgi Move some cgi scripts so that I can copy them in with the right file il y a 17 ans
Ocella.py Fix Middlesbrough scraper. il y a 15 ans
Planet.py Add info url for Elmbridge. il y a 15 ans
PlanningExplorer.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. il y a 15 ans
PlanningUtils.py Add scraper for Mendip. il y a 16 ans
PublicAccess.py Bit of a refactor of PublicAccess in order to fix Hambleton. il y a 15 ans
README adding fastweb il y a 17 ans
Redbridge.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites il y a 16 ans
Redbridge.pl North Ayrshire, Redbridge: added il y a 16 ans
RutlandLike.py Fix Lincoln parser. il y a 16 ans
Shetland.py Add scraper for Shetland Islands. il y a 16 ans
Shropshire.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. il y a 15 ans
Solihull.py Add Thomas' scraper for Solihull. il y a 16 ans
SouthOxfordshire.cgi expanded the api (still need to test some stuff) il y a 17 ans
SouthOxfordshireParser.py add the south oxfordshire scraper, and code to generate il y a 17 ans
SouthSomerset.cgi New version of South Somerset from Tom. il y a 17 ans
SwiftLG.py Fix Lake District scraper - small change to the HTML reducing the depth of tables. il y a 15 ans
WAM.py Oops - remove pdb from AcolnetParser. il y a 15 ans
WestDorset.py Fix Tamworth scraper (change of IP address) il y a 16 ans
Westminster.py Go back to the urllib2 version of Westminster. This works on disruptiveproactivity. il y a 16 ans
Westminster_pycurl.py Adding scraper for Halton. il y a 16 ans
Weymouth.py Add scraper for Weymouth and Portland. il y a 16 ans
Wychavon.py Add Wychavon scraper from Thomas. il y a 15 ans
createCGI.sh remove offending svn rm line... il y a 17 ans

README 

In order to generate the contents of the CGI directory (../cgi-bin/)
run

./createCGI.sh

This script generates new cgi files in the CGI directory,
copies in some other files that are needed,
and commits all these changes to svn.

There is currently something very nasty in the permissions
column in the file OtherFilesToCopy.csv

Until version 2.6 of python, there appears to be no convenient
way to convert a string like 0755 into an octal. I am therefore
using integers to specify permissions of the copied files...

420 is 0644
493 is 0755

This is horrid, and must change in the future...