adrianshort
/
planningalerts
spogulis no https://github.com/adrianshort/planningalerts.git
1
0
Atdalīts 0
Kods Problēmas 0 Laidieni 0 Vikivietne Aktivitāte
Automatically exported from code.google.com/p/planningalerts
Nevar pievienot vairāk kā 25 tēmas Tēmai ir jāsākas ar burtu vai ciparu, tā var saturēt domu zīmes ('-') un var būt līdz 35 simboliem gara.
1246 Revīzijas
2 Atzari
21 MiB
 
 
 
 
 
 
Koks: 06aef67d45
Atzari Tagi
${ item.name }
Izveidot atzaru ${ searchTerm }
no '06aef67d45'
${ noResults }
planningalerts/trunk/python_scrapers
duncan.parkes@gmail.com f6b725c5bd Fix Bridgend and Middlesbrough pirms 15 gadiem
..
Aberdeenshire.py Add parser for Kirklees. Get rid of some unnecessary imports. pirms 16 gadiem
AcolnetParser.py Fix West Wiltshire - change of capitalization in url. pirms 15 gadiem
AcolnetParser_HTMLParser.py Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser. pirms 17 gadiem
AmberValley.py Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so pirms 16 gadiem
ApplicationSearchServletParser.py Fix High Peak - extra column in results. pirms 15 gadiem
AtriumePlanning.py Fix Dorset County Council scraper (the council seem to be using an IP address now rather than the domain they had pirms 16 gadiem
Barnsley.py Add scraper for Barnsley. pirms 16 gadiem
Berwick.py Add parser for Kirklees. Get rid of some unnecessary imports. pirms 16 gadiem
Birmingham.py Add scraper for Birmingham. pirms 16 gadiem
Brent.py Add scraper for Brent. pirms 16 gadiem
Brentwood.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. pirms 16 gadiem
Brentwood.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. pirms 16 gadiem
Broxbourne.cgi Rename Broxbourne scraper so that it matches the database. pirms 17 gadiem
Broxtowe.py Add scraper for Broxtowe. pirms 16 gadiem
CGITemplate.py This is a big refactor of the scrapers. pirms 15 gadiem
Cairngorms.py Add scraper for the Cairngorms National Park. pirms 16 gadiem
Calderdale.py Add scraper for Calderdale. pirms 16 gadiem
Carmarthenshire.py Fix Lichfield scraper. pirms 16 gadiem
Christchurch.cgi Add Somerset scraper pirms 17 gadiem
Crawley.py Make Crawley scraper work with python 2.5... pirms 15 gadiem
Dacorum.cgi Fix Lichfield scraper. pirms 16 gadiem
EastHerts.cgi Move some cgi scripts so that I can copy them in with the right file pirms 17 gadiem
Eastbourne.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go pirms 16 gadiem
Enfield.cgi Add back in the Enfield scraper which I probably deleted pirms 17 gadiem
Exmoor.py Add scraper for Exmoor. Fix name of Herefordshire. pirms 16 gadiem
FastWeb.py Oops - printing the sutton results twice... pirms 16 gadiem
Fife.py Add Forest of Dean and Fife parsers. pirms 16 gadiem
Flintshire.py Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where pirms 16 gadiem
ForestOfDean.py Add Forest of Dean and Fife parsers. pirms 16 gadiem
Glasgow.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. pirms 16 gadiem
Glasgow.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. pirms 16 gadiem
Gosport.py Gosport has been hardcoded for the last year to check one date in 2008 - woops! pirms 15 gadiem
HTTPHandlers.py Add scraper for Gosport. pirms 16 gadiem
Halton.py Adding scraper for Halton. pirms 16 gadiem
Hampshire.py Add Hampshire scraper. pirms 16 gadiem
Harrow.py Adding scraper for Harrow. pirms 16 gadiem
Hastings.py Fix West Wiltshire - change of capitalization in url. pirms 15 gadiem
Herefordshire.py Add scraper for Exmoor. Fix name of Herefordshire. pirms 16 gadiem
Highland.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites pirms 16 gadiem
Highland.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. pirms 16 gadiem
Hounslow.py Add scraper for Hounslow. pirms 16 gadiem
IsleOfWight.py Add Scraper for the Isle of Wight. pirms 16 gadiem
Kensington.py Add Kensington and Chelsea Scraper. pirms 16 gadiem
KingstonUponThames.py Add scraper for Kingston upon Thames. pirms 16 gadiem
Kirklees.py Add parser for Kirklees. Get rid of some unnecessary imports. pirms 16 gadiem
Leicestershire.py Add scraper for Leicestershire County Council. pirms 16 gadiem
Lichfield.py Fix Lichfield scraper. pirms 16 gadiem
Maldon.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. pirms 15 gadiem
Medway.py Add Medway scraper. pirms 16 gadiem
MultipartPostHandler.py add some Acolnet sites: pirms 17 gadiem
Newport.cgi Add perl scraper from Peter for Newport. pirms 16 gadiem
Newport.pl Add perl scraper from Peter for Newport. pirms 16 gadiem
NorthAyrshire.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites pirms 16 gadiem
NorthAyrshire.pl North Ayrshire, Redbridge: added pirms 16 gadiem
NorthHerts.cgi Move some cgi scripts so that I can copy them in with the right file pirms 17 gadiem
Ocella.py Fix Bridgend and Middlesbrough pirms 15 gadiem
Planet.py Add info url for Elmbridge. pirms 15 gadiem
PlanningExplorer.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. pirms 15 gadiem
PlanningUtils.py Add scraper for Mendip. pirms 16 gadiem
PublicAccess.py Bit of a refactor of PublicAccess in order to fix Hambleton. pirms 15 gadiem
README adding fastweb pirms 17 gadiem
Redbridge.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites pirms 16 gadiem
Redbridge.pl North Ayrshire, Redbridge: added pirms 16 gadiem
RutlandLike.py Fix Lincoln parser. pirms 16 gadiem
Shetland.py Add scraper for Shetland Islands. pirms 16 gadiem
Shropshire.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. pirms 15 gadiem
Solihull.py Add Thomas' scraper for Solihull. pirms 16 gadiem
SouthOxfordshire.cgi expanded the api (still need to test some stuff) pirms 17 gadiem
SouthOxfordshireParser.py add the south oxfordshire scraper, and code to generate pirms 17 gadiem
SouthSomerset.cgi New version of South Somerset from Tom. pirms 17 gadiem
SwiftLG.py Fix Bridgend and Middlesbrough pirms 15 gadiem
WAM.py Oops - remove pdb from AcolnetParser. pirms 15 gadiem
WestDorset.py Fix Tamworth scraper (change of IP address) pirms 16 gadiem
Westminster.py Go back to the urllib2 version of Westminster. This works on disruptiveproactivity. pirms 16 gadiem
Westminster_pycurl.py Adding scraper for Halton. pirms 16 gadiem
Weymouth.py Add scraper for Weymouth and Portland. pirms 16 gadiem
Wychavon.py Add Wychavon scraper from Thomas. pirms 15 gadiem
createCGI.sh remove offending svn rm line... pirms 17 gadiem

README 

In order to generate the contents of the CGI directory (../cgi-bin/)
run

./createCGI.sh

This script generates new cgi files in the CGI directory,
copies in some other files that are needed,
and commits all these changes to svn.

There is currently something very nasty in the permissions
column in the file OtherFilesToCopy.csv

Until version 2.6 of python, there appears to be no convenient
way to convert a string like 0755 into an octal. I am therefore
using integers to specify permissions of the copied files...

420 is 0644
493 is 0755

This is horrid, and must change in the future...