adrianshort
/
planningalerts
spogulis no https://github.com/adrianshort/planningalerts.git
1
0
Atdalīts 0
Kods Problēmas 0 Laidieni 0 Vikivietne Aktivitāte
Automatically exported from code.google.com/p/planningalerts
Nevar pievienot vairāk kā 25 tēmas Tēmai ir jāsākas ar burtu vai ciparu, tā var saturēt domu zīmes ('-') un var būt līdz 35 simboliem gara.
342 Revīzijas
2 Atzari
1.3 MiB
 
 
 
 
 
 
Koks: ef6c073d70
Atzari Tagi
${ item.name }
Izveidot atzaru ${ searchTerm }
no 'ef6c073d70'
${ noResults }
planningalerts/python_scrapers
duncan.parkes ef6c073d70 Fix Greenwich - just the council moving things around in a pointless fashion. pirms 17 gadiem
..
Aberdeenshire.py Add parser for Kirklees. Get rid of some unnecessary imports. pirms 17 gadiem
AcolnetParser.py Fix Greenwich - just the council moving things around in a pointless fashion. pirms 17 gadiem
AcolnetParser_HTMLParser.py Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser. pirms 18 gadiem
AmberValley.py Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so pirms 17 gadiem
ApplicationSearchServletParser.py Update Rutland scraper to ApplicationSearchServlet - Rutland is no longer RutlandLike! pirms 17 gadiem
AtriumePlanning.py Fix Dorset County Council scraper (the council seem to be using an IP address now rather than the domain they had pirms 17 gadiem
Barnsley.py Add scraper for Barnsley. pirms 18 gadiem
Berwick.py Add parser for Kirklees. Get rid of some unnecessary imports. pirms 17 gadiem
Birmingham.py Add scraper for Birmingham. pirms 17 gadiem
Brent.py Add scraper for Brent. pirms 17 gadiem
Brentwood.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. pirms 18 gadiem
Brentwood.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. pirms 18 gadiem
Broxbourne.cgi Rename Broxbourne scraper so that it matches the database. pirms 18 gadiem
Broxtowe.py Add scraper for Broxtowe. pirms 17 gadiem
CGITemplate.py This is a big refactor of the scrapers. pirms 17 gadiem
Cairngorms.py Add scraper for the Cairngorms National Park. pirms 17 gadiem
Calderdale.py Add scraper for Calderdale. pirms 17 gadiem
Carmarthenshire.py Fix Lichfield scraper. pirms 17 gadiem
Christchurch.cgi Add Somerset scraper pirms 18 gadiem
Crawley.py Make Crawley scraper work with python 2.5... pirms 17 gadiem
Dacorum.cgi Fix Lichfield scraper. pirms 17 gadiem
EastHerts.cgi Move some cgi scripts so that I can copy them in with the right file pirms 18 gadiem
Eastbourne.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go pirms 17 gadiem
Enfield.cgi Add back in the Enfield scraper which I probably deleted pirms 18 gadiem
Exmoor.py Add scraper for Exmoor. Fix name of Herefordshire. pirms 17 gadiem
FastWeb.py Oops - printing the sutton results twice... pirms 17 gadiem
Fife.py Add Forest of Dean and Fife parsers. pirms 18 gadiem
Flintshire.py Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where pirms 18 gadiem
ForestOfDean.py Add Forest of Dean and Fife parsers. pirms 18 gadiem
Glasgow.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. pirms 18 gadiem
Glasgow.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. pirms 18 gadiem
Gosport.py Fix Mole Valley scraper. pirms 17 gadiem
HTTPHandlers.py Add scraper for Gosport. pirms 17 gadiem
Halton.py Adding scraper for Halton. pirms 17 gadiem
Hampshire.py Add Hampshire scraper. pirms 17 gadiem
Harrow.py Adding scraper for Harrow. pirms 17 gadiem
Hastings.py Add scraper for Hastings. Sadly, no decent info urls again. Had to use the search page. The real info url is only pirms 17 gadiem
Herefordshire.py Add scraper for Exmoor. Fix name of Herefordshire. pirms 17 gadiem
Highland.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites pirms 17 gadiem
Highland.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. pirms 18 gadiem
Hounslow.py Add scraper for Hounslow. pirms 17 gadiem
IsleOfWight.py Add Scraper for the Isle of Wight. pirms 18 gadiem
Kensington.py Add Kensington and Chelsea Scraper. pirms 18 gadiem
KingstonUponThames.py Add scraper for Kingston upon Thames. pirms 17 gadiem
Kirklees.py Add parser for Kirklees. Get rid of some unnecessary imports. pirms 17 gadiem
Leicestershire.py Add scraper for Leicestershire County Council. pirms 17 gadiem
Lichfield.py Fix Lichfield scraper. pirms 17 gadiem
Maldon.py Add Pendle scraper (this is basically the same as Maldon). pirms 18 gadiem
Medway.py Add Medway scraper. pirms 18 gadiem
Mendip.py Add scraper for Mendip. pirms 17 gadiem
MultipartPostHandler.py add some Acolnet sites: pirms 19 gadiem
Newport.cgi Add perl scraper from Peter for Newport. pirms 17 gadiem
Newport.pl Add perl scraper from Peter for Newport. pirms 17 gadiem
NorthAyrshire.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites pirms 17 gadiem
NorthAyrshire.pl North Ayrshire, Redbridge: added pirms 17 gadiem
NorthHerts.cgi Move some cgi scripts so that I can copy them in with the right file pirms 18 gadiem
Ocella.py Fix Middlesbrough scraper. pirms 17 gadiem
Planet.py Add info url for Elmbridge. pirms 17 gadiem
PlanningExplorer.py Remove a couple of permanently broken scrapers. pirms 17 gadiem
PlanningUtils.py Add scraper for Mendip. pirms 17 gadiem
PublicAccess.py Bit of a refactor of PublicAccess in order to fix Hambleton. pirms 17 gadiem
README adding fastweb pirms 18 gadiem
Redbridge.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites pirms 17 gadiem
Redbridge.pl North Ayrshire, Redbridge: added pirms 17 gadiem
RutlandLike.py Fix Lincoln parser. pirms 18 gadiem
Shetland.py Add scraper for Shetland Islands. pirms 18 gadiem
Shropshire.py Add Scraper for Lewes (which now has PublicAccess). pirms 18 gadiem
Solihull.py Add Thomas' scraper for Solihull. pirms 17 gadiem
SouthOxfordshire.cgi expanded the api (still need to test some stuff) pirms 19 gadiem
SouthOxfordshireParser.py add the south oxfordshire scraper, and code to generate pirms 19 gadiem
SouthSomerset.cgi New version of South Somerset from Tom. pirms 18 gadiem
SwiftLG.py Fix Lake District scraper - small change to the HTML reducing the depth of tables. pirms 17 gadiem
WAM.py Oops - remove pdb from AcolnetParser. pirms 17 gadiem
WestDorset.py Fix Tamworth scraper (change of IP address) pirms 17 gadiem
Westminster.py Go back to the urllib2 version of Westminster. This works on disruptiveproactivity. pirms 17 gadiem
Westminster_pycurl.py Adding scraper for Halton. pirms 17 gadiem
Weymouth.py Add scraper for Weymouth and Portland. pirms 17 gadiem
Wychavon.py Add Wychavon scraper from Thomas. pirms 17 gadiem
createCGI.sh remove offending svn rm line... pirms 19 gadiem

README 

In order to generate the contents of the CGI directory (../cgi-bin/)
run

./createCGI.sh

This script generates new cgi files in the CGI directory,
copies in some other files that are needed,
and commits all these changes to svn.

There is currently something very nasty in the permissions
column in the file OtherFilesToCopy.csv

Until version 2.6 of python, there appears to be no convenient
way to convert a string like 0755 into an octal. I am therefore
using integers to specify permissions of the copied files...

420 is 0644
493 is 0755

This is horrid, and must change in the future...