adrianshort
/
planningalerts
Mirror von https://github.com/adrianshort/planningalerts.git
1
0
Fork 0
Code Issues 0 Releases 0 Wiki Aktivität
Automatically exported from code.google.com/p/planningalerts
Du kannst nicht mehr als 25 Themen auswählen Themen müssen entweder mit einem Buchstaben oder einer Ziffer beginnen. Sie können Bindestriche („-“) enthalten und bis zu 35 Zeichen lang sein.
1240 Commits
2 Branches
21 MiB
 
 
 
 
 
 
Struktur: 726cde1511
Branches Tags
${ item.name }
Erstelle Branch ${ searchTerm }
von „726cde1511“
${ noResults }
planningalerts/trunk/python_scrapers
duncan.parkes@gmail.com 726cde1511 Fix Cannock Chase, though still no postcodes :-( vor 15 Jahren
..
Aberdeenshire.py Add parser for Kirklees. Get rid of some unnecessary imports. vor 16 Jahren
AcolnetParser.py Fix Bassetlaw - slight change in url and results format. vor 15 Jahren
AcolnetParser_HTMLParser.py Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser. vor 17 Jahren
AmberValley.py Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so vor 16 Jahren
ApplicationSearchServletParser.py Fix High Peak - extra column in results. vor 15 Jahren
AtriumePlanning.py Fix Dorset County Council scraper (the council seem to be using an IP address now rather than the domain they had vor 16 Jahren
Barnsley.py Add scraper for Barnsley. vor 16 Jahren
Berwick.py Add parser for Kirklees. Get rid of some unnecessary imports. vor 16 Jahren
Birmingham.py Add scraper for Birmingham. vor 16 Jahren
Brent.py Add scraper for Brent. vor 16 Jahren
Brentwood.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. vor 16 Jahren
Brentwood.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. vor 16 Jahren
Broxbourne.cgi Rename Broxbourne scraper so that it matches the database. vor 17 Jahren
Broxtowe.py Add scraper for Broxtowe. vor 16 Jahren
CGITemplate.py This is a big refactor of the scrapers. vor 15 Jahren
Cairngorms.py Add scraper for the Cairngorms National Park. vor 16 Jahren
Calderdale.py Add scraper for Calderdale. vor 16 Jahren
Carmarthenshire.py Fix Lichfield scraper. vor 16 Jahren
Christchurch.cgi Add Somerset scraper vor 17 Jahren
Crawley.py Make Crawley scraper work with python 2.5... vor 15 Jahren
Dacorum.cgi Fix Lichfield scraper. vor 16 Jahren
EastHerts.cgi Move some cgi scripts so that I can copy them in with the right file vor 17 Jahren
Eastbourne.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go vor 16 Jahren
Enfield.cgi Add back in the Enfield scraper which I probably deleted vor 17 Jahren
Exmoor.py Add scraper for Exmoor. Fix name of Herefordshire. vor 16 Jahren
FastWeb.py Oops - printing the sutton results twice... vor 16 Jahren
Fife.py Add Forest of Dean and Fife parsers. vor 16 Jahren
Flintshire.py Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where vor 16 Jahren
ForestOfDean.py Add Forest of Dean and Fife parsers. vor 16 Jahren
Glasgow.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. vor 16 Jahren
Glasgow.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. vor 16 Jahren
Gosport.py Gosport has been hardcoded for the last year to check one date in 2008 - woops! vor 15 Jahren
HTTPHandlers.py Add scraper for Gosport. vor 16 Jahren
Halton.py Adding scraper for Halton. vor 16 Jahren
Hampshire.py Add Hampshire scraper. vor 16 Jahren
Harrow.py Adding scraper for Harrow. vor 16 Jahren
Hastings.py Add scraper for Hastings. Sadly, no decent info urls again. Had to use the search page. The real info url is only vor 16 Jahren
Herefordshire.py Add scraper for Exmoor. Fix name of Herefordshire. vor 16 Jahren
Highland.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites vor 16 Jahren
Highland.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. vor 16 Jahren
Hounslow.py Add scraper for Hounslow. vor 16 Jahren
IsleOfWight.py Add Scraper for the Isle of Wight. vor 16 Jahren
Kensington.py Add Kensington and Chelsea Scraper. vor 16 Jahren
KingstonUponThames.py Add scraper for Kingston upon Thames. vor 16 Jahren
Kirklees.py Add parser for Kirklees. Get rid of some unnecessary imports. vor 16 Jahren
Leicestershire.py Add scraper for Leicestershire County Council. vor 16 Jahren
Lichfield.py Fix Lichfield scraper. vor 16 Jahren
Maldon.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. vor 15 Jahren
Medway.py Add Medway scraper. vor 16 Jahren
MultipartPostHandler.py add some Acolnet sites: vor 17 Jahren
Newport.cgi Add perl scraper from Peter for Newport. vor 16 Jahren
Newport.pl Add perl scraper from Peter for Newport. vor 16 Jahren
NorthAyrshire.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites vor 16 Jahren
NorthAyrshire.pl North Ayrshire, Redbridge: added vor 16 Jahren
NorthHerts.cgi Move some cgi scripts so that I can copy them in with the right file vor 17 Jahren
Ocella.py Fix Middlesbrough scraper. vor 15 Jahren
Planet.py Add info url for Elmbridge. vor 15 Jahren
PlanningExplorer.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. vor 15 Jahren
PlanningUtils.py Add scraper for Mendip. vor 16 Jahren
PublicAccess.py Bit of a refactor of PublicAccess in order to fix Hambleton. vor 15 Jahren
README adding fastweb vor 17 Jahren
Redbridge.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites vor 16 Jahren
Redbridge.pl North Ayrshire, Redbridge: added vor 16 Jahren
RutlandLike.py Fix Lincoln parser. vor 16 Jahren
Shetland.py Add scraper for Shetland Islands. vor 16 Jahren
Shropshire.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. vor 15 Jahren
Solihull.py Add Thomas' scraper for Solihull. vor 16 Jahren
SouthOxfordshire.cgi expanded the api (still need to test some stuff) vor 17 Jahren
SouthOxfordshireParser.py add the south oxfordshire scraper, and code to generate vor 17 Jahren
SouthSomerset.cgi New version of South Somerset from Tom. vor 17 Jahren
SwiftLG.py Fix Cannock Chase, though still no postcodes :-( vor 15 Jahren
WAM.py Oops - remove pdb from AcolnetParser. vor 15 Jahren
WestDorset.py Fix Tamworth scraper (change of IP address) vor 16 Jahren
Westminster.py Go back to the urllib2 version of Westminster. This works on disruptiveproactivity. vor 16 Jahren
Westminster_pycurl.py Adding scraper for Halton. vor 16 Jahren
Weymouth.py Add scraper for Weymouth and Portland. vor 16 Jahren
Wychavon.py Add Wychavon scraper from Thomas. vor 15 Jahren
createCGI.sh remove offending svn rm line... vor 17 Jahren

README 

In order to generate the contents of the CGI directory (../cgi-bin/)
run

./createCGI.sh

This script generates new cgi files in the CGI directory,
copies in some other files that are needed,
and commits all these changes to svn.

There is currently something very nasty in the permissions
column in the file OtherFilesToCopy.csv

Until version 2.6 of python, there appears to be no convenient
way to convert a string like 0755 into an octal. I am therefore
using integers to specify permissions of the copied files...

420 is 0644
493 is 0755

This is horrid, and must change in the future...