planningalerts

Automatically exported from code.google.com/p/planningalerts

duncan.parkes 55b14a2b71 This is a big refactor of the scrapers. The database table which says which scrapers are where will now be filled in automatically, which should result in rather less in the way of manual editing errors. I've also redone the python PublicAccess scraper and set all the PublicAccess sites to use it (removing the PHP PublicAccess scrapers).		16 年前
..
Aberdeenshire.py	Add parser for Kirklees. Get rid of some unnecessary imports.	16 年前
AcolnetParser.py	Fix Lewisham comments email address.	16 年前
AcolnetParser_HTMLParser.py	Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser.	17 年前
AmberValley.py	Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so	16 年前
ApplicationSearchServletParser.py	Daventry have replaced their nice url with an IP address...	16 年前
AtriumePlanning.py	Fix Dorset County Council scraper (the council seem to be using an IP address now rather than the domain they had	16 年前
Barnsley.py	Add scraper for Barnsley.	16 年前
Berwick.py	Add parser for Kirklees. Get rid of some unnecessary imports.	16 年前
Birmingham.py	Add scraper for Birmingham.	16 年前
Brent.py	Add scraper for Brent.	16 年前
Brentwood.cgi	Add Peter's scrapers for Highland, Glasgow, and Brentwood.	16 年前
Brentwood.pl	Add Peter's scrapers for Highland, Glasgow, and Brentwood.	16 年前
Broxbourne.cgi	Rename Broxbourne scraper so that it matches the database.	17 年前
Broxtowe.py	Add scraper for Broxtowe.	16 年前
CGITemplate.py	This is a big refactor of the scrapers.	16 年前
Cairngorms.py	Add scraper for the Cairngorms National Park.	16 年前
Calderdale.py	Add scraper for Calderdale.	16 年前
Carmarthenshire.py	Fix Lichfield scraper.	16 年前
Christchurch.cgi	Add Somerset scraper	17 年前
Dacorum.cgi	Fix Lichfield scraper.	16 年前
EastHerts.cgi	Move some cgi scripts so that I can copy them in with the right file	17 年前
Eastbourne.py	Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go	16 年前
Enfield.cgi	Add back in the Enfield scraper which I probably deleted	17 年前
Exmoor.py	Add scraper for Exmoor. Fix name of Herefordshire.	16 年前
FastWeb.py	Oops - printing the sutton results twice...	16 年前
Fife.py	Add Forest of Dean and Fife parsers.	16 年前
Flintshire.py	Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where	16 年前
ForestOfDean.py	Add Forest of Dean and Fife parsers.	16 年前
Glasgow.cgi	Add Peter's scrapers for Highland, Glasgow, and Brentwood.	16 年前
Glasgow.pl	Add Peter's scrapers for Highland, Glasgow, and Brentwood.	16 年前
Gosport.py	Fix Mole Valley scraper.	16 年前
HTTPHandlers.py	Add scraper for Gosport.	16 年前
Halton.py	Adding scraper for Halton.	16 年前
Hampshire.py	Add Hampshire scraper.	16 年前
Harrow.py	Adding scraper for Harrow.	16 年前
Hastings.py	Add scraper for Hastings. Sadly, no decent info urls again. Had to use the search page. The real info url is only	16 年前
Herefordshire.py	Add scraper for Exmoor. Fix name of Herefordshire.	16 年前
Highland.cgi	Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites	16 年前
Highland.pl	Add Peter's scrapers for Highland, Glasgow, and Brentwood.	16 年前
Hounslow.py	Add scraper for Hounslow.	16 年前
IsleOfWight.py	Add Scraper for the Isle of Wight.	16 年前
Kensington.py	Add Kensington and Chelsea Scraper.	16 年前
KingstonUponThames.py	Add scraper for Kingston upon Thames.	16 年前
Kirklees.py	Add parser for Kirklees. Get rid of some unnecessary imports.	16 年前
Leicestershire.py	Add scraper for Leicestershire County Council.	16 年前
Lichfield.py	Fix Lichfield scraper.	16 年前
Maldon.py	Add Pendle scraper (this is basically the same as Maldon).	16 年前
Medway.py	Add Medway scraper.	16 年前
Mendip.py	Add scraper for Mendip.	16 年前
MultipartPostHandler.py	add some Acolnet sites:	17 年前
Newport.cgi	Add perl scraper from Peter for Newport.	16 年前
Newport.pl	Add perl scraper from Peter for Newport.	16 年前
NorthAyrshire.cgi	Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites	16 年前
NorthAyrshire.pl	North Ayrshire, Redbridge: added	16 年前
NorthHerts.cgi	Move some cgi scripts so that I can copy them in with the right file	17 年前
Ocella.py	Fix Lichfield scraper.	16 年前
Planet.py	Fix Mole Valley scraper.	16 年前
PlanningExplorer.py	Fix Tamworth scraper (change of IP address)	16 年前
PlanningUtils.py	Add scraper for Mendip.	16 年前
PublicAccess.py	Update PublicAccess scraper to work with BeautifulSoup.	16 年前
README	adding fastweb	17 年前
Redbridge.cgi	Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites	16 年前
Redbridge.pl	North Ayrshire, Redbridge: added	16 年前
RutlandLike.py	Fix Lincoln parser.	16 年前
Shetland.py	Add scraper for Shetland Islands.	16 年前
Shropshire.py	Add Scraper for Lewes (which now has PublicAccess).	16 年前
Solihull.py	Add Thomas' scraper for Solihull.	16 年前
SouthOxfordshire.cgi	expanded the api (still need to test some stuff)	17 年前
SouthOxfordshireParser.py	add the south oxfordshire scraper, and code to generate	17 年前
SouthSomerset.cgi	New version of South Somerset from Tom.	17 年前
SwiftLG.py	Fix Mole Valley scraper.	16 年前
WAM.py	Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go	16 年前
WestDorset.py	Fix Tamworth scraper (change of IP address)	16 年前
Westminster.py	Go back to the urllib2 version of Westminster. This works on disruptiveproactivity.	16 年前
Westminster_pycurl.py	Adding scraper for Halton.	16 年前
Weymouth.py	Add scraper for Weymouth and Portland.	16 年前
createCGI.sh	remove offending svn rm line...	17 年前

README

In order to generate the contents of the CGI directory (../cgi-bin/)
run

./createCGI.sh

This script generates new cgi files in the CGI directory,
copies in some other files that are needed,
and commits all these changes to svn.

There is currently something very nasty in the permissions
column in the file OtherFilesToCopy.csv

Until version 2.6 of python, there appears to be no convenient
way to convert a string like 0755 into an octal. I am therefore
using integers to specify permissions of the copied files...

420 is 0644
493 is 0755

This is horrid, and must change in the future...