planningalerts

Automatically exported from code.google.com/p/planningalerts

duncan.parkes 55b14a2b71 This is a big refactor of the scrapers. The database table which says which scrapers are where will now be filled in automatically, which should result in rather less in the way of manual editing errors. I've also redone the python PublicAccess scraper and set all the PublicAccess sites to use it (removing the PHP PublicAccess scrapers).		преди 16 години
..
Aberdeenshire.py	Add parser for Kirklees. Get rid of some unnecessary imports.	преди 16 години
AcolnetParser.py	Fix Lewisham comments email address.	преди 16 години
AcolnetParser_HTMLParser.py	Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser.	преди 17 години
AmberValley.py	Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so	преди 16 години
ApplicationSearchServletParser.py	Daventry have replaced their nice url with an IP address...	преди 16 години
AtriumePlanning.py	Fix Dorset County Council scraper (the council seem to be using an IP address now rather than the domain they had	преди 16 години
Barnsley.py	Add scraper for Barnsley.	преди 16 години
Berwick.py	Add parser for Kirklees. Get rid of some unnecessary imports.	преди 16 години
Birmingham.py	Add scraper for Birmingham.	преди 16 години
Brent.py	Add scraper for Brent.	преди 16 години
Brentwood.cgi	Add Peter's scrapers for Highland, Glasgow, and Brentwood.	преди 16 години
Brentwood.pl	Add Peter's scrapers for Highland, Glasgow, and Brentwood.	преди 16 години
Broxbourne.cgi	Rename Broxbourne scraper so that it matches the database.	преди 17 години
Broxtowe.py	Add scraper for Broxtowe.	преди 16 години
CGITemplate.py	This is a big refactor of the scrapers.	преди 16 години
Cairngorms.py	Add scraper for the Cairngorms National Park.	преди 16 години
Calderdale.py	Add scraper for Calderdale.	преди 16 години
Carmarthenshire.py	Fix Lichfield scraper.	преди 16 години
Christchurch.cgi	Add Somerset scraper	преди 17 години
Dacorum.cgi	Fix Lichfield scraper.	преди 16 години
EastHerts.cgi	Move some cgi scripts so that I can copy them in with the right file	преди 17 години
Eastbourne.py	Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go	преди 16 години
Enfield.cgi	Add back in the Enfield scraper which I probably deleted	преди 17 години
Exmoor.py	Add scraper for Exmoor. Fix name of Herefordshire.	преди 16 години
FastWeb.py	Oops - printing the sutton results twice...	преди 16 години
Fife.py	Add Forest of Dean and Fife parsers.	преди 16 години
Flintshire.py	Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where	преди 16 години
ForestOfDean.py	Add Forest of Dean and Fife parsers.	преди 16 години
Glasgow.cgi	Add Peter's scrapers for Highland, Glasgow, and Brentwood.	преди 16 години
Glasgow.pl	Add Peter's scrapers for Highland, Glasgow, and Brentwood.	преди 16 години
Gosport.py	Fix Mole Valley scraper.	преди 16 години
HTTPHandlers.py	Add scraper for Gosport.	преди 16 години
Halton.py	Adding scraper for Halton.	преди 16 години
Hampshire.py	Add Hampshire scraper.	преди 16 години
Harrow.py	Adding scraper for Harrow.	преди 16 години
Hastings.py	Add scraper for Hastings. Sadly, no decent info urls again. Had to use the search page. The real info url is only	преди 16 години
Herefordshire.py	Add scraper for Exmoor. Fix name of Herefordshire.	преди 16 години
Highland.cgi	Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites	преди 16 години
Highland.pl	Add Peter's scrapers for Highland, Glasgow, and Brentwood.	преди 16 години
Hounslow.py	Add scraper for Hounslow.	преди 16 години
IsleOfWight.py	Add Scraper for the Isle of Wight.	преди 16 години
Kensington.py	Add Kensington and Chelsea Scraper.	преди 16 години
KingstonUponThames.py	Add scraper for Kingston upon Thames.	преди 16 години
Kirklees.py	Add parser for Kirklees. Get rid of some unnecessary imports.	преди 16 години
Leicestershire.py	Add scraper for Leicestershire County Council.	преди 16 години
Lichfield.py	Fix Lichfield scraper.	преди 16 години
Maldon.py	Add Pendle scraper (this is basically the same as Maldon).	преди 16 години
Medway.py	Add Medway scraper.	преди 16 години
Mendip.py	Add scraper for Mendip.	преди 16 години
MultipartPostHandler.py	add some Acolnet sites:	преди 17 години
Newport.cgi	Add perl scraper from Peter for Newport.	преди 16 години
Newport.pl	Add perl scraper from Peter for Newport.	преди 16 години
NorthAyrshire.cgi	Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites	преди 16 години
NorthAyrshire.pl	North Ayrshire, Redbridge: added	преди 16 години
NorthHerts.cgi	Move some cgi scripts so that I can copy them in with the right file	преди 17 години
Ocella.py	Fix Lichfield scraper.	преди 16 години
Planet.py	Fix Mole Valley scraper.	преди 16 години
PlanningExplorer.py	Fix Tamworth scraper (change of IP address)	преди 16 години
PlanningUtils.py	Add scraper for Mendip.	преди 16 години
PublicAccess.py	Update PublicAccess scraper to work with BeautifulSoup.	преди 16 години
README	adding fastweb	преди 17 години
Redbridge.cgi	Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites	преди 16 години
Redbridge.pl	North Ayrshire, Redbridge: added	преди 16 години
RutlandLike.py	Fix Lincoln parser.	преди 16 години
Shetland.py	Add scraper for Shetland Islands.	преди 16 години
Shropshire.py	Add Scraper for Lewes (which now has PublicAccess).	преди 16 години
Solihull.py	Add Thomas' scraper for Solihull.	преди 16 години
SouthOxfordshire.cgi	expanded the api (still need to test some stuff)	преди 17 години
SouthOxfordshireParser.py	add the south oxfordshire scraper, and code to generate	преди 17 години
SouthSomerset.cgi	New version of South Somerset from Tom.	преди 17 години
SwiftLG.py	Fix Mole Valley scraper.	преди 16 години
WAM.py	Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go	преди 16 години
WestDorset.py	Fix Tamworth scraper (change of IP address)	преди 16 години
Westminster.py	Go back to the urllib2 version of Westminster. This works on disruptiveproactivity.	преди 16 години
Westminster_pycurl.py	Adding scraper for Halton.	преди 16 години
Weymouth.py	Add scraper for Weymouth and Portland.	преди 16 години
createCGI.sh	remove offending svn rm line...	преди 17 години

README

In order to generate the contents of the CGI directory (../cgi-bin/)
run

./createCGI.sh

This script generates new cgi files in the CGI directory,
copies in some other files that are needed,
and commits all these changes to svn.

There is currently something very nasty in the permissions
column in the file OtherFilesToCopy.csv

Until version 2.6 of python, there appears to be no convenient
way to convert a string like 0755 into an octal. I am therefore
using integers to specify permissions of the copied files...

420 is 0644
493 is 0755

This is horrid, and must change in the future...