adrianshort
/
planningalerts
spegling av https://github.com/adrianshort/planningalerts.git
1
0
Förgrening 0
Kod Ärenden 0 Släpp 0 Wiki Aktiviteter
Automatically exported from code.google.com/p/planningalerts
Du kan inte välja fler än 25 ämnen Ämnen måste starta med en bokstav eller siffra, kan innehålla bindestreck ('-') och vara max 35 tecken långa.
294 Incheckningar
2 Grenar
1.3 MiB
 
 
 
 
 
 
Träd: 42d99b3e7f
Grenar Taggar
${ item.name }
Skapa branchen ${ searchTerm }
från '42d99b3e7f'
${ noResults }
planningalerts/python_scrapers
duncan.parkes 42d99b3e7f Add scraper for Broxtowe. 16 år sedan
..
Aberdeenshire.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 år sedan
AcolnetParser.py Fix Lewisham comments email address. 16 år sedan
AcolnetParser_HTMLParser.py Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser. 17 år sedan
AmberValley.py Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so 16 år sedan
ApplicationSearchServletParser.py Daventry have replaced their nice url with an IP address... 16 år sedan
AtriumePlanning.py Fix Dorset County Council scraper (the council seem to be using an IP address now rather than the domain they had 16 år sedan
Barnsley.py Add scraper for Barnsley. 16 år sedan
Berwick.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 år sedan
Birmingham.py Add scraper for Birmingham. 16 år sedan
Brent.py Add scraper for Brent. 16 år sedan
Brentwood.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 år sedan
Brentwood.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 år sedan
Broxbourne.cgi Rename Broxbourne scraper so that it matches the database. 17 år sedan
Broxtowe.py Add scraper for Broxtowe. 16 år sedan
CGITemplate Add more debug. 16 år sedan
Cairngorms.py Add scraper for the Cairngorms National Park. 16 år sedan
Calderdale.py Add scraper for Calderdale. 16 år sedan
Carmarthenshire.py Add scraper for Lichfield. Remove another unused import. 16 år sedan
Christchurch.cgi Add Somerset scraper 17 år sedan
Dacorum.cgi Fix the Dacorum perl parser. 16 år sedan
EastHerts.cgi Move some cgi scripts so that I can copy them in with the right file 17 år sedan
Eastbourne.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go 16 år sedan
Enfield.cgi Add back in the Enfield scraper which I probably deleted 17 år sedan
Exmoor.py Add scraper for Exmoor. Fix name of Herefordshire. 16 år sedan
FastWeb.py Oops - printing the sutton results twice... 16 år sedan
Fife.py Add Forest of Dean and Fife parsers. 16 år sedan
Flintshire.py Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where 16 år sedan
ForestOfDean.py Add Forest of Dean and Fife parsers. 16 år sedan
Glasgow.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 år sedan
Glasgow.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 år sedan
Gosport.py Add scraper for Gosport. 16 år sedan
HTTPHandlers.py Add scraper for Gosport. 16 år sedan
Halton.py Adding scraper for Halton. 16 år sedan
Hampshire.py Add Hampshire scraper. 16 år sedan
Harrow.py Adding scraper for Harrow. 16 år sedan
Hastings.py Add scraper for Hastings. Sadly, no decent info urls again. Had to use the search page. The real info url is only 16 år sedan
Herefordshire.py Add scraper for Exmoor. Fix name of Herefordshire. 16 år sedan
Highland.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 år sedan
Highland.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 år sedan
Hounslow.py Add scraper for Hounslow. 16 år sedan
IsleOfWight.py Add Scraper for the Isle of Wight. 16 år sedan
Kensington.py Add Kensington and Chelsea Scraper. 16 år sedan
KingstonUponThames.py Add scraper for Kingston upon Thames. 16 år sedan
Kirklees.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 år sedan
Leicestershire.py Add scraper for Leicestershire County Council. 16 år sedan
Lichfield.py Add scraper for Lichfield. Remove another unused import. 16 år sedan
Maldon.py Add Pendle scraper (this is basically the same as Maldon). 16 år sedan
Medway.py Add Medway scraper. 16 år sedan
MultipartPostHandler.py add some Acolnet sites: 17 år sedan
Newport.cgi Add perl scraper from Peter for Newport. 16 år sedan
Newport.pl Add perl scraper from Peter for Newport. 16 år sedan
NorthAyrshire.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 år sedan
NorthAyrshire.pl North Ayrshire, Redbridge: added 16 år sedan
NorthHerts.cgi Move some cgi scripts so that I can copy them in with the right file 17 år sedan
Ocella.py Add scraper for Gosport. 16 år sedan
OtherFilesToCopy.csv Add scraper for Broxtowe. 16 år sedan
Planet.py Set up planet scraper. This get's us 5 new councils (though one, Tewkesbury, has no postcodes) 16 år sedan
PlanningExplorer.py Change some PlanningExplorer scrapers to use date_registered rather than date_received. 16 år sedan
PlanningUtils.py Add scraper for Herefordshire. 16 år sedan
PublicAccess.py Some debug (mostly for westminster). 16 år sedan
README adding fastweb 17 år sedan
Redbridge.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 år sedan
Redbridge.pl North Ayrshire, Redbridge: added 16 år sedan
RutlandLike.py Fix Lincoln parser. 16 år sedan
Shetland.py Add scraper for Shetland Islands. 16 år sedan
Shropshire.py Add Scraper for Lewes (which now has PublicAccess). 16 år sedan
SitesToGenerate.csv Add scraper for Broxtowe. 16 år sedan
SouthOxfordshire.cgi expanded the api (still need to test some stuff) 17 år sedan
SouthOxfordshireParser.py add the south oxfordshire scraper, and code to generate 17 år sedan
SouthSomerset.cgi New version of South Somerset from Tom. 17 år sedan
SwiftLG.py Some debug (mostly for westminster). 16 år sedan
WAM.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go 16 år sedan
WestDorset.py Add python parser for West Dorset, and remove the non-working perl one. 16 år sedan
Westminster.py Go back to the urllib2 version of Westminster. This works on disruptiveproactivity. 16 år sedan
Westminster_pycurl.py Adding scraper for Halton. 16 år sedan
createCGI.sh remove offending svn rm line... 17 år sedan
generateCGIScripts.py adding fastweb 17 år sedan

README 

In order to generate the contents of the CGI directory (../cgi-bin/)
run

./createCGI.sh

This script generates new cgi files in the CGI directory,
copies in some other files that are needed,
and commits all these changes to svn.

There is currently something very nasty in the permissions
column in the file OtherFilesToCopy.csv

Until version 2.6 of python, there appears to be no convenient
way to convert a string like 0755 into an octal. I am therefore
using integers to specify permissions of the copied files...

420 is 0644
493 is 0755

This is horrid, and must change in the future...