adrianshort
/
planningalerts
kopia lustrzana https://github.com/adrianshort/planningalerts.git
1
0
Forkuj 0
Kod Zgłoszenia 0 Wydania 0 Wiki Aktywność
Automatically exported from code.google.com/p/planningalerts
Nie możesz wybrać więcej, niż 25 tematów Tematy muszą się zaczynać od litery lub cyfry, mogą zawierać myślniki ('-') i mogą mieć do 35 znaków.
1165 Commity
2 Gałęzie
21 MiB
 
 
 
 
 
 
Drzewo: 4ea9836f1e
Gałęzie Tagi
${ item.name }
Utwórz gałąź ${ searchTerm }
z '4ea9836f1e'
${ noResults }
planningalerts/trunk/python_scrapers
duncan.parkes 4ea9836f1e Fix Tamworth scraper (change of IP address) 16 lat temu
..
Aberdeenshire.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 lat temu
AcolnetParser.py Fix Lewisham comments email address. 16 lat temu
AcolnetParser_HTMLParser.py Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser. 17 lat temu
AmberValley.py Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so 16 lat temu
ApplicationSearchServletParser.py Daventry have replaced their nice url with an IP address... 16 lat temu
AtriumePlanning.py Fix Dorset County Council scraper (the council seem to be using an IP address now rather than the domain they had 16 lat temu
Barnsley.py Add scraper for Barnsley. 16 lat temu
Berwick.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 lat temu
Birmingham.py Add scraper for Birmingham. 16 lat temu
Brent.py Add scraper for Brent. 16 lat temu
Brentwood.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 lat temu
Brentwood.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 lat temu
Broxbourne.cgi Rename Broxbourne scraper so that it matches the database. 17 lat temu
Broxtowe.py Add scraper for Broxtowe. 16 lat temu
CGITemplate Add more debug. 16 lat temu
Cairngorms.py Add scraper for the Cairngorms National Park. 16 lat temu
Calderdale.py Add scraper for Calderdale. 16 lat temu
Carmarthenshire.py Add scraper for Lichfield. Remove another unused import. 16 lat temu
Christchurch.cgi Add Somerset scraper 17 lat temu
Dacorum.cgi Fix the Dacorum perl parser. 16 lat temu
EastHerts.cgi Move some cgi scripts so that I can copy them in with the right file 17 lat temu
Eastbourne.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go 16 lat temu
Enfield.cgi Add back in the Enfield scraper which I probably deleted 17 lat temu
Exmoor.py Add scraper for Exmoor. Fix name of Herefordshire. 16 lat temu
FastWeb.py Oops - printing the sutton results twice... 16 lat temu
Fife.py Add Forest of Dean and Fife parsers. 16 lat temu
Flintshire.py Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where 16 lat temu
ForestOfDean.py Add Forest of Dean and Fife parsers. 16 lat temu
Glasgow.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 lat temu
Glasgow.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 lat temu
Gosport.py Add scraper for Gosport. 16 lat temu
HTTPHandlers.py Add scraper for Gosport. 16 lat temu
Halton.py Adding scraper for Halton. 16 lat temu
Hampshire.py Add Hampshire scraper. 16 lat temu
Harrow.py Adding scraper for Harrow. 16 lat temu
Hastings.py Add scraper for Hastings. Sadly, no decent info urls again. Had to use the search page. The real info url is only 16 lat temu
Herefordshire.py Add scraper for Exmoor. Fix name of Herefordshire. 16 lat temu
Highland.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 lat temu
Highland.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 lat temu
Hounslow.py Add scraper for Hounslow. 16 lat temu
IsleOfWight.py Add Scraper for the Isle of Wight. 16 lat temu
Kensington.py Add Kensington and Chelsea Scraper. 16 lat temu
KingstonUponThames.py Add scraper for Kingston upon Thames. 16 lat temu
Kirklees.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 lat temu
Leicestershire.py Add scraper for Leicestershire County Council. 16 lat temu
Lichfield.py Add scraper for Lichfield. Remove another unused import. 16 lat temu
Maldon.py Add Pendle scraper (this is basically the same as Maldon). 16 lat temu
Medway.py Add Medway scraper. 16 lat temu
Mendip.py Add scraper for Mendip. 16 lat temu
MultipartPostHandler.py add some Acolnet sites: 17 lat temu
Newport.cgi Add perl scraper from Peter for Newport. 16 lat temu
Newport.pl Add perl scraper from Peter for Newport. 16 lat temu
NorthAyrshire.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 lat temu
NorthAyrshire.pl North Ayrshire, Redbridge: added 16 lat temu
NorthHerts.cgi Move some cgi scripts so that I can copy them in with the right file 17 lat temu
Ocella.py Add scraper for Gosport. 16 lat temu
OtherFilesToCopy.csv Add Thomas' scraper for Solihull. 16 lat temu
Planet.py Set up planet scraper. This get's us 5 new councils (though one, Tewkesbury, has no postcodes) 16 lat temu
PlanningExplorer.py Fix Tamworth scraper (change of IP address) 16 lat temu
PlanningUtils.py Add scraper for Mendip. 16 lat temu
PublicAccess.py Some debug (mostly for westminster). 16 lat temu
README adding fastweb 17 lat temu
Redbridge.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 lat temu
Redbridge.pl North Ayrshire, Redbridge: added 16 lat temu
RutlandLike.py Fix Lincoln parser. 16 lat temu
Shetland.py Add scraper for Shetland Islands. 16 lat temu
Shropshire.py Add Scraper for Lewes (which now has PublicAccess). 16 lat temu
SitesToGenerate.csv Fix Tamworth scraper (change of IP address) 16 lat temu
Solihull.py Add Thomas' scraper for Solihull. 16 lat temu
SouthOxfordshire.cgi expanded the api (still need to test some stuff) 17 lat temu
SouthOxfordshireParser.py add the south oxfordshire scraper, and code to generate 17 lat temu
SouthSomerset.cgi New version of South Somerset from Tom. 17 lat temu
SwiftLG.py Some debug (mostly for westminster). 16 lat temu
WAM.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go 16 lat temu
WestDorset.py Fix Tamworth scraper (change of IP address) 16 lat temu
Westminster.py Go back to the urllib2 version of Westminster. This works on disruptiveproactivity. 16 lat temu
Westminster_pycurl.py Adding scraper for Halton. 16 lat temu
Weymouth.py Add scraper for Weymouth and Portland. 16 lat temu
createCGI.sh remove offending svn rm line... 17 lat temu
generateCGIScripts.py adding fastweb 17 lat temu

README 

In order to generate the contents of the CGI directory (../cgi-bin/)
run

./createCGI.sh

This script generates new cgi files in the CGI directory,
copies in some other files that are needed,
and commits all these changes to svn.

There is currently something very nasty in the permissions
column in the file OtherFilesToCopy.csv

Until version 2.6 of python, there appears to be no convenient
way to convert a string like 0755 into an octal. I am therefore
using integers to specify permissions of the copied files...

420 is 0644
493 is 0755

This is horrid, and must change in the future...