adrianshort
/
planningalerts
espelho de https://github.com/adrianshort/planningalerts.git
1
0
Derivar 0
Código Questões 0 Lançamentos 0 Wiki Trabalho
Automatically exported from code.google.com/p/planningalerts
Não pode escolher mais do que 25 tópicos Os tópicos devem começar com uma letra ou um número, podem incluir traços ('-') e podem ter até 35 caracteres.
1157 Cometimentos
2 Ramos
1.3 MiB
 
 
 
 
 
 
Árvore: 42fff04c3a
Ramos Etiquetas
${ item.name }
Criar ramo ${ searchTerm }
de '42fff04c3a'
${ noResults }
planningalerts/trunk/python_scrapers
duncan.parkes 887abe9652 Add scraper for Mendip. há 16 anos
..
Aberdeenshire.py Add parser for Kirklees. Get rid of some unnecessary imports. há 16 anos
AcolnetParser.py Fix Lewisham comments email address. há 16 anos
AcolnetParser_HTMLParser.py Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser. há 17 anos
AmberValley.py Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so há 16 anos
ApplicationSearchServletParser.py Daventry have replaced their nice url with an IP address... há 16 anos
AtriumePlanning.py Fix Dorset County Council scraper (the council seem to be using an IP address now rather than the domain they had há 16 anos
Barnsley.py Add scraper for Barnsley. há 16 anos
Berwick.py Add parser for Kirklees. Get rid of some unnecessary imports. há 16 anos
Birmingham.py Add scraper for Birmingham. há 16 anos
Brent.py Add scraper for Brent. há 16 anos
Brentwood.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. há 16 anos
Brentwood.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. há 16 anos
Broxbourne.cgi Rename Broxbourne scraper so that it matches the database. há 17 anos
Broxtowe.py Add scraper for Broxtowe. há 16 anos
CGITemplate Add more debug. há 16 anos
Cairngorms.py Add scraper for the Cairngorms National Park. há 16 anos
Calderdale.py Add scraper for Calderdale. há 16 anos
Carmarthenshire.py Add scraper for Lichfield. Remove another unused import. há 16 anos
Christchurch.cgi Add Somerset scraper há 17 anos
Dacorum.cgi Fix the Dacorum perl parser. há 16 anos
EastHerts.cgi Move some cgi scripts so that I can copy them in with the right file há 17 anos
Eastbourne.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go há 16 anos
Enfield.cgi Add back in the Enfield scraper which I probably deleted há 17 anos
Exmoor.py Add scraper for Exmoor. Fix name of Herefordshire. há 16 anos
FastWeb.py Oops - printing the sutton results twice... há 16 anos
Fife.py Add Forest of Dean and Fife parsers. há 16 anos
Flintshire.py Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where há 16 anos
ForestOfDean.py Add Forest of Dean and Fife parsers. há 16 anos
Glasgow.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. há 16 anos
Glasgow.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. há 16 anos
Gosport.py Add scraper for Gosport. há 16 anos
HTTPHandlers.py Add scraper for Gosport. há 16 anos
Halton.py Adding scraper for Halton. há 16 anos
Hampshire.py Add Hampshire scraper. há 16 anos
Harrow.py Adding scraper for Harrow. há 16 anos
Hastings.py Add scraper for Hastings. Sadly, no decent info urls again. Had to use the search page. The real info url is only há 16 anos
Herefordshire.py Add scraper for Exmoor. Fix name of Herefordshire. há 16 anos
Highland.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites há 16 anos
Highland.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. há 16 anos
Hounslow.py Add scraper for Hounslow. há 16 anos
IsleOfWight.py Add Scraper for the Isle of Wight. há 16 anos
Kensington.py Add Kensington and Chelsea Scraper. há 16 anos
KingstonUponThames.py Add scraper for Kingston upon Thames. há 16 anos
Kirklees.py Add parser for Kirklees. Get rid of some unnecessary imports. há 16 anos
Leicestershire.py Add scraper for Leicestershire County Council. há 16 anos
Lichfield.py Add scraper for Lichfield. Remove another unused import. há 16 anos
Maldon.py Add Pendle scraper (this is basically the same as Maldon). há 16 anos
Medway.py Add Medway scraper. há 16 anos
Mendip.py Add scraper for Mendip. há 16 anos
MultipartPostHandler.py add some Acolnet sites: há 17 anos
Newport.cgi Add perl scraper from Peter for Newport. há 16 anos
Newport.pl Add perl scraper from Peter for Newport. há 16 anos
NorthAyrshire.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites há 16 anos
NorthAyrshire.pl North Ayrshire, Redbridge: added há 16 anos
NorthHerts.cgi Move some cgi scripts so that I can copy them in with the right file há 17 anos
Ocella.py Add scraper for Gosport. há 16 anos
OtherFilesToCopy.csv Add scraper for Mendip. há 16 anos
Planet.py Set up planet scraper. This get's us 5 new councils (though one, Tewkesbury, has no postcodes) há 16 anos
PlanningExplorer.py Change some PlanningExplorer scrapers to use date_registered rather than date_received. há 16 anos
PlanningUtils.py Add scraper for Mendip. há 16 anos
PublicAccess.py Some debug (mostly for westminster). há 16 anos
README adding fastweb há 17 anos
Redbridge.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites há 16 anos
Redbridge.pl North Ayrshire, Redbridge: added há 16 anos
RutlandLike.py Fix Lincoln parser. há 16 anos
Shetland.py Add scraper for Shetland Islands. há 16 anos
Shropshire.py Add Scraper for Lewes (which now has PublicAccess). há 16 anos
SitesToGenerate.csv Add scraper for Mendip. há 16 anos
SouthOxfordshire.cgi expanded the api (still need to test some stuff) há 17 anos
SouthOxfordshireParser.py add the south oxfordshire scraper, and code to generate há 17 anos
SouthSomerset.cgi New version of South Somerset from Tom. há 17 anos
SwiftLG.py Some debug (mostly for westminster). há 16 anos
WAM.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go há 16 anos
WestDorset.py Add python parser for West Dorset, and remove the non-working perl one. há 16 anos
Westminster.py Go back to the urllib2 version of Westminster. This works on disruptiveproactivity. há 16 anos
Westminster_pycurl.py Adding scraper for Halton. há 16 anos
createCGI.sh remove offending svn rm line... há 17 anos
generateCGIScripts.py adding fastweb há 17 anos

README 

In order to generate the contents of the CGI directory (../cgi-bin/)
run

./createCGI.sh

This script generates new cgi files in the CGI directory,
copies in some other files that are needed,
and commits all these changes to svn.

There is currently something very nasty in the permissions
column in the file OtherFilesToCopy.csv

Until version 2.6 of python, there appears to be no convenient
way to convert a string like 0755 into an octal. I am therefore
using integers to specify permissions of the copied files...

420 is 0644
493 is 0755

This is horrid, and must change in the future...