adrianshort
/
planningalerts
espelhamento de https://github.com/adrianshort/planningalerts.git
1
0
Fork 0
Código Issues 0 Versões 0 Wiki Atividade
Automatically exported from code.google.com/p/planningalerts
Você não pode selecionar mais de 25 tópicos Os tópicos devem começar com uma letra ou um número, podem incluir traços ('-') e podem ter até 35 caracteres.
317 Commits
2 Branches
1.3 MiB
 
 
 
 
 
 
Tag: 24247d187f
Branches Tags
${ item.name }
Criar branch ${ searchTerm }
de 24247d187f
${ noResults }
planningalerts/python_scrapers
duncan.parkes 55b14a2b71 This is a big refactor of the scrapers. 16 anos atrás
..
Aberdeenshire.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 anos atrás
AcolnetParser.py Fix Lewisham comments email address. 16 anos atrás
AcolnetParser_HTMLParser.py Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser. 17 anos atrás
AmberValley.py Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so 16 anos atrás
ApplicationSearchServletParser.py Daventry have replaced their nice url with an IP address... 16 anos atrás
AtriumePlanning.py Fix Dorset County Council scraper (the council seem to be using an IP address now rather than the domain they had 16 anos atrás
Barnsley.py Add scraper for Barnsley. 16 anos atrás
Berwick.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 anos atrás
Birmingham.py Add scraper for Birmingham. 16 anos atrás
Brent.py Add scraper for Brent. 16 anos atrás
Brentwood.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 anos atrás
Brentwood.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 anos atrás
Broxbourne.cgi Rename Broxbourne scraper so that it matches the database. 17 anos atrás
Broxtowe.py Add scraper for Broxtowe. 16 anos atrás
CGITemplate.py This is a big refactor of the scrapers. 16 anos atrás
Cairngorms.py Add scraper for the Cairngorms National Park. 16 anos atrás
Calderdale.py Add scraper for Calderdale. 16 anos atrás
Carmarthenshire.py Fix Lichfield scraper. 16 anos atrás
Christchurch.cgi Add Somerset scraper 17 anos atrás
Dacorum.cgi Fix Lichfield scraper. 16 anos atrás
EastHerts.cgi Move some cgi scripts so that I can copy them in with the right file 17 anos atrás
Eastbourne.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go 16 anos atrás
Enfield.cgi Add back in the Enfield scraper which I probably deleted 17 anos atrás
Exmoor.py Add scraper for Exmoor. Fix name of Herefordshire. 16 anos atrás
FastWeb.py Oops - printing the sutton results twice... 16 anos atrás
Fife.py Add Forest of Dean and Fife parsers. 16 anos atrás
Flintshire.py Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where 16 anos atrás
ForestOfDean.py Add Forest of Dean and Fife parsers. 16 anos atrás
Glasgow.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 anos atrás
Glasgow.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 anos atrás
Gosport.py Fix Mole Valley scraper. 16 anos atrás
HTTPHandlers.py Add scraper for Gosport. 16 anos atrás
Halton.py Adding scraper for Halton. 16 anos atrás
Hampshire.py Add Hampshire scraper. 16 anos atrás
Harrow.py Adding scraper for Harrow. 16 anos atrás
Hastings.py Add scraper for Hastings. Sadly, no decent info urls again. Had to use the search page. The real info url is only 16 anos atrás
Herefordshire.py Add scraper for Exmoor. Fix name of Herefordshire. 16 anos atrás
Highland.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 anos atrás
Highland.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 anos atrás
Hounslow.py Add scraper for Hounslow. 16 anos atrás
IsleOfWight.py Add Scraper for the Isle of Wight. 16 anos atrás
Kensington.py Add Kensington and Chelsea Scraper. 16 anos atrás
KingstonUponThames.py Add scraper for Kingston upon Thames. 16 anos atrás
Kirklees.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 anos atrás
Leicestershire.py Add scraper for Leicestershire County Council. 16 anos atrás
Lichfield.py Fix Lichfield scraper. 16 anos atrás
Maldon.py Add Pendle scraper (this is basically the same as Maldon). 16 anos atrás
Medway.py Add Medway scraper. 16 anos atrás
Mendip.py Add scraper for Mendip. 16 anos atrás
MultipartPostHandler.py add some Acolnet sites: 17 anos atrás
Newport.cgi Add perl scraper from Peter for Newport. 16 anos atrás
Newport.pl Add perl scraper from Peter for Newport. 16 anos atrás
NorthAyrshire.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 anos atrás
NorthAyrshire.pl North Ayrshire, Redbridge: added 16 anos atrás
NorthHerts.cgi Move some cgi scripts so that I can copy them in with the right file 17 anos atrás
Ocella.py Fix Lichfield scraper. 16 anos atrás
Planet.py Fix Mole Valley scraper. 16 anos atrás
PlanningExplorer.py Fix Tamworth scraper (change of IP address) 16 anos atrás
PlanningUtils.py Add scraper for Mendip. 16 anos atrás
PublicAccess.py Update PublicAccess scraper to work with BeautifulSoup. 16 anos atrás
README adding fastweb 17 anos atrás
Redbridge.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 anos atrás
Redbridge.pl North Ayrshire, Redbridge: added 16 anos atrás
RutlandLike.py Fix Lincoln parser. 16 anos atrás
Shetland.py Add scraper for Shetland Islands. 16 anos atrás
Shropshire.py Add Scraper for Lewes (which now has PublicAccess). 16 anos atrás
Solihull.py Add Thomas' scraper for Solihull. 16 anos atrás
SouthOxfordshire.cgi expanded the api (still need to test some stuff) 17 anos atrás
SouthOxfordshireParser.py add the south oxfordshire scraper, and code to generate 17 anos atrás
SouthSomerset.cgi New version of South Somerset from Tom. 17 anos atrás
SwiftLG.py Fix Mole Valley scraper. 16 anos atrás
WAM.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go 16 anos atrás
WestDorset.py Fix Tamworth scraper (change of IP address) 16 anos atrás
Westminster.py Go back to the urllib2 version of Westminster. This works on disruptiveproactivity. 16 anos atrás
Westminster_pycurl.py Adding scraper for Halton. 16 anos atrás
Weymouth.py Add scraper for Weymouth and Portland. 16 anos atrás
createCGI.sh remove offending svn rm line... 17 anos atrás

README 

In order to generate the contents of the CGI directory (../cgi-bin/)
run

./createCGI.sh

This script generates new cgi files in the CGI directory,
copies in some other files that are needed,
and commits all these changes to svn.

There is currently something very nasty in the permissions
column in the file OtherFilesToCopy.csv

Until version 2.6 of python, there appears to be no convenient
way to convert a string like 0755 into an octal. I am therefore
using integers to specify permissions of the copied files...

420 is 0644
493 is 0755

This is horrid, and must change in the future...