adrianshort
/
planningalerts
kopie van https://github.com/adrianshort/planningalerts.git
1
0
Vork 0
Code Kwesties 0 Publicaties 0 Wiki Activiteit
Automatically exported from code.google.com/p/planningalerts
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
354 Commits
2 Branches
1.3 MiB
 
 
 
 
 
 
Tree: 6351b04742
Branches Labels
${ item.name }
Maak branch ${ searchTerm }
van '6351b04742'
${ noResults }
planningalerts/python_scrapers
duncan.parkes 6351b04742 Fix West Wiltshire - change of capitalization in url. 15 jaren geleden
..
Aberdeenshire.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 jaren geleden
AcolnetParser.py Fix West Wiltshire - change of capitalization in url. 15 jaren geleden
AcolnetParser_HTMLParser.py Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser. 17 jaren geleden
AmberValley.py Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so 16 jaren geleden
ApplicationSearchServletParser.py Fix High Peak - extra column in results. 15 jaren geleden
AtriumePlanning.py Fix Dorset County Council scraper (the council seem to be using an IP address now rather than the domain they had 16 jaren geleden
Barnsley.py Add scraper for Barnsley. 16 jaren geleden
Berwick.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 jaren geleden
Birmingham.py Add scraper for Birmingham. 16 jaren geleden
Brent.py Add scraper for Brent. 16 jaren geleden
Brentwood.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 jaren geleden
Brentwood.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 jaren geleden
Broxbourne.cgi Rename Broxbourne scraper so that it matches the database. 17 jaren geleden
Broxtowe.py Add scraper for Broxtowe. 16 jaren geleden
CGITemplate.py This is a big refactor of the scrapers. 16 jaren geleden
Cairngorms.py Add scraper for the Cairngorms National Park. 16 jaren geleden
Calderdale.py Add scraper for Calderdale. 16 jaren geleden
Carmarthenshire.py Fix Lichfield scraper. 16 jaren geleden
Christchurch.cgi Add Somerset scraper 17 jaren geleden
Crawley.py Make Crawley scraper work with python 2.5... 15 jaren geleden
Dacorum.cgi Fix Lichfield scraper. 16 jaren geleden
EastHerts.cgi Move some cgi scripts so that I can copy them in with the right file 17 jaren geleden
Eastbourne.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go 16 jaren geleden
Enfield.cgi Add back in the Enfield scraper which I probably deleted 17 jaren geleden
Exmoor.py Add scraper for Exmoor. Fix name of Herefordshire. 16 jaren geleden
FastWeb.py Oops - printing the sutton results twice... 16 jaren geleden
Fife.py Add Forest of Dean and Fife parsers. 16 jaren geleden
Flintshire.py Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where 16 jaren geleden
ForestOfDean.py Add Forest of Dean and Fife parsers. 16 jaren geleden
Glasgow.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 jaren geleden
Glasgow.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 jaren geleden
Gosport.py Gosport has been hardcoded for the last year to check one date in 2008 - woops! 15 jaren geleden
HTTPHandlers.py Add scraper for Gosport. 16 jaren geleden
Halton.py Adding scraper for Halton. 16 jaren geleden
Hampshire.py Add Hampshire scraper. 16 jaren geleden
Harrow.py Adding scraper for Harrow. 16 jaren geleden
Hastings.py Fix West Wiltshire - change of capitalization in url. 15 jaren geleden
Herefordshire.py Add scraper for Exmoor. Fix name of Herefordshire. 16 jaren geleden
Highland.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 jaren geleden
Highland.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 jaren geleden
Hounslow.py Add scraper for Hounslow. 16 jaren geleden
IsleOfWight.py Add Scraper for the Isle of Wight. 16 jaren geleden
Kensington.py Add Kensington and Chelsea Scraper. 16 jaren geleden
KingstonUponThames.py Add scraper for Kingston upon Thames. 16 jaren geleden
Kirklees.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 jaren geleden
Leicestershire.py Add scraper for Leicestershire County Council. 16 jaren geleden
Lichfield.py Fix Lichfield scraper. 16 jaren geleden
Maldon.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. 15 jaren geleden
Medway.py Add Medway scraper. 16 jaren geleden
MultipartPostHandler.py add some Acolnet sites: 17 jaren geleden
Newport.cgi Add perl scraper from Peter for Newport. 16 jaren geleden
Newport.pl Add perl scraper from Peter for Newport. 16 jaren geleden
NorthAyrshire.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 jaren geleden
NorthAyrshire.pl North Ayrshire, Redbridge: added 16 jaren geleden
NorthHerts.cgi Move some cgi scripts so that I can copy them in with the right file 17 jaren geleden
Ocella.py Fix West Wiltshire - change of capitalization in url. 15 jaren geleden
Planet.py Add info url for Elmbridge. 15 jaren geleden
PlanningExplorer.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. 15 jaren geleden
PlanningUtils.py Add scraper for Mendip. 16 jaren geleden
PublicAccess.py Bit of a refactor of PublicAccess in order to fix Hambleton. 15 jaren geleden
README adding fastweb 17 jaren geleden
Redbridge.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 jaren geleden
Redbridge.pl North Ayrshire, Redbridge: added 16 jaren geleden
RutlandLike.py Fix Lincoln parser. 16 jaren geleden
Shetland.py Add scraper for Shetland Islands. 16 jaren geleden
Shropshire.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. 15 jaren geleden
Solihull.py Add Thomas' scraper for Solihull. 16 jaren geleden
SouthOxfordshire.cgi expanded the api (still need to test some stuff) 17 jaren geleden
SouthOxfordshireParser.py add the south oxfordshire scraper, and code to generate 17 jaren geleden
SouthSomerset.cgi New version of South Somerset from Tom. 17 jaren geleden
SwiftLG.py Fix Cannock Chase, though still no postcodes :-( 15 jaren geleden
WAM.py Oops - remove pdb from AcolnetParser. 15 jaren geleden
WestDorset.py Fix Tamworth scraper (change of IP address) 16 jaren geleden
Westminster.py Go back to the urllib2 version of Westminster. This works on disruptiveproactivity. 16 jaren geleden
Westminster_pycurl.py Adding scraper for Halton. 16 jaren geleden
Weymouth.py Add scraper for Weymouth and Portland. 16 jaren geleden
Wychavon.py Add Wychavon scraper from Thomas. 15 jaren geleden
createCGI.sh remove offending svn rm line... 17 jaren geleden

README 

In order to generate the contents of the CGI directory (../cgi-bin/)
run

./createCGI.sh

This script generates new cgi files in the CGI directory,
copies in some other files that are needed,
and commits all these changes to svn.

There is currently something very nasty in the permissions
column in the file OtherFilesToCopy.csv

Until version 2.6 of python, there appears to be no convenient
way to convert a string like 0755 into an octal. I am therefore
using integers to specify permissions of the copied files...

420 is 0644
493 is 0755

This is horrid, and must change in the future...