adrianshort
/
planningalerts
kopia lustrzana https://github.com/adrianshort/planningalerts.git
1
0
Forkuj 0
Kod Zgłoszenia 0 Wydania 0 Wiki Aktywność
Automatically exported from code.google.com/p/planningalerts
Nie możesz wybrać więcej, niż 25 tematów Tematy muszą się zaczynać od litery lub cyfry, mogą zawierać myślniki ('-') i mogą mieć do 35 znaków.
354 Commity
2 Gałęzie
1.3 MiB
 
 
 
 
 
 
Drzewo: 6351b04742
Gałęzie Tagi
${ item.name }
Utwórz gałąź ${ searchTerm }
z '6351b04742'
${ noResults }
planningalerts/python_scrapers
duncan.parkes 6351b04742 Fix West Wiltshire - change of capitalization in url. 15 lat temu
..
Aberdeenshire.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 lat temu
AcolnetParser.py Fix West Wiltshire - change of capitalization in url. 15 lat temu
AcolnetParser_HTMLParser.py Add New version of the Acolnet scraper using BeautifulSoup instead of HTMLParser. 17 lat temu
AmberValley.py Add scraper for Amber Valley. This was a really irritating one. There is no way to link to individual info pages, so 16 lat temu
ApplicationSearchServletParser.py Fix High Peak - extra column in results. 15 lat temu
AtriumePlanning.py Fix Dorset County Council scraper (the council seem to be using an IP address now rather than the domain they had 16 lat temu
Barnsley.py Add scraper for Barnsley. 16 lat temu
Berwick.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 lat temu
Birmingham.py Add scraper for Birmingham. 16 lat temu
Brent.py Add scraper for Brent. 16 lat temu
Brentwood.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 lat temu
Brentwood.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 lat temu
Broxbourne.cgi Rename Broxbourne scraper so that it matches the database. 17 lat temu
Broxtowe.py Add scraper for Broxtowe. 16 lat temu
CGITemplate.py This is a big refactor of the scrapers. 16 lat temu
Cairngorms.py Add scraper for the Cairngorms National Park. 16 lat temu
Calderdale.py Add scraper for Calderdale. 16 lat temu
Carmarthenshire.py Fix Lichfield scraper. 16 lat temu
Christchurch.cgi Add Somerset scraper 17 lat temu
Crawley.py Make Crawley scraper work with python 2.5... 15 lat temu
Dacorum.cgi Fix Lichfield scraper. 16 lat temu
EastHerts.cgi Move some cgi scripts so that I can copy them in with the right file 17 lat temu
Eastbourne.py Add scraper for Eastbourne. The info and comment links won't work since they require you to have a cookie. If you go 16 lat temu
Enfield.cgi Add back in the Enfield scraper which I probably deleted 17 lat temu
Exmoor.py Add scraper for Exmoor. Fix name of Herefordshire. 16 lat temu
FastWeb.py Oops - printing the sutton results twice... 16 lat temu
Fife.py Add Forest of Dean and Fife parsers. 16 lat temu
Flintshire.py Add scraper for Flintshire. I've included the OSGB x,y coordinates in the hope that we can start using these where 16 lat temu
ForestOfDean.py Add Forest of Dean and Fife parsers. 16 lat temu
Glasgow.cgi Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 lat temu
Glasgow.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 lat temu
Gosport.py Gosport has been hardcoded for the last year to check one date in 2008 - woops! 15 lat temu
HTTPHandlers.py Add scraper for Gosport. 16 lat temu
Halton.py Adding scraper for Halton. 16 lat temu
Hampshire.py Add Hampshire scraper. 16 lat temu
Harrow.py Adding scraper for Harrow. 16 lat temu
Hastings.py Fix West Wiltshire - change of capitalization in url. 15 lat temu
Herefordshire.py Add scraper for Exmoor. Fix name of Herefordshire. 16 lat temu
Highland.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 lat temu
Highland.pl Add Peter's scrapers for Highland, Glasgow, and Brentwood. 16 lat temu
Hounslow.py Add scraper for Hounslow. 16 lat temu
IsleOfWight.py Add Scraper for the Isle of Wight. 16 lat temu
Kensington.py Add Kensington and Chelsea Scraper. 16 lat temu
KingstonUponThames.py Add scraper for Kingston upon Thames. 16 lat temu
Kirklees.py Add parser for Kirklees. Get rid of some unnecessary imports. 16 lat temu
Leicestershire.py Add scraper for Leicestershire County Council. 16 lat temu
Lichfield.py Fix Lichfield scraper. 16 lat temu
Maldon.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. 15 lat temu
Medway.py Add Medway scraper. 16 lat temu
MultipartPostHandler.py add some Acolnet sites: 17 lat temu
Newport.cgi Add perl scraper from Peter for Newport. 16 lat temu
Newport.pl Add perl scraper from Peter for Newport. 16 lat temu
NorthAyrshire.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 lat temu
NorthAyrshire.pl North Ayrshire, Redbridge: added 16 lat temu
NorthHerts.cgi Move some cgi scripts so that I can copy them in with the right file 17 lat temu
Ocella.py Fix West Wiltshire - change of capitalization in url. 15 lat temu
Planet.py Add info url for Elmbridge. 15 lat temu
PlanningExplorer.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. 15 lat temu
PlanningUtils.py Add scraper for Mendip. 16 lat temu
PublicAccess.py Bit of a refactor of PublicAccess in order to fix Hambleton. 15 lat temu
README adding fastweb 17 lat temu
Redbridge.cgi Highland, North Ayrshire, Redbridge: updated based on changes made to planning websites 16 lat temu
Redbridge.pl North Ayrshire, Redbridge: added 16 lat temu
RutlandLike.py Fix Lincoln parser. 16 lat temu
Shetland.py Add scraper for Shetland Islands. 16 lat temu
Shropshire.py Fix Mendip - now using PlanningExplorer rather than a bespoke scraper. 15 lat temu
Solihull.py Add Thomas' scraper for Solihull. 16 lat temu
SouthOxfordshire.cgi expanded the api (still need to test some stuff) 17 lat temu
SouthOxfordshireParser.py add the south oxfordshire scraper, and code to generate 17 lat temu
SouthSomerset.cgi New version of South Somerset from Tom. 17 lat temu
SwiftLG.py Fix Cannock Chase, though still no postcodes :-( 15 lat temu
WAM.py Oops - remove pdb from AcolnetParser. 15 lat temu
WestDorset.py Fix Tamworth scraper (change of IP address) 16 lat temu
Westminster.py Go back to the urllib2 version of Westminster. This works on disruptiveproactivity. 16 lat temu
Westminster_pycurl.py Adding scraper for Halton. 16 lat temu
Weymouth.py Add scraper for Weymouth and Portland. 16 lat temu
Wychavon.py Add Wychavon scraper from Thomas. 15 lat temu
createCGI.sh remove offending svn rm line... 17 lat temu

README 

In order to generate the contents of the CGI directory (../cgi-bin/)
run

./createCGI.sh

This script generates new cgi files in the CGI directory,
copies in some other files that are needed,
and commits all these changes to svn.

There is currently something very nasty in the permissions
column in the file OtherFilesToCopy.csv

Until version 2.6 of python, there appears to be no convenient
way to convert a string like 0755 into an octal. I am therefore
using integers to specify permissions of the copied files...

420 is 0644
493 is 0755

This is horrid, and must change in the future...