uk_planning_scraper

Commit Graph

Аутор	SHA1	Порука	Датум
Graeme Porteous	779f0f8d91	Flatten application hash Instead of properties hashes within application hash we now prepends the hash keys so the values are accessible at `property_1_uprn`...	пре 5 година
Graeme Porteous	97f5eb0c7e	Don't scrape properties by default	пре 5 година
Graeme Porteous	9b86779fe7	Extract common Mechanize error handling	пре 5 година
Graeme Porteous	452e39a867	Scape properties details	пре 5 година
Graeme Porteous	1efb7c57d4	Extract summary scraping into separate method	пре 5 година
Graeme Porteous	74e3121f28	Nuke whitespace	пре 5 година
Adrian Short	45427b73ff	Bump version and publish gem	пре 5 година
Adrian Short	dcd996772b	Bump version	пре 5 година
Keith Payne	8b6f13e705	updates Kingston Upon Thames to idox system	пре 5 година
Russell Garner	0908878f56	Fix tags for Leeds/Bradford westmidlands -> westyorkshire	пре 6 година
Adrian Short	b8a303381e	Add lots of councils; bump version	пре 6 година
NotQuiteMinerva	009a4b0932	Update authorities.csv Added: Bedford Blackpool Bracknell Forest Calderdale Cornwall County Durham Darlington Doncaster East Riding of Yorkshire Hull Milton Keynes Newcastle upon Tyne North East Lincolnshire North Lincolnshire North Somerset North Tyneside Northumberland Peterborough Plymouth Poole Rutland Solihull South Gloucestershire South Tyneside Southend-on-Sea Stockton-on-Tees Stoke-on-Trent Sunderland Swindon Thurrock Torbay West Berkshire Windsor and Maidenhead Wolverhampton York	пре 6 година
Adrian Short	ae6c9f6809	Add Portsmouth and Southampton	пре 6 година
Adrian Short	4c23d65bda	FIx CSV file format into 3 cols with header row. Fix #32	пре 6 година
Adrian Short	a24582ee03	Add Northern Ireland multi-authority site #31	пре 6 година
NotQuiteMinerva	74e873331b	Update authorities.csv Added N. Ireland from their centralised site - I haven't added all authorities as it's a long list and I wasn't sure it could cope with it. At the moment only Belfast has applications. The councils are listed below and can't be added separately, they all use this site for planning applications. Causeway Coast and Glens Mid and East Antrim Antrim and Newtownabbey Belfast Lisburn and Castlereagh City Council Ards and North Down Newry, Mourne and Down Armagh, Banbridge and Craigavon Mid Ulster Fermanagh and Omagh Derry City and Strabane District	пре 6 година
Adrian Short	09b289d1fe	Use chained methods for scrape params #15	пре 6 година
NotQuiteMinerva	1e0a321aad	Update authorities.csv Added Nottingham	пре 6 година
Adrian Short	9cfbdd4a18	Remove system tags as they're added automatically	пре 6 година
Adrian Short	dd8e0849e2	Add Aberdeen	пре 6 година
Adrian Short	eb7e63275b	Bump version to 0.3.0	пре 6 година
Adrian Short	96ac906d57	Sort authorities.csv; remove duplicate Wirral	пре 6 година
Adrian McEwen	827eb6c93e	Add Halton (although it's not supported at present)	пре 6 година
Adrian McEwen	1cc6c87ed8	Add St. Helens, Knowsley, Sefton and Wirral and tags for Liverpool	пре 6 година
Ross Jones	22ea0b900d	Adds Wirral	пре 6 година
Ross Jones	9e8fe1245c	Add Cheshire West and Chester	пре 6 година
Adrian Short	8a070e1773	Raise exceptions rather than quit when things go wrong.	пре 6 година
Adrian Short	9b0103030c	Fix URL	пре 6 година
Jez Nicholson	863b7321c8	added a few LAs and use VCR	пре 6 година
Adrian Short	44764bd5a8	Handle tags through methods not directly on the instance variable	пре 6 година
Adrian Short	ca5588706b	Improve regex so it doesn't parse "Not Available" as a date (Lewisham) Should we even bother parsing all these fields from the search results pages given that we'll get them on the deeper scrape anyway?	пре 6 година
Adrian Short	9f3af5e4a9	Tidy date format	пре 6 година
Adrian Short	1aa0aac9f9	Create Application class; scrape into Application objects. #8	пре 6 година
richard	d4ec031ddc	add south london	пре 6 година
Adrian Short	a342ff53bd	Idox: searchCriteria.caseType and searchCriteria.developmentType are two separate things We need to test a group of Idox sites to see how these parameters are used in practice.	пре 6 година
Adrian Short	fa2a705069	Tidy up	пре 6 година
Adrian Short	2778252c22	Raise exception if search gives "too many results" error. Fix #14	пре 6 година
Adrian Short	9229f1ff55	Add expected fields to search form if they're missing. Fix #6 This structure allows us to add other missing fields easily if necessary.	пре 6 година
Adrian Short	7349fd6470	Make exception name nicer	пре 6 година
Adrian Short	580b887708	Automatically add tags for software systems	пре 6 година
Adrian Short	2e100bc3c8	Make scrapers private instance methods in Authority	пре 6 година
Adrian Short	6d72d25166	Search field name variant for Idox eg Bolton	пре 6 година
Adrian Short	8d15678700	Catch Idox internal error where search page fails to load	пре 6 година
Adrian Short	4f4fc49c38	Add Greater Manchester authorities	пре 6 година
Adrian Short	29f2c2a885	Update tags and README	пре 6 година
pezholio	3a1499524f	Some initial tests	пре 6 година
Adrian Short	7441f13d6b	Sometimes date fields have values that aren't dates Like "Not available" in Greenwich.	пре 6 година
Adrian Short	ab9e76ca92	Bump version number	пре 6 година
Adrian Short	1b0f87a371	Add all the London councils	пре 6 година
Adrian Short	b9adc22816	Bugfix scopes	пре 6 година

1 2

72 Комити (779f0f8d91719f1484e27a24e43652e320b2d486)