uk_planning_scraper

Commit-Graf

Upphovsman	SHA1	Meddelande	Datum
Graeme Porteous	779f0f8d91	Flatten application hash Instead of properties hashes within application hash we now prepends the hash keys so the values are accessible at `property_1_uprn`...	5 år sedan
Graeme Porteous	97f5eb0c7e	Don't scrape properties by default	5 år sedan
Graeme Porteous	9b86779fe7	Extract common Mechanize error handling	5 år sedan
Graeme Porteous	452e39a867	Scape properties details	5 år sedan
Graeme Porteous	1efb7c57d4	Extract summary scraping into separate method	5 år sedan
Graeme Porteous	74e3121f28	Nuke whitespace	5 år sedan
Adrian Short	45427b73ff	Bump version and publish gem	5 år sedan
Adrian Short	dcd996772b	Bump version	5 år sedan
Keith Payne	8b6f13e705	updates Kingston Upon Thames to idox system	5 år sedan
Russell Garner	0908878f56	Fix tags for Leeds/Bradford westmidlands -> westyorkshire	6 år sedan
Adrian Short	b8a303381e	Add lots of councils; bump version	6 år sedan
NotQuiteMinerva	009a4b0932	Update authorities.csv Added: Bedford Blackpool Bracknell Forest Calderdale Cornwall County Durham Darlington Doncaster East Riding of Yorkshire Hull Milton Keynes Newcastle upon Tyne North East Lincolnshire North Lincolnshire North Somerset North Tyneside Northumberland Peterborough Plymouth Poole Rutland Solihull South Gloucestershire South Tyneside Southend-on-Sea Stockton-on-Tees Stoke-on-Trent Sunderland Swindon Thurrock Torbay West Berkshire Windsor and Maidenhead Wolverhampton York	6 år sedan
Adrian Short	ae6c9f6809	Add Portsmouth and Southampton	6 år sedan
Adrian Short	4c23d65bda	FIx CSV file format into 3 cols with header row. Fix #32	6 år sedan
Adrian Short	a24582ee03	Add Northern Ireland multi-authority site #31	6 år sedan
NotQuiteMinerva	74e873331b	Update authorities.csv Added N. Ireland from their centralised site - I haven't added all authorities as it's a long list and I wasn't sure it could cope with it. At the moment only Belfast has applications. The councils are listed below and can't be added separately, they all use this site for planning applications. Causeway Coast and Glens Mid and East Antrim Antrim and Newtownabbey Belfast Lisburn and Castlereagh City Council Ards and North Down Newry, Mourne and Down Armagh, Banbridge and Craigavon Mid Ulster Fermanagh and Omagh Derry City and Strabane District	6 år sedan
Adrian Short	09b289d1fe	Use chained methods for scrape params #15	6 år sedan
NotQuiteMinerva	1e0a321aad	Update authorities.csv Added Nottingham	6 år sedan
Adrian Short	9cfbdd4a18	Remove system tags as they're added automatically	6 år sedan
Adrian Short	dd8e0849e2	Add Aberdeen	6 år sedan
Adrian Short	eb7e63275b	Bump version to 0.3.0	6 år sedan
Adrian Short	96ac906d57	Sort authorities.csv; remove duplicate Wirral	6 år sedan
Adrian McEwen	827eb6c93e	Add Halton (although it's not supported at present)	6 år sedan
Adrian McEwen	1cc6c87ed8	Add St. Helens, Knowsley, Sefton and Wirral and tags for Liverpool	6 år sedan
Ross Jones	22ea0b900d	Adds Wirral	6 år sedan
Ross Jones	9e8fe1245c	Add Cheshire West and Chester	6 år sedan
Adrian Short	8a070e1773	Raise exceptions rather than quit when things go wrong.	6 år sedan
Adrian Short	9b0103030c	Fix URL	6 år sedan
Jez Nicholson	863b7321c8	added a few LAs and use VCR	6 år sedan
Adrian Short	44764bd5a8	Handle tags through methods not directly on the instance variable	6 år sedan
Adrian Short	ca5588706b	Improve regex so it doesn't parse "Not Available" as a date (Lewisham) Should we even bother parsing all these fields from the search results pages given that we'll get them on the deeper scrape anyway?	6 år sedan
Adrian Short	9f3af5e4a9	Tidy date format	6 år sedan
Adrian Short	1aa0aac9f9	Create Application class; scrape into Application objects. #8	6 år sedan
richard	d4ec031ddc	add south london	6 år sedan
Adrian Short	a342ff53bd	Idox: searchCriteria.caseType and searchCriteria.developmentType are two separate things We need to test a group of Idox sites to see how these parameters are used in practice.	6 år sedan
Adrian Short	fa2a705069	Tidy up	6 år sedan
Adrian Short	2778252c22	Raise exception if search gives "too many results" error. Fix #14	6 år sedan
Adrian Short	9229f1ff55	Add expected fields to search form if they're missing. Fix #6 This structure allows us to add other missing fields easily if necessary.	6 år sedan
Adrian Short	7349fd6470	Make exception name nicer	6 år sedan
Adrian Short	580b887708	Automatically add tags for software systems	6 år sedan
Adrian Short	2e100bc3c8	Make scrapers private instance methods in Authority	6 år sedan
Adrian Short	6d72d25166	Search field name variant for Idox eg Bolton	6 år sedan
Adrian Short	8d15678700	Catch Idox internal error where search page fails to load	6 år sedan
Adrian Short	4f4fc49c38	Add Greater Manchester authorities	6 år sedan
Adrian Short	29f2c2a885	Update tags and README	6 år sedan
pezholio	3a1499524f	Some initial tests	6 år sedan
Adrian Short	7441f13d6b	Sometimes date fields have values that aren't dates Like "Not available" in Greenwich.	6 år sedan
Adrian Short	ab9e76ca92	Bump version number	6 år sedan
Adrian Short	1b0f87a371	Add all the London councils	6 år sedan
Adrian Short	b9adc22816	Bugfix scopes	6 år sedan

1 2

72 Incheckningar (779f0f8d91719f1484e27a24e43652e320b2d486)