uk_planning_scraper

Revīziju grafs

Autors	SHA1	Ziņojums	Datums
Graeme Porteous	d6ff621eac	Limit number of properties retrieved per application	pirms 5 gadiem
Graeme Porteous	779f0f8d91	Flatten application hash Instead of properties hashes within application hash we now prepends the hash keys so the values are accessible at `property_1_uprn`...	pirms 5 gadiem
Graeme Porteous	97f5eb0c7e	Don't scrape properties by default	pirms 5 gadiem
Graeme Porteous	9b86779fe7	Extract common Mechanize error handling	pirms 5 gadiem
Graeme Porteous	452e39a867	Scape properties details	pirms 5 gadiem
Graeme Porteous	1efb7c57d4	Extract summary scraping into separate method	pirms 5 gadiem
Graeme Porteous	74e3121f28	Nuke whitespace	pirms 5 gadiem
Adrian Short	45427b73ff	Bump version and publish gem	pirms 6 gadiem
Adrian Short	dcd996772b	Bump version	pirms 6 gadiem
Keith Payne	8b6f13e705	updates Kingston Upon Thames to idox system	pirms 6 gadiem
Russell Garner	0908878f56	Fix tags for Leeds/Bradford westmidlands -> westyorkshire	pirms 6 gadiem
Adrian Short	b8a303381e	Add lots of councils; bump version	pirms 6 gadiem
NotQuiteMinerva	009a4b0932	Update authorities.csv Added: Bedford Blackpool Bracknell Forest Calderdale Cornwall County Durham Darlington Doncaster East Riding of Yorkshire Hull Milton Keynes Newcastle upon Tyne North East Lincolnshire North Lincolnshire North Somerset North Tyneside Northumberland Peterborough Plymouth Poole Rutland Solihull South Gloucestershire South Tyneside Southend-on-Sea Stockton-on-Tees Stoke-on-Trent Sunderland Swindon Thurrock Torbay West Berkshire Windsor and Maidenhead Wolverhampton York	pirms 6 gadiem
Adrian Short	ae6c9f6809	Add Portsmouth and Southampton	pirms 6 gadiem
Adrian Short	4c23d65bda	FIx CSV file format into 3 cols with header row. Fix #32	pirms 6 gadiem
Adrian Short	a24582ee03	Add Northern Ireland multi-authority site #31	pirms 6 gadiem
NotQuiteMinerva	74e873331b	Update authorities.csv Added N. Ireland from their centralised site - I haven't added all authorities as it's a long list and I wasn't sure it could cope with it. At the moment only Belfast has applications. The councils are listed below and can't be added separately, they all use this site for planning applications. Causeway Coast and Glens Mid and East Antrim Antrim and Newtownabbey Belfast Lisburn and Castlereagh City Council Ards and North Down Newry, Mourne and Down Armagh, Banbridge and Craigavon Mid Ulster Fermanagh and Omagh Derry City and Strabane District	pirms 6 gadiem
Adrian Short	09b289d1fe	Use chained methods for scrape params #15	pirms 6 gadiem
NotQuiteMinerva	1e0a321aad	Update authorities.csv Added Nottingham	pirms 6 gadiem
Adrian Short	9cfbdd4a18	Remove system tags as they're added automatically	pirms 6 gadiem
Adrian Short	dd8e0849e2	Add Aberdeen	pirms 6 gadiem
Adrian Short	eb7e63275b	Bump version to 0.3.0	pirms 6 gadiem
Adrian Short	96ac906d57	Sort authorities.csv; remove duplicate Wirral	pirms 6 gadiem
Adrian McEwen	827eb6c93e	Add Halton (although it's not supported at present)	pirms 6 gadiem
Adrian McEwen	1cc6c87ed8	Add St. Helens, Knowsley, Sefton and Wirral and tags for Liverpool	pirms 6 gadiem
Ross Jones	22ea0b900d	Adds Wirral	pirms 6 gadiem
Ross Jones	9e8fe1245c	Add Cheshire West and Chester	pirms 6 gadiem
Adrian Short	8a070e1773	Raise exceptions rather than quit when things go wrong.	pirms 6 gadiem
Adrian Short	9b0103030c	Fix URL	pirms 6 gadiem
Jez Nicholson	863b7321c8	added a few LAs and use VCR	pirms 6 gadiem
Adrian Short	44764bd5a8	Handle tags through methods not directly on the instance variable	pirms 6 gadiem
Adrian Short	ca5588706b	Improve regex so it doesn't parse "Not Available" as a date (Lewisham) Should we even bother parsing all these fields from the search results pages given that we'll get them on the deeper scrape anyway?	pirms 6 gadiem
Adrian Short	9f3af5e4a9	Tidy date format	pirms 6 gadiem
Adrian Short	1aa0aac9f9	Create Application class; scrape into Application objects. #8	pirms 6 gadiem
richard	d4ec031ddc	add south london	pirms 6 gadiem
Adrian Short	a342ff53bd	Idox: searchCriteria.caseType and searchCriteria.developmentType are two separate things We need to test a group of Idox sites to see how these parameters are used in practice.	pirms 6 gadiem
Adrian Short	fa2a705069	Tidy up	pirms 6 gadiem
Adrian Short	2778252c22	Raise exception if search gives "too many results" error. Fix #14	pirms 6 gadiem
Adrian Short	9229f1ff55	Add expected fields to search form if they're missing. Fix #6 This structure allows us to add other missing fields easily if necessary.	pirms 6 gadiem
Adrian Short	7349fd6470	Make exception name nicer	pirms 6 gadiem
Adrian Short	580b887708	Automatically add tags for software systems	pirms 6 gadiem
Adrian Short	2e100bc3c8	Make scrapers private instance methods in Authority	pirms 6 gadiem
Adrian Short	6d72d25166	Search field name variant for Idox eg Bolton	pirms 6 gadiem
Adrian Short	8d15678700	Catch Idox internal error where search page fails to load	pirms 6 gadiem
Adrian Short	4f4fc49c38	Add Greater Manchester authorities	pirms 6 gadiem
Adrian Short	29f2c2a885	Update tags and README	pirms 6 gadiem
pezholio	3a1499524f	Some initial tests	pirms 6 gadiem
Adrian Short	7441f13d6b	Sometimes date fields have values that aren't dates Like "Not available" in Greenwich.	pirms 6 gadiem
Adrian Short	ab9e76ca92	Bump version number	pirms 6 gadiem
Adrian Short	1b0f87a371	Add all the London councils	pirms 6 gadiem

1 2

73 Revīzijas (d6ff621eace0292f0f3146c4a1d660d0fcda100e)