Adrian Short
aac15c24eb
Scrape Northgate details page
Currently we only parse:
- application_type
- location_easting
- location_northing
преди 3 години
Adrian Short
dcdadb1608
Determine @system when Authority object is created
This ensures that @system is set only once, avoiding bugs where any change to @url breaks subsequent calls to #system (as was).
Improve Northgate detection by making it more specific, reducing false positives.
преди 3 години
Adrian Short
8f7e2d93e1
Scrape Northgate dates page
преди 3 години
Adrian Short
6ae5f245f4
Improve Northgate detection
Previous method miscategorised some authorities as Northgate. This method is more reliable.
преди 3 години
Adrian Short
e29916b02e
Update supposed Northgate authorities
Amber Valley, Ashford and Hounslow were miscategorised and have changed URL.
Hackney is no longer Northgate.
Wandsworth has changed URL but is still Northgate.
преди 3 години
Adrian Short
cc65240378
Update CHANGELOG and bump version to 0.5.0
преди 4 години
Adrian Short
df0be313e7
Add status search for Idox
преди 4 години
Adrian Short
30d6240b20
Add status search for Northgate
преди 4 години
Adrian Short
f2e42cec22
Add case officer search for Northgate
преди 4 години
Adrian Short
f9e70cb21c
Update version.rb
преди 4 години
Adrian Short
21e6594846
Output date_validated correctly. Fix #40
преди 4 години
Adrian Short
624efc0ecf
Bump version
преди 4 години
Adrian Short
f939dfd1b6
Update authorities.csv
преди 4 години
Adrian Short
557678ea7c
Bump version
преди 5 години
Adrian Short
cd7518a24c
Update authorities.csv
преди 5 години
Adrian Short
45427b73ff
Bump version and publish gem
преди 6 години
Adrian Short
dcd996772b
Bump version
преди 6 години
Keith Payne
8b6f13e705
updates Kingston Upon Thames to idox system
преди 6 години
Russell Garner
0908878f56
Fix tags for Leeds/Bradford
westmidlands -> westyorkshire
преди 6 години
Adrian Short
b8a303381e
Add lots of councils; bump version
преди 6 години
NotQuiteMinerva
009a4b0932
Update authorities.csv
Added:
Bedford
Blackpool
Bracknell Forest
Calderdale
Cornwall
County Durham
Darlington
Doncaster
East Riding of Yorkshire
Hull
Milton Keynes
Newcastle upon Tyne
North East Lincolnshire
North Lincolnshire
North Somerset
North Tyneside
Northumberland
Peterborough
Plymouth
Poole
Rutland
Solihull
South Gloucestershire
South Tyneside
Southend-on-Sea
Stockton-on-Tees
Stoke-on-Trent
Sunderland
Swindon
Thurrock
Torbay
West Berkshire
Windsor and Maidenhead
Wolverhampton
York
преди 6 години
Adrian Short
ae6c9f6809
Add Portsmouth and Southampton
преди 6 години
Adrian Short
4c23d65bda
FIx CSV file format into 3 cols with header row. Fix #32
преди 6 години
Adrian Short
a24582ee03
Add Northern Ireland multi-authority site #31
преди 6 години
NotQuiteMinerva
74e873331b
Update authorities.csv
Added N. Ireland from their centralised site - I haven't added all authorities as it's a long list and I wasn't sure it could cope with it. At the moment only Belfast has applications.
The councils are listed below and can't be added separately, they all use this site for planning applications.
Causeway Coast and Glens
Mid and East Antrim
Antrim and Newtownabbey
Belfast
Lisburn and Castlereagh City Council
Ards and North Down
Newry, Mourne and Down
Armagh, Banbridge and Craigavon
Mid Ulster
Fermanagh and Omagh
Derry City and Strabane District
преди 6 години
Adrian Short
09b289d1fe
Use chained methods for scrape params #15
преди 6 години
NotQuiteMinerva
1e0a321aad
Update authorities.csv
Added Nottingham
преди 6 години
Adrian Short
9cfbdd4a18
Remove system tags as they're added automatically
преди 6 години
Adrian Short
dd8e0849e2
Add Aberdeen
преди 6 години
Adrian Short
eb7e63275b
Bump version to 0.3.0
преди 6 години
Adrian Short
96ac906d57
Sort authorities.csv; remove duplicate Wirral
преди 6 години
Adrian McEwen
827eb6c93e
Add Halton (although it's not supported at present)
преди 6 години
Adrian McEwen
1cc6c87ed8
Add St. Helens, Knowsley, Sefton and Wirral and tags for Liverpool
преди 6 години
Ross Jones
22ea0b900d
Adds Wirral
преди 6 години
Ross Jones
9e8fe1245c
Add Cheshire West and Chester
преди 6 години
Adrian Short
8a070e1773
Raise exceptions rather than quit when things go wrong.
преди 6 години
Adrian Short
9b0103030c
Fix URL
преди 6 години
Jez Nicholson
863b7321c8
added a few LAs and use VCR
преди 6 години
Adrian Short
44764bd5a8
Handle tags through methods not directly on the instance variable
преди 6 години
Adrian Short
ca5588706b
Improve regex so it doesn't parse "Not Available" as a date (Lewisham)
Should we even bother parsing all these fields from the search results pages given that we'll get them on the deeper scrape anyway?
преди 6 години
Adrian Short
9f3af5e4a9
Tidy date format
преди 6 години
Adrian Short
1aa0aac9f9
Create Application class; scrape into Application objects. #8
преди 6 години
richard
d4ec031ddc
add south london
преди 6 години
Adrian Short
a342ff53bd
Idox: searchCriteria.caseType and searchCriteria.developmentType are two separate things
We need to test a group of Idox sites to see how these parameters are used in practice.
преди 6 години
Adrian Short
fa2a705069
Tidy up
преди 6 години
Adrian Short
2778252c22
Raise exception if search gives "too many results" error. Fix #14
преди 6 години
Adrian Short
9229f1ff55
Add expected fields to search form if they're missing. Fix #6
This structure allows us to add other missing fields easily if necessary.
преди 6 години
Adrian Short
7349fd6470
Make exception name nicer
преди 6 години
Adrian Short
580b887708
Automatically add tags for software systems
преди 6 години
Adrian Short
2e100bc3c8
Make scrapers private instance methods in Authority
преди 6 години