Adrian Short
a24582ee03
Add Northern Ireland multi-authority site #31
6 anos atrás
NotQuiteMinerva
74e873331b
Update authorities.csv
Added N. Ireland from their centralised site - I haven't added all authorities as it's a long list and I wasn't sure it could cope with it. At the moment only Belfast has applications.
The councils are listed below and can't be added separately, they all use this site for planning applications.
Causeway Coast and Glens
Mid and East Antrim
Antrim and Newtownabbey
Belfast
Lisburn and Castlereagh City Council
Ards and North Down
Newry, Mourne and Down
Armagh, Banbridge and Craigavon
Mid Ulster
Fermanagh and Omagh
Derry City and Strabane District
6 anos atrás
NotQuiteMinerva
1e0a321aad
Update authorities.csv
Added Nottingham
6 anos atrás
Adrian Short
9cfbdd4a18
Remove system tags as they're added automatically
6 anos atrás
Adrian Short
dd8e0849e2
Add Aberdeen
6 anos atrás
Adrian Short
eb7e63275b
Bump version to 0.3.0
6 anos atrás
Adrian Short
96ac906d57
Sort authorities.csv; remove duplicate Wirral
6 anos atrás
Adrian McEwen
827eb6c93e
Add Halton (although it's not supported at present)
6 anos atrás
Adrian McEwen
1cc6c87ed8
Add St. Helens, Knowsley, Sefton and Wirral and tags for Liverpool
6 anos atrás
Ross Jones
22ea0b900d
Adds Wirral
6 anos atrás
Ross Jones
9e8fe1245c
Add Cheshire West and Chester
6 anos atrás
Adrian Short
8a070e1773
Raise exceptions rather than quit when things go wrong.
6 anos atrás
Adrian Short
9b0103030c
Fix URL
6 anos atrás
Jez Nicholson
863b7321c8
added a few LAs and use VCR
6 anos atrás
Adrian Short
44764bd5a8
Handle tags through methods not directly on the instance variable
6 anos atrás
Adrian Short
ca5588706b
Improve regex so it doesn't parse "Not Available" as a date (Lewisham)
Should we even bother parsing all these fields from the search results pages given that we'll get them on the deeper scrape anyway?
6 anos atrás
Adrian Short
9f3af5e4a9
Tidy date format
6 anos atrás
Adrian Short
1aa0aac9f9
Create Application class; scrape into Application objects. #8
6 anos atrás
richard
d4ec031ddc
add south london
6 anos atrás
Adrian Short
a342ff53bd
Idox: searchCriteria.caseType and searchCriteria.developmentType are two separate things
We need to test a group of Idox sites to see how these parameters are used in practice.
6 anos atrás
Adrian Short
fa2a705069
Tidy up
6 anos atrás
Adrian Short
2778252c22
Raise exception if search gives "too many results" error. Fix #14
6 anos atrás
Adrian Short
9229f1ff55
Add expected fields to search form if they're missing. Fix #6
This structure allows us to add other missing fields easily if necessary.
6 anos atrás
Adrian Short
7349fd6470
Make exception name nicer
6 anos atrás
Adrian Short
580b887708
Automatically add tags for software systems
6 anos atrás
Adrian Short
2e100bc3c8
Make scrapers private instance methods in Authority
6 anos atrás
Adrian Short
6d72d25166
Search field name variant for Idox eg Bolton
6 anos atrás
Adrian Short
8d15678700
Catch Idox internal error where search page fails to load
6 anos atrás
Adrian Short
4f4fc49c38
Add Greater Manchester authorities
6 anos atrás
Adrian Short
29f2c2a885
Update tags and README
6 anos atrás
pezholio
3a1499524f
Some initial tests
6 anos atrás
Adrian Short
7441f13d6b
Sometimes date fields have values that aren't dates
Like "Not available" in Greenwich.
6 anos atrás
Adrian Short
ab9e76ca92
Bump version number
6 anos atrás
Adrian Short
1b0f87a371
Add all the London councils
6 anos atrás
Adrian Short
b9adc22816
Bugfix scopes
6 anos atrás
Adrian Short
1354202538
Create custom exception
6 anos atrás
Adrian Short
14ed6e7b79
Add more authorities
6 anos atrás
Adrian Short
1a00f3797d
Add Authority class
UKPlanningScraper#search method is now UKPlanningScraper::Authority.scrape.
6 anos atrás
Adrian Short
673dec1f26
Add authorities.csv file
6 anos atrás
Adrian Short
9f10e4ec8a
Bugfix
6 anos atrás
Adrian Short
dca8a84979
Add helper search params: :validated_days, :decided_days, :received_days
6 anos atrás
Adrian Short
5e166c3d34
Bugfix for councils that don't have this column
6 anos atrás
Adrian Short
0a6736b9ee
Remove unnecessary var
6 anos atrás
Adrian Short
dbfd10b33c
Add core Northgate scraper for search results page
6 anos atrás
Adrian Short
2946c1d7bf
Move Idox scraper into its own method
6 anos atrás
Adrian Short
f70d4f2598
Some Documents tabs don't have the number in them
6 anos atrás
Adrian Short
23d5825e73
Bugfix: handle applications with no documents correctly
6 anos atrás
Adrian Short
163e471d83
Too much information
6 anos atrás
Adrian Short
ddc81dd838
Scrape and parse summary tab for each app
6 anos atrás
Adrian Short
b9e75b3507
Fix #3 parsing for more Idox sites. Bump version to 0.1.1
6 anos atrás