 Jez Nicholson
|
863b7321c8
|
added a few LAs and use VCR
|
6 years ago |
 Adrian Short
|
44764bd5a8
|
Handle tags through methods not directly on the instance variable
|
6 years ago |
|
Adrian Short
|
ca5588706b
|
Improve regex so it doesn't parse "Not Available" as a date (Lewisham)
Should we even bother parsing all these fields from the search results pages given that we'll get them on the deeper scrape anyway?
|
6 years ago |
|
Adrian Short
|
9f3af5e4a9
|
Tidy date format
|
6 years ago |
|
Adrian Short
|
1aa0aac9f9
|
Create Application class; scrape into Application objects. #8
|
6 years ago |
 richard
|
d4ec031ddc
|
add south london
|
6 years ago |
|
Adrian Short
|
a342ff53bd
|
Idox: searchCriteria.caseType and searchCriteria.developmentType are two separate things
We need to test a group of Idox sites to see how these parameters are used in practice.
|
6 years ago |
|
Adrian Short
|
fa2a705069
|
Tidy up
|
6 years ago |
|
Adrian Short
|
2778252c22
|
Raise exception if search gives "too many results" error. Fix #14
|
6 years ago |
|
Adrian Short
|
9229f1ff55
|
Add expected fields to search form if they're missing. Fix #6
This structure allows us to add other missing fields easily if necessary.
|
6 years ago |
|
Adrian Short
|
7349fd6470
|
Make exception name nicer
|
6 years ago |
|
Adrian Short
|
580b887708
|
Automatically add tags for software systems
|
6 years ago |
|
Adrian Short
|
2e100bc3c8
|
Make scrapers private instance methods in Authority
|
6 years ago |
|
Adrian Short
|
6d72d25166
|
Search field name variant for Idox eg Bolton
|
6 years ago |
|
Adrian Short
|
8d15678700
|
Catch Idox internal error where search page fails to load
|
6 years ago |
|
Adrian Short
|
4f4fc49c38
|
Add Greater Manchester authorities
|
6 years ago |
|
Adrian Short
|
29f2c2a885
|
Update tags and README
|
6 years ago |
 pezholio
|
3a1499524f
|
Some initial tests
|
6 years ago |
|
Adrian Short
|
7441f13d6b
|
Sometimes date fields have values that aren't dates
Like "Not available" in Greenwich.
|
6 years ago |
|
Adrian Short
|
ab9e76ca92
|
Bump version number
|
6 years ago |
|
Adrian Short
|
1b0f87a371
|
Add all the London councils
|
6 years ago |
|
Adrian Short
|
b9adc22816
|
Bugfix scopes
|
6 years ago |
|
Adrian Short
|
1354202538
|
Create custom exception
|
6 years ago |
|
Adrian Short
|
14ed6e7b79
|
Add more authorities
|
6 years ago |
|
Adrian Short
|
1a00f3797d
|
Add Authority class
UKPlanningScraper#search method is now UKPlanningScraper::Authority.scrape.
|
6 years ago |
|
Adrian Short
|
673dec1f26
|
Add authorities.csv file
|
6 years ago |
|
Adrian Short
|
9f10e4ec8a
|
Bugfix
|
6 years ago |
|
Adrian Short
|
dca8a84979
|
Add helper search params: :validated_days, :decided_days, :received_days
|
6 years ago |
|
Adrian Short
|
5e166c3d34
|
Bugfix for councils that don't have this column
|
6 years ago |
|
Adrian Short
|
0a6736b9ee
|
Remove unnecessary var
|
6 years ago |
|
Adrian Short
|
dbfd10b33c
|
Add core Northgate scraper for search results page
|
6 years ago |
|
Adrian Short
|
2946c1d7bf
|
Move Idox scraper into its own method
|
6 years ago |
|
Adrian Short
|
f70d4f2598
|
Some Documents tabs don't have the number in them
|
6 years ago |
|
Adrian Short
|
23d5825e73
|
Bugfix: handle applications with no documents correctly
|
6 years ago |
|
Adrian Short
|
163e471d83
|
Too much information
|
6 years ago |
|
Adrian Short
|
ddc81dd838
|
Scrape and parse summary tab for each app
|
6 years ago |
|
Adrian Short
|
b9e75b3507
|
Fix #3 parsing for more Idox sites. Bump version to 0.1.1
|
6 years ago |
|
Adrian Short
|
f7c77fce95
|
Improve variable name
It's nicer to type.
|
6 years ago |
|
Adrian Short
|
7f48783e71
|
First commit
|
6 years ago |
