Mike Fährmann
1e3dd7330e
merge SharedConfigMixin functionality into Extractor
2020-11-17 00:34:07 +01:00
Mike Fährmann
2626629117
[danbooru] handle posts without 'id' ( fixes #1004 )
2020-09-16 21:35:27 +02:00
Mike Fährmann
e19f665a44
[danbooru] change default for 'ugoira' to 'false'
...
Downloading the pre-rendered versions should be a better default
than .zip files with individual frames.
2020-05-20 19:57:28 +02:00
Mike Fährmann
ad2efa8509
[e621] derive from Danbooru extractors ( #651 )
...
- use extractor implementations from 'danbooru'
- use "page": "b[ID]" to paginate over results instead of
"tags": "id:<[ID]", avoiding infinite loops with certain
post orders
- bump User-Agent version
2020-03-22 21:08:45 +01:00
Mike Fährmann
5bcc7184c9
[danbooru][e621] increase page limits
2020-03-17 15:53:28 +01:00
Mike Fährmann
f117e32910
[danbooru] restore 'popular' functionality
2020-02-29 23:37:53 +01:00
Mike Fährmann
86c00f9e66
[danbooru] move extractor logic from booru.py
2020-02-28 22:53:45 +01:00
Mike Fährmann
f02a768b5c
[danbooru] add 'ugoira' option ( #406 )
...
to choose between ZIP archives or converted video files
for Ugoira posts
2019-08-31 21:51:52 +02:00
Mike Fährmann
6284731107
simplify extractor constants
...
- single strings for URL patterns
- tuples instead of lists for 'directory_fmt' and 'test'
- single-tuple tests where applicable
2019-02-08 13:45:40 +01:00
Mike Fährmann
1e4d351ad3
[danbooru] add authentication support ( closes #151 )
...
... via HTTP Basic Auth with username and "password".
The password value in this case is not the account password itself,
but the"api_key" found in your user profile.
2019-01-09 14:19:07 +01:00
Mike Fährmann
e1d306cc48
update unit test results
2018-10-13 16:54:30 +02:00
Mike Fährmann
6ac403c5d3
add postprocessor config example
2018-06-08 18:31:59 +02:00
Mike Fährmann
3905474805
[booru] call update_page() with correct dict ( closes #82 )
2018-03-19 11:33:19 +01:00
Mike Fährmann
974e73bdbb
[booru] smaller code adjustments
2018-01-06 17:48:49 +01:00
Mike Fährmann
1219ebb7f5
[danbooru] use alternate subdomains; support safebooru
2018-01-04 00:51:04 +01:00
Mike Fährmann
9e8a84ab6c
[booru] rewrite using Mixin classes ( #59 )
...
- improved code structure
- improved URL patterns
- better pagination to work around page limits on
- Danbooru
- e621
- 3dbooru
2018-01-04 00:01:39 +01:00
Mike Fährmann
289d6b65d2
[danbooru] extend and improve URL regex
...
- add support for danbooru mirrors:
- hijiribe.donmai.us
- sonohara.donmai.us
- todo: actually use these domains instead of redirecting everything
to danbooru itself
- improve handling of query string parameters
2017-10-16 21:21:19 +02:00
Mike Fährmann
65997d835b
replace popular/ranking tests with older ones
...
Metadata of several year old lists shouldn't change as much as it
would for newer ones, which makes metadata-comparisons of the output
of build_testresult_db.oy easier.
2017-08-31 15:09:18 +02:00
Mike Fährmann
07214f4007
[booru] place subcategories into base classes
2017-08-26 22:27:55 +02:00
Mike Fährmann
47bcf53ec1
implement support for additional unit test result types
...
- "pattern" matches all resulting URLs against the given regex
- "count" allows to specify the amount of returned URLs
2017-08-25 22:01:14 +02:00
Mike Fährmann
18e6ed1c7e
[booru] add extractors for "Popular" images
2017-08-24 21:29:22 +02:00
Mike Fährmann
c921b4f32a
code cleanup and fixing tests
2017-06-02 09:10:58 +02:00
Mike Fährmann
cf79a47b59
update unit tests
2017-04-08 11:02:32 +02:00
Mike Fährmann
ed94d9b92d
fix/improve various things
2017-03-17 09:39:46 +01:00
Mike Fährmann
94e10f249a
code adjustments according to pep8 nr2
2017-02-01 00:53:19 +01:00
Mike Fährmann
d7e168799d
consistent extractor naming scheme + docstrings
2016-09-12 10:34:31 +02:00
Mike Fährmann
6f7d42b974
update tests
2016-07-12 12:08:36 +02:00
Mike Fährmann
616e0aedd6
update booru testdata
2015-12-22 03:10:52 +01:00
Mike Fährmann
ba99506c72
more extractor test-cases
2015-12-14 03:00:58 +01:00
Mike Fährmann
2449532132
add more extractor test-cases
2015-12-13 04:36:44 +01:00
Mike Fährmann
c8fdfbec42
[danbooru] add test cases
2015-12-12 15:59:26 +01:00
Mike Fährmann
f7c47a6018
add subcategories to extractors
2015-11-30 01:11:13 +01:00
Mike Fährmann
15dec86e6a
[danbooru] update to new format
2015-11-21 00:55:25 +01:00
Mike Fährmann
205ef3ca02
[danbooru] add single image/post extractor
2015-11-20 20:25:31 +01:00
Mike Fährmann
ee1ba22d05
[danbooru] add pool extractor
2015-11-20 20:24:58 +01:00
Mike Fährmann
80917f5392
[danbooru] rewrite to use multiple extractors
2015-11-20 20:24:15 +01:00
Mike Fährmann
3b0fe8f544
unify booru filename-patterns
2015-11-06 16:48:33 +01:00
Mike Fährmann
3c13548f29
rewrite extractors to use config-module
2015-10-05 15:51:08 +02:00
Mike Fährmann
3c6161eea7
small whitespace fixes
2015-04-11 16:22:15 +02:00
Mike Fährmann
1f4866fcd6
[danbooru] update to new extractor interface
2015-04-11 00:17:06 +02:00
Mike Fährmann
34d13bc906
added extractor 'danbooru' + split BooruExtractor to handle XML and JSON
2014-12-30 21:34:55 +01:00
