Mike Fährmann
9b2d782cb7
[pp:classify] rewrite & simplify ( #5213 )
...
Do not manually build paths, which get later overwritten by
pathfmt.build_path() anyway. Just update the target directory and let
the rest of the "path logic" handle it.
Fixes skipping previously downloaded and categorized files,
which was broken since 8124c16a50
2024-11-19 08:05:11 +01:00
Mike Fährmann
b069783578
[newgrounds] fix metadata extraction ( #6463 )
...
- fix 'comment' metadata
- fix 'following' extractor pattern
- use own 'type' values, since 'og:type' is no longer available
- update test results
2024-11-18 16:21:59 +01:00
Mike Fährmann
50acf2ac84
[danbooru] add 'artist-search' extractor ( #5348 )
2024-11-17 16:58:54 +01:00
Mike Fährmann
80454460ce
[config] support accumulating non-list values
...
fixes 1264fc518b
2024-11-16 21:13:57 +01:00
Mike Fährmann
bced143750
[tests] add workaround for compile_expression_defaultdict in pypy3
2024-11-16 19:35:28 +01:00
Mike Fährmann
f7246f025f
[weibo] simplify 'livephoto' extraction ( #6471 )
...
continuation of 396b52aef7
2024-11-16 08:19:02 +01:00
Mike Fährmann
cb09273670
[koharu] implement 'tags' option
2024-11-15 23:49:58 +01:00
Mike Fährmann
ddd325b435
merge #6432 : [koharu] update domain ( #6430 )
2024-11-15 22:41:46 +01:00
Mike Fährmann
e5c2882320
[koharu] cleanup
...
- update BASE_PATTERN formatting
- fix groups indices
- add tests for new domains
- update docs/supportedsites
2024-11-15 22:41:40 +01:00
K0ng2
a09d9edaa6
[koharu] updat root and root_api change
2024-11-15 22:14:33 +01:00
Mike Fährmann
0d1469f229
[exhentai] implement 'tags' option ( #2117 )
...
allow splitting tags into categories,
e.g. 'tags_parody', 'tags_group', etc.
2024-11-15 21:47:13 +01:00
Mike Fährmann
a3dbc58172
[pillowfort] provide 'count' metadata field ( #6478 )
2024-11-15 08:27:52 +01:00
Mike Fährmann
5bc3657c59
[util] implement 'compile_filter()' ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2477029728
allow (theoretically*) all filter expression statements
to be a list of individual filters
(*) except for 'filename' and 'directory' conditionals,
as dict keys cannot be lists
2024-11-14 22:47:36 +01:00
Mike Fährmann
0b99d9e6b9
[util] add "defaultdict" filters-environment
...
allows accessing undefined values without raising an exception,
but preserves other errors like TypeError, AttributeError, etc
2024-11-14 22:47:25 +01:00
Mike Fährmann
396b52aef7
[weibo] fix livephoto 'filename' & 'extension' ( #6471 )
2024-11-14 18:56:18 +01:00
Mike Fährmann
a3276e3b5d
[hentaifoundry] add 'tag' extractor ( #6465 )
2024-11-13 20:56:37 +01:00
Mike Fährmann
2b96d638dc
[bunkr] support 'bunkr.cr' URLs
2024-11-10 20:43:33 +01:00
Mike Fährmann
73d6e56a8f
merge #6443 : [bilibili] add support for articles ( #2824 )
2024-11-10 18:01:51 +01:00
Mike Fährmann
82d561e825
[bilibili] update
...
- use self.groups[…] to access matched values
- extract more metadata (count, width, height, size)
- remove type hint
- add tests
- update docs/supportedsites
2024-11-10 17:59:24 +01:00
Mike Fährmann
74f1e9a1ac
[poipiku] return 'count' as proper number ( #6445 )
2024-11-10 08:26:43 +01:00
Mike Fährmann
0e18fa395d
[flickr] use "download" URLs ( #6360 )
2024-11-09 17:33:27 +01:00
Mike Fährmann
1ddbcda58b
[nhentai] support ',webp' files ( #6442 )
2024-11-08 17:46:38 +01:00
Mike Fährmann
b6cf348658
[webtoons] extract 'episode_no' for comic results ( #6439 )
2024-11-08 14:19:17 +01:00
Mike Fährmann
6205e255f4
merge #6394 : [tumblr] add 'search' extractor
2024-11-08 08:17:46 +01:00
Mike Fährmann
33778d35ba
[tumblr] update
...
- simplify
- fix search pagination
- support custom search mode and post types
2024-11-08 08:15:13 +01:00
Mike Fährmann
a9a9f3a180
[pinterest] support 'story_pin_music_block' blocks ( #6421 )
2024-11-05 15:55:24 +01:00
Mike Fährmann
0b3ddd01af
[hiperdex] update domain to 'hipertoon.com' ( #6420 )
...
and fix 'description' extraction
2024-11-05 15:54:42 +01:00
Mike Fährmann
9afbe91f82
[rule34xyz] add 'format' option ( #1078 )
2024-11-05 15:45:52 +01:00
Mike Fährmann
cb0d8cae77
merge #6227 : [everia] add support ( #1067 , #2472 , #4091 )
2024-11-03 17:52:17 +01:00
Mike Fährmann
cea062ffc5
[everia] update
...
- implement general _pagination method
- simplify code
- adjust URL patterns
- update test results
2024-11-03 17:51:04 +01:00
missionfloyd
d31a3b5da3
[everia.club] Add support
...
- Unescape title and URL
- Add tags and categories metadata
Lookup tag id with API instead of downloading tag page
- Add category extractor
- Add tests
- Rename EveriaExtractor to EveriaPostExtractor
- Fix EveriaPostExtractor example
- Lookup tags/categories by post id
- Add date extractor
- Remove leftover pages parameter
- Add error handling for invalid dates.
- Add filename numbering
Parse date
- Rename extract() to images()
- Remove html import
- Fix search/date URLs with page number
- Fix tag/category search
- Fix post extractor
- Fix tag, category extractors
- Fix search extractor
- Only load first page once
- Fix date extractor
- Fix tests
- Clean up search extractor
2024-11-03 14:09:07 +01:00
Mike Fährmann
d787c0c4ea
[rule34xyz] add support ( #1078 , #4960 )
2024-11-03 10:12:26 +01:00
Mike Fährmann
7c0d2ca07d
[rule34vault] update
...
- implement 'tags' categorization
- don't use 'totalCount' for pagination end
- update tests
2024-11-03 09:59:25 +01:00
Delphox
565dc5b43b
[bluesky] match fxbsky.app and vxbsky.app
2024-11-02 16:00:43 -03:00
Mike Fährmann
93adfbe935
merge #6410 : [bluesky] match common bluesky embed fixes
2024-11-02 18:28:07 +01:00
Mike Fährmann
cd47425ccc
[bluesky] fix downloads from non-bsky PDSs ( #6406 )
2024-11-02 18:22:34 +01:00
Mike Fährmann
9deed87340
[bluesky] add 'author["instance"]' metadata ( #4438 )
2024-11-02 17:37:11 +01:00
Delphox
80c7246732
[bluesky] match cbsky.app, bskye.app, bskyx.app and bsyy.app urls
2024-11-02 13:04:32 -03:00
Mike Fährmann
99fe2b1f55
[bluesky] support 'main.bsky.dev' URLs ( #4438 )
2024-11-02 15:33:31 +01:00
Mike Fährmann
b92edb4614
[boosty] update default video format list ( #2387 )
2024-10-31 20:55:32 +01:00
Mike Fährmann
6f54328a39
[hitomi] update
...
- remove f-strings
- fix flake8 warnings
- move tests to test/results/hitomi.py
2024-10-29 16:56:52 +01:00
Mike Fährmann
655e42dc92
merge #6240 : [rule34vault] add support ( #5708 )
2024-10-28 22:31:05 +01:00
Mike Fährmann
a974c30057
[rule34vault] update
...
- use more of BooruExtractor's interface
- use BASE_PATTERN
- define generic pagination method
- parse 'date' metadata
- make tags & extended metadata optional
2024-10-28 22:28:23 +01:00
ssdaniel24
3d0263b3ab
[rule34vault] Added initial support for rule34vault.com
...
- Added playlists support for rule34vault
- Added support for posts in rule34vault
- Fixed supported sites with script
- Fixed posts pattern in rule34vault
- Added tests for rule34vault
- Clean
- Fixed lint warnings
2024-10-28 22:26:47 +01:00
Mike Fährmann
5de8576ff6
[noop] add 'noop' extractor
2024-10-28 19:45:24 +01:00
Mike Fährmann
2bbae0e98d
merge #6389 : [reddit] support user profile share links
2024-10-28 14:46:18 +01:00
inty
625fe0efce
[reddit] support user profile share links
2024-10-28 14:58:06 +03:00
Mike Fährmann
10c076e7f2
[saint] add 'album' and 'media' extractors ( #4405 , #6324 )
2024-10-27 22:27:30 +01:00
Mike Fährmann
061b27f329
[tests] detect calls to 'request()' during initialization ( #6387 )
2024-10-27 20:08:50 +01:00
Mike Fährmann
6693ae19e8
[civitai] add 'metadata' option ( #6383 )
2024-10-27 15:46:00 +01:00
