1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-22 10:42:34 +01:00
Commit Graph

5919 Commits

Author SHA1 Message Date
Mike Fährmann
f8f67dab22
[cookies] add 'cookies-select' option 2024-09-27 10:41:26 +02:00
Mike Fährmann
a783d6473c
[jpgfish] update domain to 'jpg5.su' (#6231) 2024-09-26 15:23:22 +02:00
Mike Fährmann
f0267f969a
[skeb] prevent 429 errors and need for 'request_key' cookie
https://github.com/danbooru/danbooru/pull/5795
2024-09-26 15:15:37 +02:00
Mike Fährmann
e8c5b57a33
merge #6115: [inkbunny:favorite] update default directory
- extract 'favs_username' metadata
- store files in 'favs_username' directory
2024-09-25 20:28:14 +02:00
Mike Fährmann
ac3ff25236
[inkbunny:favorite] update test 2024-09-25 20:25:33 +02:00
Mike Fährmann
050d87d024
merge #6113: [weasyl:favorite] fix pagination, support readable URLs 2024-09-25 20:08:36 +02:00
Mike Fährmann
9d7f8f892d
[weasyl:favorite] update
- use 'self.groups' to access userid and username
- safe one request by not doing an explicit username -> userid lookup
- safe one request by following the 'Next' link instead of detecting an
  empty page
2024-09-25 20:02:01 +02:00
Mike Fährmann
3eb3564b5d
[civitai] support using internal tRPC API endpoints (#3706) 2024-09-25 18:46:18 +02:00
Mike Fährmann
daa220370c
[civitai] improve image URL handling (#3706)
- support building URLs from URL-hash values
- rename '_orig' to '_url'
2024-09-25 17:29:35 +02:00
Mike Fährmann
a2db0d5c0d
[civitai] add 'quality' option (#3706)
download 'original=true' files by default
2024-09-25 17:23:08 +02:00
Mike Fährmann
92bbb9bf31
[civitai] add 'image' extractors (#3706, #6220) 2024-09-23 10:13:30 +02:00
Deer-Spangle
cbecaecc43 Fix infinite loop in Weasyl Favs downloader 2024-09-22 11:12:34 +01:00
Mike Fährmann
933dc568c3
[tests] ensure 'extractor.find' and 'from_url' extractors are identical 2024-09-22 10:58:59 +02:00
Mike Fährmann
14c57f771c
[tests] make "#category" result entries optional
use categories of the given "#class"
when "#category" is not specified
2024-09-21 21:45:45 +02:00
Mike Fährmann
8bf081d295
[ao3] fix bookmark extraction, support 'series' bookmarks (#6013) 2024-09-21 13:54:42 +02:00
Mike Fährmann
5c062f95c1
[ao3] fix 'title' of restricted works (#6013) 2024-09-21 13:21:45 +02:00
Mike Fährmann
91eb04b0d0
[ao3] detect member-only and adult works (#6013) 2024-09-21 13:20:42 +02:00
Mike Fährmann
3348b05df0
[ao3] implement login with username & password (#6013) 2024-09-21 13:15:50 +02:00
Mike Fährmann
93eca64a73
[civitai] add initial support (#3706, #3787, #4129, #5995) 2024-09-20 17:21:17 +02:00
Mike Fährmann
fe190be589
[8chan] update 'TOS' cookie name 2024-09-19 20:50:58 +02:00
Mike Fährmann
bb03311894
[docs] rewrite Field Names table in formatting.md as HTML
should fix the '\|' in '{empty\|title}'
in https://gdl-org.github.io/docs/formatting.html
2024-09-19 20:47:43 +02:00
Mike Fährmann
2c7a0c3ca8
add alternatives for deprecated utc datetime functions 2024-09-19 20:47:05 +02:00
Mike Fährmann
a051e1c955
directly pass exception instances as 'exc_info' logger argument 2024-09-19 14:50:08 +02:00
Mike Fährmann
dd56bb2187
include debug exception info for GalleryDLException errors 2024-09-19 13:51:27 +02:00
Mike Fährmann
68bff76d90
[formatter] implement 'L' conversion 2024-09-19 13:50:52 +02:00
Mike Fährmann
b44f0cdab0
[formatter] allow accessing 'util.NONE' via global '_nul' 2024-09-19 13:28:59 +02:00
Mike Fährmann
2dfdc92b21
[ao3] extract detailed 'chapters' metadata (#6013) 2024-09-18 09:48:57 +02:00
Mike Fährmann
1d7df9cef2
[ao3] extract 'date_completed' and 'date_updated' metadata (#6013) 2024-09-17 17:26:54 +02:00
Mike Fährmann
064bc890fc
[ao3] parse 'series' metadata (#6013) 2024-09-17 17:14:44 +02:00
Mike Fährmann
6b8628b23f
merge #6191: [cohost] support downloading likes 2024-09-17 10:50:28 +02:00
Mike Fährmann
8f777668d0
[ao3] match URLs with 'com' and 'net' TLDs and 'ao3.org' (#6013) 2024-09-17 09:59:55 +02:00
Kae
31af0a12c7
[cohost] Support for downloading likes
turns out it's almost the same as tags, so I was able to get it working pretty easily
2024-09-17 12:50:59 +10:00
Mike Fährmann
73f833d08a
[cookies:firefox] support using domain + container filters together 2024-09-16 14:58:44 +02:00
Mike Fährmann
a9dc7a6f98
[deviantart] warn about empty journal texts (#5916)
https://github.com/mikf/gallery-dl/issues/5916#issuecomment-2351069092
2024-09-16 10:12:25 +02:00
Mike Fährmann
4c391805de
[bluesky] simplify file extraction code (#6183) 2024-09-16 09:37:18 +02:00
Mike Fährmann
638a676495
[ao3] add initial support (#6013) 2024-09-15 22:38:21 +02:00
Mike Fährmann
7d6520e15d
[bluesky] support video downloads (#6183) 2024-09-15 22:38:03 +02:00
Mike Fährmann
af8cba089e
[zzup] support 'up.zzup.com' galleries (#6181) 2024-09-15 11:01:27 +02:00
Mike Fährmann
7abf6e445c
[cohost] add 'tag' extractor (#4483) 2024-09-13 11:11:53 +02:00
Mike Fährmann
0d67d54162
[cohost] support 'attachment-row' blocks (#4483) 2024-09-13 10:33:05 +02:00
Mike Fährmann
29279f07d4
[cohost] warn about inaccessible posts (#4483) 2024-09-13 10:31:28 +02:00
Mike Fährmann
319116c923
[pp:ugoira] update mtime of zipped files (#6147)
in zip archives generated by '"mode": "archive"'
2024-09-12 21:51:55 +02:00
Mike Fährmann
df0d7d4a12
[cohost] add 'user' and 'post' extractors (#4483) 2024-09-11 18:03:33 +02:00
Mike Fährmann
ff07aef776
[pp:ugoira] implement storing "original" frames in archives (#6147)
… by using '"mode": "archive"'

- rename 'ffmpeg-demuxer' option to 'mode'
- add 'metadata' option
- add 'zip' as a possible `--ugoira` format

TODO: adjust file mtimes inside archives when 'mtime' is enabled
2024-09-09 21:41:37 +02:00
Mike Fährmann
4601aa9794
[util] add 'NullContext'
an even more minimal 'contextlib.nullcontext'
that also works on older Python versions
2024-09-09 20:28:18 +02:00
Mike Fährmann
4da3347d18
allow filtering '--list-extractors' results
with blacklist/whitelist syntax, e.g.

--list-extractors pixiv
--list-extractors pixiv:user pixiv:work
--list-extractors :search
2024-09-08 09:27:32 +02:00
Mike Fährmann
0db3c11ab0
[common] use 'cf-mitigated' header to detect challenges 2024-09-07 20:16:06 +02:00
Mike Fährmann
4b04ccb3a1
[wikimedia] probe possible API endpoints when none is defined
instead of hardcoding it to '/api.php'
2024-09-07 20:11:44 +02:00
Mike Fährmann
061cc12fdd
[pp:ugoira] fix "KeyError: '_ugoira_frame_index'" (#6154)
fixes regression introduced in 07bd967f

Files with a non-ugoira related 'frames' metadata field would cause an
exception when an ugoira post processor was active.
2024-09-06 21:29:12 +02:00
Mike Fährmann
11a508f470
[docker] fix Docker image build
make commands meant to remove unnecessary caches non-fatal
(pip no longer installs setuptools and wheel directly anymore)
2024-09-06 21:27:45 +02:00