1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-25 20:22:36 +01:00
Commit Graph

1347 Commits

Author SHA1 Message Date
Mike Fährmann
321161c769
[patreon] use mobile UA (#6241, #6239, #6140) 2024-10-01 08:22:16 +02:00
Mike Fährmann
a937b72034
[ao3] add 'subscriptions' extractor (#6247) 2024-09-29 13:01:51 +02:00
Mike Fährmann
df4ecef364
release version 1.27.5 2024-09-28 11:44:10 +02:00
Mike Fährmann
4e9dd036e7
[civitai] add 'nsfw' option (#3706) 2024-09-28 08:44:35 +02:00
Mike Fährmann
bc11dc0de2
[deviantart] add 'previews' option (#3782, #6124) 2024-09-27 10:41:26 +02:00
Mike Fährmann
f8f67dab22
[cookies] add 'cookies-select' option 2024-09-27 10:41:26 +02:00
Mike Fährmann
3eb3564b5d
[civitai] support using internal tRPC API endpoints (#3706) 2024-09-25 18:46:18 +02:00
Mike Fährmann
a2db0d5c0d
[civitai] add 'quality' option (#3706)
download 'original=true' files by default
2024-09-25 17:23:08 +02:00
Mike Fährmann
92bbb9bf31
[civitai] add 'image' extractors (#3706, #6220) 2024-09-23 10:13:30 +02:00
Mike Fährmann
3348b05df0
[ao3] implement login with username & password (#6013) 2024-09-21 13:15:50 +02:00
Mike Fährmann
93eca64a73
[civitai] add initial support (#3706, #3787, #4129, #5995) 2024-09-20 17:21:17 +02:00
Mike Fährmann
bb03311894
[docs] rewrite Field Names table in formatting.md as HTML
should fix the '\|' in '{empty\|title}'
in https://gdl-org.github.io/docs/formatting.html
2024-09-19 20:47:43 +02:00
Mike Fährmann
68bff76d90
[formatter] implement 'L' conversion 2024-09-19 13:50:52 +02:00
Mike Fährmann
b44f0cdab0
[formatter] allow accessing 'util.NONE' via global '_nul' 2024-09-19 13:28:59 +02:00
Mike Fährmann
73f833d08a
[cookies:firefox] support using domain + container filters together 2024-09-16 14:58:44 +02:00
Mike Fährmann
638a676495
[ao3] add initial support (#6013) 2024-09-15 22:38:21 +02:00
Mike Fährmann
7d6520e15d
[bluesky] support video downloads (#6183) 2024-09-15 22:38:03 +02:00
Mike Fährmann
7abf6e445c
[cohost] add 'tag' extractor (#4483) 2024-09-13 11:11:53 +02:00
Mike Fährmann
df0d7d4a12
[cohost] add 'user' and 'post' extractors (#4483) 2024-09-11 18:03:33 +02:00
Mike Fährmann
ff07aef776
[pp:ugoira] implement storing "original" frames in archives (#6147)
… by using '"mode": "archive"'

- rename 'ffmpeg-demuxer' option to 'mode'
- add 'metadata' option
- add 'zip' as a possible `--ugoira` format

TODO: adjust file mtimes inside archives when 'mtime' is enabled
2024-09-09 21:41:37 +02:00
Mike Fährmann
4da3347d18
allow filtering '--list-extractors' results
with blacklist/whitelist syntax, e.g.

--list-extractors pixiv
--list-extractors pixiv:user pixiv:work
--list-extractors :search
2024-09-08 09:27:32 +02:00
Mike Fährmann
7fe0f35998
[sexcom] add 'likes' extractor (#6149) 2024-09-06 07:44:06 +02:00
Mike Fährmann
07bd967f59
[pp:ugoira] update (#6056)
- introduce '_ugoira_frame_index' metadata field
- store Ugoira file exts separately
- add 'skip' option
2024-09-05 20:25:20 +02:00
Mike Fährmann
359572162b
[pp:rename] improve renaming files 'to' a format (#5846, #6044) 2024-09-03 21:17:31 +02:00
Mike Fährmann
864484e4c6
[instagram] add 'info' as a possible 'include' value 2024-09-02 15:43:55 +02:00
Mike Fährmann
ae9b0da755
[pp:hash] add 'hash' post processor (#6099) 2024-08-31 17:04:44 +02:00
Mike Fährmann
f52cf54e16
[docs] update 'wikimedia' capabilities in supportedsites.md 2024-08-31 17:04:22 +02:00
Mike Fährmann
bd932b6860
[twitter] add 'info' as a possible 'include' value (#6114) 2024-08-31 17:04:22 +02:00
Mike Fährmann
60b655429f
add '--rename' and '--rename-to' command-line options (#5846, #6044) 2024-08-30 18:22:46 +02:00
Mike Fährmann
17f5ba43a8
[pp:rename] add 'rename' post processor (#5846, #6044)
renames previously downloaded files to a different filename format
2024-08-30 18:21:36 +02:00
Mike Fährmann
cf8e04d999
[koharu] improve format selection (#6088)
- allow specifying more than one possible format
- ignore not available formats
2024-08-29 09:33:24 +02:00
Mike Fährmann
b46169cfd2
add 'input-files' config option (#6059) 2024-08-27 17:21:49 +02:00
Mike Fährmann
4b286e80fd
merge #6050: [wikimedia] add 'wiki' extractor 2024-08-25 09:38:24 +02:00
Mike Fährmann
46c3971c88
[bunkr] add 'tlds' option to allow URLs with all TLDs (#5875, #6017) 2024-08-24 20:45:44 +02:00
Mike Fährmann
4b94b7d477
[pp:metadata] add 'include' and 'exclude' options (#6058) 2024-08-19 21:58:57 +02:00
Mike Fährmann
f32e10f6a5
[instagram] add 'max-posts' option (#6054) 2024-08-19 10:19:44 +02:00
ClosedPort22
968c04a27c
[wikimedia] raise default value for 'limit' from 10 to 50 2024-08-18 16:33:13 +08:00
ClosedPort22
33fe1b68b7
[wikimedia] add 'limit' option 2024-08-18 13:39:48 +08:00
Mike Fährmann
e29f4ef226
[instagram] allow disabling 'cursor' output 2024-08-17 19:25:19 +02:00
Mike Fährmann
c0668f5106
[twitter] allow disabling 'cursor' output (#5990) 2024-08-17 19:24:38 +02:00
Mike Fährmann
78ae0ba9f7
[formatter] implement 'A' format specifier (#6036) 2024-08-16 20:34:23 +02:00
Mike Fährmann
0bbdeaaa50
[bunkr] support 'bunkr:' URL prefix (#6017)
and support 'bunkr.ax' by default
2024-08-14 19:00:59 +02:00
Mike Fährmann
2d55521582
[cookies:firefox] extract only cookies without container by default (#5957)
add support for 'all' to extract all cookies regardless of container
2024-08-14 18:59:41 +02:00
Mike Fährmann
8d1805e336
[hentaicosplays] support 'hentai-cosplay-xxx.com' (#5959) 2024-08-10 12:14:18 +02:00
Mike Fährmann
87a14a50e7
[zerochan] improve redirect handling, add 'redirects' option (#5891) 2024-08-10 11:32:30 +02:00
Mike Fährmann
846512f6cd
[furaffinity] add 'submissions' extractor (#5954) 2024-08-07 16:34:32 +02:00
Mike Fährmann
605f6fba2c
[pp:metadata] implement 'base-directory' option (#5262, #5728) 2024-08-07 10:15:06 +02:00
Mike Fährmann
704d786658
[docs] add 'blogger.api-key' (#5937) 2024-08-07 08:10:01 +02:00
Mike Fährmann
bb07313227
[deviantart] try to work around journal/status API changes (#5916)
The new /user/profile/posts endpoint is documented to
"return all journals & status updates for a given user in a single feed"
but it does not do this.

There are usually several or even all status updates missing.
2024-08-03 13:17:27 +02:00
Mike Fährmann
f87783ff26
[cien] add 'files' option (#2885) 2024-08-03 11:37:14 +02:00
Mike Fährmann
c372242a06
[koharu] add 'favorite' extractor (#5893) 2024-08-01 12:33:18 +02:00
Mike Fährmann
095f278d6f
[vsco] add 'include' option (#5911) 2024-07-31 12:32:04 +02:00
Mike Fährmann
399ba85841
[fallenangels] remove module 2024-07-30 17:33:16 +02:00
Mike Fährmann
aa6d00613f
[cien] initial support (#2885, #4103, #5240) 2024-07-28 19:27:12 +02:00
Mike Fährmann
c9aeedeafd
[koharu] add 'gallery' and 'search' extractors (#5893, #4707) 2024-07-28 12:22:18 +02:00
Mike Fährmann
226ead728e
[agnph] add 'tag' and 'post' extractors (#5284, #5890) 2024-07-27 12:17:47 +02:00
Mike Fährmann
8ecd408f53
add '-J/--resolve-json' command-line option (#5864) 2024-07-26 20:41:35 +02:00
Mike Fährmann
b5e141ed6e
[sankakucomplex] update domain to 'news.sankakucomplex.com' 2024-07-26 20:39:55 +02:00
Mike Fährmann
540eaa5add
[tumblr] implement 'pagination' option (#5880)
restore pagination behavior from before
de670bd7de
2024-07-23 20:31:04 +02:00
Mike Fährmann
156a70bec0
[aryion] update favorite extractor
- add test case
- add docs/supportedsites entry
- add custom directory_fmt and archive_fmt
- remove constructor
- appease flake8
2024-07-21 12:34:06 +02:00
Mike Fährmann
6940ad0e72
[booru] allow multiple 'url' keys (#5859) 2024-07-17 20:49:52 +02:00
Mike Fährmann
f7383a56f8
wrap filters/conditionals in a try-except block
allows accessing undefined fields without exception or locals().get(…)
but hides mistakes/typos/etc by evaluating to False without feedback

performance loss compared to the previous version without try-except
is negligible (~20ns for me)
2024-07-12 22:51:11 +02:00
Mike Fährmann
c83c812a1e
[instagram][twitter] rename 'profile' to 'info' (#5262, #3623) 2024-07-11 00:22:39 +02:00
Mike Fährmann
8aca0e6970
update default User-Agent header to Firefox 128 ESR 2024-07-09 20:42:06 +02:00
Mike Fährmann
da9916c01f
[pp:metadata] implement format strings for 'directory' (#5728) 2024-07-06 03:08:59 +02:00
Mike Fährmann
f41a5065b2
[actions] support multiple actions per pattern 2024-06-30 02:36:33 +02:00
Mike Fährmann
84b3da54aa
[actions] add 'exec' action (#5619) 2024-06-29 23:02:48 +02:00
Mike Fährmann
c9860002ba
[actions] add 'abort' and 'terminate' actions (#5778) 2024-06-29 19:20:17 +02:00
Mike Fährmann
c2bf4ff99c
[twitter] add 'profile' extractor (#3623) 2024-06-28 22:55:48 +02:00
Mike Fährmann
44896b0296
[instagram] add 'profile' extractor (#5262)
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2188915210
2024-06-28 22:54:07 +02:00
Mike Fährmann
ea81fa985f
[archive] implement 'archive-event' option (#5784)
With this, IDs of skipped files will no longer be written to an archive
by default. Use "archive-event": "file,skip" to restore the previous
behavior.
2024-06-27 22:00:59 +02:00
Mike Fährmann
8f50c04af2
[formatter] implement 'X' format specifier (#5770) 2024-06-21 20:56:19 +02:00
enduser420
c73375d8ba [tcbscans] update docs/supportedsites 2024-06-21 21:38:15 +05:30
Mike Fährmann
f58b0e6fc7
[twitter] ignore 'Unavailable' media (#5736)
… including geo-restricted content.

add 'unavailable' option to allow re-enabling them again
2024-06-21 00:15:10 +02:00
Mike Fährmann
a1bb32792b
do not try to read from stdin when it is non-interactive (#5733)
add '--no-input' command-line option and 'input' config file option
to allow users to manually configure this
2024-06-16 18:31:39 +02:00
Mike Fährmann
76385f5f18
re-categorize some command-line options in --help 2024-06-15 23:29:09 +02:00
Mike Fährmann
4ffaa7fabf
[docs] update ytdl references 2024-06-15 21:45:06 +02:00
Mike Fährmann
942fc18008
[docs] update links to source files 2024-06-15 01:57:34 +02:00
Mike Fährmann
3fc2e61818
add '--config-open' and '--config-status' (#5713)
adapted from 119a25a59c
2024-06-13 23:22:56 +02:00
Mike Fährmann
c699ce8ebb
[twitter] add 'username-alt' option (#5715) 2024-06-13 00:54:43 +02:00
Mike Fährmann
c6fc0281e8
[newgrounds] extend 'format' option (#5709)
- check more extensions for original formats (mp4, webm, m4v, mov, mkv)
- allow specifying which extensions and recoded formats to check
2024-06-12 20:46:45 +02:00
Mike Fährmann
9abeab5ecf
[shimmie2] support 'vidya.pics' (#5632) 2024-06-06 15:08:56 +02:00
Mike Fährmann
162d4269ec
[twitter] extend 'ratelimit' option (#5532)
allow waiting for a set amount of seconds
2024-06-06 01:18:08 +02:00
Mike Fährmann
1ce5de0290
[formatter] implement 'C' format specifier (#5647)
to apply a conversion after ':' or
to apply multiple conversions

for example {tags:CSl} or {tags:J - /Cl}
to convert list to string and lowercase it
2024-06-05 16:49:29 +02:00
Mike Fährmann
9b99d2c886
[philomena] support downloading SVG files (#5643) 2024-06-05 16:48:51 +02:00
Mike Fährmann
8fce9ea6d5
[hentainexus] restore module (#5275)
revert 97641cd151
2024-06-05 16:48:25 +02:00
Mike Fährmann
cbaf041cea
[docs:options] add --update arguments 2024-06-02 18:16:25 +02:00
Mike Fährmann
035d882c6f
[docs:supportedsites] include base categories without instances 2024-06-02 18:16:24 +02:00
Mike Fährmann
4d11cd9ffb
[vichan] remove 'wikieat.club'
redirects to some non-vichan site
2024-06-02 18:16:24 +02:00
Mike Fährmann
31133b97fb
[nitter] remove instances 2024-06-02 18:15:53 +02:00
Mike Fährmann
ce228ee163
[photobucket] remove module
had been broken for years and the new site is payed access only
2024-06-02 01:40:31 +02:00
Mike Fährmann
a53db09ca0
[artstation] disable TLS 1.2 ciphers by default (#5564, #5658) 2024-05-30 23:54:19 +02:00
Mike Fährmann
0761b22a7f
[hiperdex] update domain to 'hiperdex.top' (#5635) 2024-05-24 17:13:10 +02:00
Mike Fährmann
895e633c44
implement 'keywords-eval' option (#5621)
to allow evaluating 'keywords' values as format strings
2024-05-22 22:53:34 +02:00
Mike Fährmann
6276f5cd94
[twitter] update domain to x.com (#5597) 2024-05-17 22:59:52 +02:00
Mike Fährmann
d2f50ecf09
add 'skip-filter' option (#5255) 2024-05-10 22:59:52 +02:00
Mike Fährmann
fd734b9222
[archive] add 'archive-mode' option (#5255) 2024-05-10 22:59:51 +02:00
Mike Fährmann
bd8e4797e5
[vsco] add 'avatar' extractor (#5341) 2024-05-02 18:12:19 +02:00
Mike Fährmann
3cf5366143
[mastodon] add support for card images 2024-05-01 16:00:07 +02:00
Mike Fährmann
9b1995dda3
[mastodon] add 'favorite', 'list', and 'hashtag' extractors (#5529) 2024-05-01 15:59:34 +02:00