1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-25 20:22:36 +01:00
Commit Graph

1348 Commits

Author SHA1 Message Date
Mike Fährmann
f87783ff26
[cien] add 'files' option (#2885) 2024-08-03 11:37:14 +02:00
Mike Fährmann
c372242a06
[koharu] add 'favorite' extractor (#5893) 2024-08-01 12:33:18 +02:00
Mike Fährmann
095f278d6f
[vsco] add 'include' option (#5911) 2024-07-31 12:32:04 +02:00
Mike Fährmann
399ba85841
[fallenangels] remove module 2024-07-30 17:33:16 +02:00
Mike Fährmann
aa6d00613f
[cien] initial support (#2885, #4103, #5240) 2024-07-28 19:27:12 +02:00
Mike Fährmann
c9aeedeafd
[koharu] add 'gallery' and 'search' extractors (#5893, #4707) 2024-07-28 12:22:18 +02:00
Mike Fährmann
226ead728e
[agnph] add 'tag' and 'post' extractors (#5284, #5890) 2024-07-27 12:17:47 +02:00
Mike Fährmann
8ecd408f53
add '-J/--resolve-json' command-line option (#5864) 2024-07-26 20:41:35 +02:00
Mike Fährmann
b5e141ed6e
[sankakucomplex] update domain to 'news.sankakucomplex.com' 2024-07-26 20:39:55 +02:00
Mike Fährmann
540eaa5add
[tumblr] implement 'pagination' option (#5880)
restore pagination behavior from before
de670bd7de
2024-07-23 20:31:04 +02:00
Mike Fährmann
156a70bec0
[aryion] update favorite extractor
- add test case
- add docs/supportedsites entry
- add custom directory_fmt and archive_fmt
- remove constructor
- appease flake8
2024-07-21 12:34:06 +02:00
Mike Fährmann
6940ad0e72
[booru] allow multiple 'url' keys (#5859) 2024-07-17 20:49:52 +02:00
Mike Fährmann
f7383a56f8
wrap filters/conditionals in a try-except block
allows accessing undefined fields without exception or locals().get(…)
but hides mistakes/typos/etc by evaluating to False without feedback

performance loss compared to the previous version without try-except
is negligible (~20ns for me)
2024-07-12 22:51:11 +02:00
Mike Fährmann
c83c812a1e
[instagram][twitter] rename 'profile' to 'info' (#5262, #3623) 2024-07-11 00:22:39 +02:00
Mike Fährmann
8aca0e6970
update default User-Agent header to Firefox 128 ESR 2024-07-09 20:42:06 +02:00
Mike Fährmann
da9916c01f
[pp:metadata] implement format strings for 'directory' (#5728) 2024-07-06 03:08:59 +02:00
Mike Fährmann
f41a5065b2
[actions] support multiple actions per pattern 2024-06-30 02:36:33 +02:00
Mike Fährmann
84b3da54aa
[actions] add 'exec' action (#5619) 2024-06-29 23:02:48 +02:00
Mike Fährmann
c9860002ba
[actions] add 'abort' and 'terminate' actions (#5778) 2024-06-29 19:20:17 +02:00
Mike Fährmann
c2bf4ff99c
[twitter] add 'profile' extractor (#3623) 2024-06-28 22:55:48 +02:00
Mike Fährmann
44896b0296
[instagram] add 'profile' extractor (#5262)
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2188915210
2024-06-28 22:54:07 +02:00
Mike Fährmann
ea81fa985f
[archive] implement 'archive-event' option (#5784)
With this, IDs of skipped files will no longer be written to an archive
by default. Use "archive-event": "file,skip" to restore the previous
behavior.
2024-06-27 22:00:59 +02:00
Mike Fährmann
8f50c04af2
[formatter] implement 'X' format specifier (#5770) 2024-06-21 20:56:19 +02:00
enduser420
c73375d8ba [tcbscans] update docs/supportedsites 2024-06-21 21:38:15 +05:30
Mike Fährmann
f58b0e6fc7
[twitter] ignore 'Unavailable' media (#5736)
… including geo-restricted content.

add 'unavailable' option to allow re-enabling them again
2024-06-21 00:15:10 +02:00
Mike Fährmann
a1bb32792b
do not try to read from stdin when it is non-interactive (#5733)
add '--no-input' command-line option and 'input' config file option
to allow users to manually configure this
2024-06-16 18:31:39 +02:00
Mike Fährmann
76385f5f18
re-categorize some command-line options in --help 2024-06-15 23:29:09 +02:00
Mike Fährmann
4ffaa7fabf
[docs] update ytdl references 2024-06-15 21:45:06 +02:00
Mike Fährmann
942fc18008
[docs] update links to source files 2024-06-15 01:57:34 +02:00
Mike Fährmann
3fc2e61818
add '--config-open' and '--config-status' (#5713)
adapted from 119a25a59c
2024-06-13 23:22:56 +02:00
Mike Fährmann
c699ce8ebb
[twitter] add 'username-alt' option (#5715) 2024-06-13 00:54:43 +02:00
Mike Fährmann
c6fc0281e8
[newgrounds] extend 'format' option (#5709)
- check more extensions for original formats (mp4, webm, m4v, mov, mkv)
- allow specifying which extensions and recoded formats to check
2024-06-12 20:46:45 +02:00
Mike Fährmann
9abeab5ecf
[shimmie2] support 'vidya.pics' (#5632) 2024-06-06 15:08:56 +02:00
Mike Fährmann
162d4269ec
[twitter] extend 'ratelimit' option (#5532)
allow waiting for a set amount of seconds
2024-06-06 01:18:08 +02:00
Mike Fährmann
1ce5de0290
[formatter] implement 'C' format specifier (#5647)
to apply a conversion after ':' or
to apply multiple conversions

for example {tags:CSl} or {tags:J - /Cl}
to convert list to string and lowercase it
2024-06-05 16:49:29 +02:00
Mike Fährmann
9b99d2c886
[philomena] support downloading SVG files (#5643) 2024-06-05 16:48:51 +02:00
Mike Fährmann
8fce9ea6d5
[hentainexus] restore module (#5275)
revert 97641cd151
2024-06-05 16:48:25 +02:00
Mike Fährmann
cbaf041cea
[docs:options] add --update arguments 2024-06-02 18:16:25 +02:00
Mike Fährmann
035d882c6f
[docs:supportedsites] include base categories without instances 2024-06-02 18:16:24 +02:00
Mike Fährmann
4d11cd9ffb
[vichan] remove 'wikieat.club'
redirects to some non-vichan site
2024-06-02 18:16:24 +02:00
Mike Fährmann
31133b97fb
[nitter] remove instances 2024-06-02 18:15:53 +02:00
Mike Fährmann
ce228ee163
[photobucket] remove module
had been broken for years and the new site is payed access only
2024-06-02 01:40:31 +02:00
Mike Fährmann
a53db09ca0
[artstation] disable TLS 1.2 ciphers by default (#5564, #5658) 2024-05-30 23:54:19 +02:00
Mike Fährmann
0761b22a7f
[hiperdex] update domain to 'hiperdex.top' (#5635) 2024-05-24 17:13:10 +02:00
Mike Fährmann
895e633c44
implement 'keywords-eval' option (#5621)
to allow evaluating 'keywords' values as format strings
2024-05-22 22:53:34 +02:00
Mike Fährmann
6276f5cd94
[twitter] update domain to x.com (#5597) 2024-05-17 22:59:52 +02:00
Mike Fährmann
d2f50ecf09
add 'skip-filter' option (#5255) 2024-05-10 22:59:52 +02:00
Mike Fährmann
fd734b9222
[archive] add 'archive-mode' option (#5255) 2024-05-10 22:59:51 +02:00
Mike Fährmann
bd8e4797e5
[vsco] add 'avatar' extractor (#5341) 2024-05-02 18:12:19 +02:00
Mike Fährmann
3cf5366143
[mastodon] add support for card images 2024-05-01 16:00:07 +02:00
Mike Fährmann
9b1995dda3
[mastodon] add 'favorite', 'list', and 'hashtag' extractors (#5529) 2024-05-01 15:59:34 +02:00
Mike Fährmann
bef0bd3b49
add '--no-colors' command-line option 2024-04-20 21:06:59 +02:00
Mike Fährmann
20e2c0042b
[output] enable colors by default 2024-04-20 20:51:20 +02:00
Mike Fährmann
14b38264e0
[output] extend 'output.colors' (#2566)
allow specifying ANSI colors for all loglevels
(debug, info, warning, error)
2024-04-20 20:50:58 +02:00
Mike Fährmann
566472f080
[common] add 'sleep-429' option (#5160) 2024-04-16 18:41:28 +02:00
Mike Fährmann
6dac43ad60
[docs] replace AnchorJS with custom script
use it in rendered .rst documents as well as in .md ones
2024-04-13 17:53:04 +02:00
Mike Fährmann
141a93c8fd
[docs] update docs/configuration links (#5059, #5369, #5423) 2024-04-13 02:18:44 +02:00
Mike Fährmann
85bbb59483
[twitter] implement 'relogin' option (#5445) 2024-04-12 23:01:22 +02:00
Mike Fährmann
e02d2ff45d
[tapas] add 'creator' extractor (#5306) 2024-04-11 23:41:50 +02:00
Mike Fährmann
35d4a706ae
[pixiv:novel] add 'covers' option (#5373) 2024-04-11 22:27:49 +02:00
Mike Fährmann
b57051719f
[wikimedia] support wiki.gg wikis 2024-04-09 19:24:01 +02:00
Mike Fährmann
cf36c576d0
[docs] document 'actions' (#4543)
or at least attempt to
2024-03-31 03:52:29 +02:00
Mike Fährmann
c7edeb871b
[docs] complete Authentication info in supportedsites.md 2024-03-29 02:11:04 +01:00
Mike Fährmann
a1e64bac73
[docs] update defaults of 'sleep-request', 'browser', 'tls12' 2024-03-29 02:04:11 +01:00
Mike Fährmann
9cce461627
[kemonoparty] add 'announcements' option (#5262)
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2015919188
2024-03-26 15:20:14 +01:00
Mike Fährmann
31e7ca73b6
[gelbooru] add 'order-posts' option for favorites (#5220) 2024-03-23 13:30:09 +01:00
Mike Fährmann
e1c51c0dfb
[vipergirls] add 'domain' option (#4166) 2024-03-18 17:36:16 +01:00
Mike Fährmann
ae116812cc
[vipergirls] add 'like' option (#4166) 2024-03-18 17:36:16 +01:00
Mike Fährmann
5c1f5861b6
[flickr] add 'contexts' option (#5324) 2024-03-18 17:36:16 +01:00
Mike Fährmann
03a9ce9832
[kemonoparty] add 'order-revisions' option (#5334) 2024-03-15 23:06:05 +01:00
Mike Fährmann
e76d5756a0
merge #5329: fix some typos 2024-03-14 15:20:54 +01:00
teslaedison
ab1fc470b7 chore: fix some typos
Signed-off-by: teslaedison <qingchengqiushuang@gmail.com>
2024-03-14 16:07:02 +08:00
Mike Fährmann
d53db6e11a
[twitter] handle "account is temporarily locked" errors (#5300)
- display proper error message
- add 'locked' option
2024-03-13 22:34:25 +01:00
Mike Fährmann
416f1b8cc1
[pages] customize layout to remove unnecessary links
- "docs" header
- "Improve this page"

https://github.com/pages-themes/primer/blob/master/_layouts/default.html
2024-03-11 23:28:20 +01:00
Mike Fährmann
052811b57f
[docs] fix another typo (#5262)
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1980094380

This on was on the same line as the previous one ... (9fd851cd)
2024-03-07 00:59:02 +01:00
Mike Fährmann
40c0553523
[twitter] add 'quotes' extractor (#5262)
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1981571924

It's implemented as a search for 'quoted_tweet_id:…' on Twitter.
2024-03-07 00:52:50 +01:00
Mike Fährmann
6d9e3c0eb1
[skeb] add extractor for followed users (#5290)
needs 'Authorization' header from browser session
-o headers.Authorization="Bearer ey…"
2024-03-06 22:43:01 +01:00
Mike Fährmann
ace16f00f5
[weibo] fix retweets (#2825, #3874, #5263)
- handle 快转 retweets
- disable 'retweets' by default
- skip all retweet media when 'retweets' are disabled
- extract all retweet media when 'retweets' is set to "original"
2024-03-06 19:36:53 +01:00
Mike Fährmann
9fd851cda1
[docs] fix typo: rebot -> robot (#5262)
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1979884897
2024-03-06 02:30:38 +01:00
Mike Fährmann
40af26f68b
[docs] link to documentation files in index.md 2024-03-03 22:50:09 +01:00
Mike Fährmann
1a9b9aa310
[artstation] support video clips (#2566, #3309, #3911)
- add 'videos' and 'previews' options
- fix 403 errors for video previews
2024-03-03 18:00:45 +01:00
Mike Fährmann
25d2854272
[deviantart] add 'comments-avatars' option (#4995) 2024-03-02 21:59:16 +01:00
Mike Fährmann
cf9e99c07b
[artstation] support collections (#146)
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1972101003
2024-03-01 20:21:21 +01:00
Mike Fährmann
32ec695195
merge #5256: [wikimedia] add azurlane.koumakan.jp 2024-02-29 21:50:24 +01:00
Mike Fährmann
5d9ec91896
[azurlanewiki] supportedsites + test 2024-02-29 21:49:13 +01:00
Mike Fährmann
c006f9c949
[docs] add ability to specify more than one 'event'
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1969407203
2024-02-29 14:40:18 +01:00
Mike Fährmann
495c9ee126
[bluesky] add 'reposts' option (#4438, #5248) 2024-02-27 18:42:29 +01:00
Mike Fährmann
cc6b9e4c18
[zerochan] use API by default (#3669)
add 'pagination' option
2024-02-25 00:36:14 +01:00
Mike Fährmann
741fd00cec
[deviantart] extend 'metadata' option (#5175)
alloe fetching extended metadata in addition to the usual
'description', 'tags', etc by setting 'metadata' to a list of
'camera', 'stats', 'submission', 'collection', and 'gallery'

for example "metadata": "stats,submission"
2024-02-18 23:14:14 +01:00
Mike Fährmann
ccb413df71
[wikimedia] support 'pidgi.net' and 'bulbapedia.bulbagarden.net' (#5205, #5206) 2024-02-17 17:35:10 +01:00
Mike Fährmann
7033cc14e9
[vsco] add 'space' extractor (#5202) 2024-02-17 01:54:05 +01:00
Mike Fährmann
ee7c054855
[bluesky] add 'search' extractor (#4438)
Both https://bsky.app/search?q=QUERY and https://bsky.app/search/QUERY
are recognized as search URLs, where QUERY gets forwarded unmodified as
'q' parameter for app.bsky.feed.searchPosts .

User searches are not supported yet.
2024-02-16 15:58:47 +01:00
Mike Fährmann
91e5c4fdfe
[bluesky] add 'avatar' and 'background' extractors (#4438) 2024-02-16 15:41:19 +01:00
Mike Fährmann
0abd9723af
[bluesky] add 'metadata' option (#4438)
allow extracting 'user' metadata and
make 'facets' extraction optional
2024-02-15 23:30:16 +01:00
Mike Fährmann
7e036ea290
[bluesky] add 'depth' option (#4438)
and reduce default depth and parentHeight values
2024-02-15 22:26:05 +01:00
Mike Fährmann
c97b92cc35
[fanbox] add 'home' and 'supporting' extractors (#5138) 2024-02-14 23:25:39 +01:00
Mike Fährmann
04e4ffc64c
[deviantart] combine 'png' option with 'quality' (#4846)
"quality": "png" to download PNGs instead og JPEGs
2024-02-14 22:07:29 +01:00
Mike Fährmann
9cc4ec2c58
[deviantart] add 'png' option (#4846) 2024-02-14 01:03:15 +01:00
Mike Fährmann
139ff3f6ab
[kemonoparty] add 'posts' extractor (#5194) 2024-02-13 15:41:34 +01:00
Mike Fährmann
f7f8ef8684
[twitter] support communities (#4913) 2024-02-13 01:30:23 +01:00
Mike Fährmann
4641937ca3
[imagetwist] add 'gallery' extractor (#5190) 2024-02-11 18:41:02 +01:00
Mike Fährmann
fde82ab0ce
[imagechest] add 'user' extractor (#5143) 2024-02-11 18:38:33 +01:00
Mike Fährmann
c83d0a1596
[weibo] add 'gifs' option (#5183) 2024-02-10 18:17:07 +01:00
Mike Fährmann
af61d2b037
[wikimedia] combine most wikimedia.org sites (#1443)
add wikidata.org and wikivoyage.org
2024-02-10 03:00:58 +01:00
Mike Fährmann
cf7d6be2d4
[bluesky] initial support (#4438, #4708, #4722, #5047) 2024-02-07 19:09:33 +01:00
Mike Fährmann
34a4ddc399
[sankaku] add 'id-format' option (#5073) 2024-01-26 17:56:08 +01:00
Mike Fährmann
afd20ef42c
[kemonoparty] implement filtering duplicate revisions (#5013)
set 'revisions' to '"unique"' to have it ignore duplicate revisions
2024-01-26 14:44:15 +01:00
Mike Fährmann
beacfa7436
[bunkr] update domain to 'bunkr.sk' (#5114) 2024-01-25 23:45:41 +01:00
Mike Fährmann
f3ad91b44f
[bunkr] update domain (#5088) 2024-01-21 03:00:57 +01:00
Mike Fährmann
c7a42880ab
[wikimedia] support fandom wikis (#1443, #2677, #3378)
Wikis hosted on fandom.com are just wikimedia instances
and support its API.
2024-01-21 00:52:02 +01:00
Mike Fährmann
9ca6117c67
[hbrowse] remove module
website gone
2024-01-20 02:53:44 +01:00
Mike Fährmann
375eefb886
[chevereto] remove 'pixl.li'
"Pixl is closing down"
"All images will be deleted January 1st."
2024-01-20 02:21:40 +01:00
Mike Fährmann
b0a441f1e3
[nitter] remove 'nitter.lacontrevoie.fr'
"Fermeture de Nitter / Closing down Nitter"
2024-01-19 19:34:16 +01:00
Mike Fährmann
a1c1e80f67
[giantessbooru] update domain 2024-01-19 14:21:56 +01:00
Mike Fährmann
ea553a1d55
[wikimedia] generalize (#1443)
- support mediawiki.org
- support mariowiki.com (#3660)

- combine code into a single extractor
  (use prefix as subcategory)
- handle non-wiki instances
- unescape titles
2024-01-18 15:36:16 +01:00
Mike Fährmann
c3c1635ef3
[wikimedia] update
- rewrite using BaseExtractor
- support most Wiki* domains
- update docs/supportedsites
- add tests
2024-01-17 00:08:06 +01:00
hunter-gatherer8
6c4abc982e
[2ch] add 'thread' and 'board' extractors
- [2ch] add thread extractor
- [2ch] add board extractor
- [2ch] add new entry to supported sites
2024-01-15 03:51:03 +01:00
Mike Fährmann
355b909f46
merge #5041: [steamgriddb] add support (#5033) 2024-01-13 00:59:15 +01:00
Mike Fährmann
71e2c3e5a2
merge #5037: [hatenablog] add support (#5036) 2024-01-13 00:57:21 +01:00
blankie
8995fd5f01
[steamgriddb] implement suggestions 2024-01-13 09:55:39 +11:00
Mike Fährmann
39904c9e4e
[deviantart:avatar] add 'formats' option (#4995) 2024-01-10 17:13:34 +01:00
Mike Fährmann
5c43098a1a
[twitter] revert to using 'media' timeline by default (#4953)
This reverts commit a94f944148.
2024-01-09 23:19:39 +01:00
blankie
0c88373a21
[docs] add steamgriddb to supportedsites.md 2024-01-09 17:22:25 +11:00
blankie
2ccb7d3bd3
[steamgriddb] add support 2024-01-09 17:12:56 +11:00
blankie
61f3b2f820
[hatenablog] add support 2024-01-09 01:29:47 +11:00
Mike Fährmann
33f228756a
[mangadex] add 'list' extractor (#5025)
supports listing manga and chapters from list feed
2024-01-07 02:59:35 +01:00
Mike Fährmann
8e1a2b5446
[komikcast] update domain to 'komikcast.lol' (#5027) 2024-01-06 02:16:43 +01:00
Mike Fährmann
a441249ea2
merge #4979: [batoto] add 'chapter' and 'manga' extractors (#1434, #2111) 2024-01-06 01:53:26 +01:00
Mike Fährmann
b11c352d66
[bato] rename to 'batoto'
to use the same category name as the previous bato.to site
2024-01-06 01:49:34 +01:00
Mike Fährmann
3aa24c3744
[bato] simplify and update 2024-01-06 01:10:04 +01:00
Mike Fährmann
11150a7d72
[nudecollect] remove module 2024-01-05 21:32:04 +01:00
Mike Fährmann
e61f016465
[szurubooru] support 'snootbooru.com' (#5023) 2024-01-05 17:56:39 +01:00
Mike Fährmann
7eaf648f2e
[fanbox] add 'metadata' option (#4921)
extracts 'plan' and extended 'user' metadata
2024-01-04 15:01:33 +01:00
Mike Fährmann
4f3671458e
[deviantart] add 'avatar' and 'background' extractors (#4995) 2024-01-03 00:07:55 +01:00
Mike Fährmann
ee65f3de43
[docs] add parent>child example (#4621) 2024-01-02 15:03:04 +01:00
Mike Fährmann
27d5fc3697
[docs] document 'tls12' (#4543)
https://github.com/mikf/gallery-dl/issues/4760#issuecomment-1793345940
2024-01-01 16:12:43 +01:00
Mike Fährmann
fe2147b3ef
[docs] document 'write-pages' (#4543) 2024-01-01 16:12:28 +01:00
Antonio
e348da7a06 [poringa] add support 2023-12-27 00:07:23 -06:00
bug-assassin
74c225f94e [bato] add support 2023-12-26 22:33:33 -05:00
Mike Fährmann
77d46e6f0c
[lynxchan] update 'bbw-chan' domain (#4970) 2023-12-25 15:29:05 +01:00
Mike Fährmann
108c978073
merge #4919: [postmill] add support (#4917) 2023-12-23 15:23:56 +01:00
blankie
8a42ea736a
[postmill] implement suggestions 2023-12-23 13:28:36 +11:00
Mike Fährmann
01bb75f6cb
merge #4945: {shimmie2[ support 'rule34hentai.net' (#861, #4789) 2023-12-22 00:10:26 +01:00
Mike Fährmann
79e4606893
[rule34hentai] cleanup
- fix using 'self._posts_rule34hentai'
- fix 'file_url' for posts
- update docs/supportedsites
- add tests
2023-12-22 00:01:36 +01:00
Mike Fährmann
fbebc58189
[deviantart] add 'intermediary' option (#4955) 2023-12-21 02:23:22 +01:00
Mike Fährmann
92ff99c8e5
[twitter] remove 'syndication' option (#3889) 2023-12-20 14:38:36 +01:00
Mike Fährmann
a94f944148
[twitter] default to 'tweets' timeline when 'replies' are enabled (#4953) 2023-12-20 01:57:18 +01:00
Mike Fährmann
2852404e49
[inkbunny] add 'unread' extractor (#4934) 2023-12-15 21:20:12 +01:00
Mike Fährmann
d95be2537a
move files from gh-pages branch to master 2023-12-15 18:05:44 +01:00
Mike Fährmann
39fb96a845
[docs] reword NSFW warning 2023-12-15 17:51:21 +01:00