Mike Fährmann
aa6d00613f
[cien] initial support ( #2885 , #4103 , #5240 )
2024-07-28 19:27:12 +02:00
Mike Fährmann
c9aeedeafd
[koharu] add 'gallery' and 'search' extractors ( #5893 , #4707 )
2024-07-28 12:22:18 +02:00
Mike Fährmann
226ead728e
[agnph] add 'tag' and 'post' extractors ( #5284 , #5890 )
2024-07-27 12:17:47 +02:00
Mike Fährmann
8ecd408f53
add '-J/--resolve-json' command-line option ( #5864 )
2024-07-26 20:41:35 +02:00
Mike Fährmann
b5e141ed6e
[sankakucomplex] update domain to 'news.sankakucomplex.com'
2024-07-26 20:39:55 +02:00
Mike Fährmann
540eaa5add
[tumblr] implement 'pagination' option ( #5880 )
...
restore pagination behavior from before
de670bd7de
2024-07-23 20:31:04 +02:00
Mike Fährmann
156a70bec0
[aryion] update favorite extractor
...
- add test case
- add docs/supportedsites entry
- add custom directory_fmt and archive_fmt
- remove constructor
- appease flake8
2024-07-21 12:34:06 +02:00
Mike Fährmann
6940ad0e72
[booru] allow multiple 'url' keys ( #5859 )
2024-07-17 20:49:52 +02:00
Mike Fährmann
f7383a56f8
wrap filters/conditionals in a try-except block
...
allows accessing undefined fields without exception or locals().get(…)
but hides mistakes/typos/etc by evaluating to False without feedback
performance loss compared to the previous version without try-except
is negligible (~20ns for me)
2024-07-12 22:51:11 +02:00
Mike Fährmann
c83c812a1e
[instagram][twitter] rename 'profile' to 'info' ( #5262 , #3623 )
2024-07-11 00:22:39 +02:00
Mike Fährmann
8aca0e6970
update default User-Agent header to Firefox 128 ESR
2024-07-09 20:42:06 +02:00
Mike Fährmann
da9916c01f
[pp:metadata] implement format strings for 'directory' ( #5728 )
2024-07-06 03:08:59 +02:00
Mike Fährmann
f41a5065b2
[actions] support multiple actions per pattern
2024-06-30 02:36:33 +02:00
Mike Fährmann
84b3da54aa
[actions] add 'exec' action ( #5619 )
2024-06-29 23:02:48 +02:00
Mike Fährmann
c9860002ba
[actions] add 'abort' and 'terminate' actions ( #5778 )
2024-06-29 19:20:17 +02:00
Mike Fährmann
c2bf4ff99c
[twitter] add 'profile' extractor ( #3623 )
2024-06-28 22:55:48 +02:00
Mike Fährmann
44896b0296
[instagram] add 'profile' extractor ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2188915210
2024-06-28 22:54:07 +02:00
Mike Fährmann
ea81fa985f
[archive] implement 'archive-event' option ( #5784 )
...
With this, IDs of skipped files will no longer be written to an archive
by default. Use "archive-event": "file,skip" to restore the previous
behavior.
2024-06-27 22:00:59 +02:00
Mike Fährmann
8f50c04af2
[formatter] implement 'X' format specifier ( #5770 )
2024-06-21 20:56:19 +02:00
enduser420
c73375d8ba
[tcbscans] update docs/supportedsites
2024-06-21 21:38:15 +05:30
Mike Fährmann
f58b0e6fc7
[twitter] ignore 'Unavailable' media ( #5736 )
...
… including geo-restricted content.
add 'unavailable' option to allow re-enabling them again
2024-06-21 00:15:10 +02:00
Mike Fährmann
a1bb32792b
do not try to read from stdin when it is non-interactive ( #5733 )
...
add '--no-input' command-line option and 'input' config file option
to allow users to manually configure this
2024-06-16 18:31:39 +02:00
Mike Fährmann
76385f5f18
re-categorize some command-line options in --help
2024-06-15 23:29:09 +02:00
Mike Fährmann
4ffaa7fabf
[docs] update ytdl references
2024-06-15 21:45:06 +02:00
Mike Fährmann
942fc18008
[docs] update links to source files
2024-06-15 01:57:34 +02:00
Mike Fährmann
3fc2e61818
add '--config-open' and '--config-status' ( #5713 )
...
adapted from 119a25a59c
2024-06-13 23:22:56 +02:00
Mike Fährmann
c699ce8ebb
[twitter] add 'username-alt' option ( #5715 )
2024-06-13 00:54:43 +02:00
Mike Fährmann
c6fc0281e8
[newgrounds] extend 'format' option ( #5709 )
...
- check more extensions for original formats (mp4, webm, m4v, mov, mkv)
- allow specifying which extensions and recoded formats to check
2024-06-12 20:46:45 +02:00
Mike Fährmann
9abeab5ecf
[shimmie2] support 'vidya.pics' ( #5632 )
2024-06-06 15:08:56 +02:00
Mike Fährmann
162d4269ec
[twitter] extend 'ratelimit' option ( #5532 )
...
allow waiting for a set amount of seconds
2024-06-06 01:18:08 +02:00
Mike Fährmann
1ce5de0290
[formatter] implement 'C' format specifier ( #5647 )
...
to apply a conversion after ':' or
to apply multiple conversions
for example {tags:CSl} or {tags:J - /Cl}
to convert list to string and lowercase it
2024-06-05 16:49:29 +02:00
Mike Fährmann
9b99d2c886
[philomena] support downloading SVG files ( #5643 )
2024-06-05 16:48:51 +02:00
Mike Fährmann
8fce9ea6d5
[hentainexus] restore module ( #5275 )
...
revert 97641cd151
2024-06-05 16:48:25 +02:00
Mike Fährmann
cbaf041cea
[docs:options] add --update arguments
2024-06-02 18:16:25 +02:00
Mike Fährmann
035d882c6f
[docs:supportedsites] include base categories without instances
2024-06-02 18:16:24 +02:00
Mike Fährmann
4d11cd9ffb
[vichan] remove 'wikieat.club'
...
redirects to some non-vichan site
2024-06-02 18:16:24 +02:00
Mike Fährmann
31133b97fb
[nitter] remove instances
2024-06-02 18:15:53 +02:00
Mike Fährmann
ce228ee163
[photobucket] remove module
...
had been broken for years and the new site is payed access only
2024-06-02 01:40:31 +02:00
Mike Fährmann
a53db09ca0
[artstation] disable TLS 1.2 ciphers by default ( #5564 , #5658 )
2024-05-30 23:54:19 +02:00
Mike Fährmann
0761b22a7f
[hiperdex] update domain to 'hiperdex.top' ( #5635 )
2024-05-24 17:13:10 +02:00
Mike Fährmann
895e633c44
implement 'keywords-eval' option ( #5621 )
...
to allow evaluating 'keywords' values as format strings
2024-05-22 22:53:34 +02:00
Mike Fährmann
6276f5cd94
[twitter] update domain to x.com ( #5597 )
2024-05-17 22:59:52 +02:00
Mike Fährmann
d2f50ecf09
add 'skip-filter' option ( #5255 )
2024-05-10 22:59:52 +02:00
Mike Fährmann
fd734b9222
[archive] add 'archive-mode' option ( #5255 )
2024-05-10 22:59:51 +02:00
Mike Fährmann
bd8e4797e5
[vsco] add 'avatar' extractor ( #5341 )
2024-05-02 18:12:19 +02:00
Mike Fährmann
3cf5366143
[mastodon] add support for card images
2024-05-01 16:00:07 +02:00
Mike Fährmann
9b1995dda3
[mastodon] add 'favorite', 'list', and 'hashtag' extractors ( #5529 )
2024-05-01 15:59:34 +02:00
Mike Fährmann
bef0bd3b49
add '--no-colors' command-line option
2024-04-20 21:06:59 +02:00
Mike Fährmann
20e2c0042b
[output] enable colors by default
2024-04-20 20:51:20 +02:00
Mike Fährmann
14b38264e0
[output] extend 'output.colors' ( #2566 )
...
allow specifying ANSI colors for all loglevels
(debug, info, warning, error)
2024-04-20 20:50:58 +02:00
Mike Fährmann
566472f080
[common] add 'sleep-429' option ( #5160 )
2024-04-16 18:41:28 +02:00
Mike Fährmann
6dac43ad60
[docs] replace AnchorJS with custom script
...
use it in rendered .rst documents as well as in .md ones
2024-04-13 17:53:04 +02:00
Mike Fährmann
141a93c8fd
[docs] update docs/configuration links ( #5059 , #5369 , #5423 )
2024-04-13 02:18:44 +02:00
Mike Fährmann
85bbb59483
[twitter] implement 'relogin' option ( #5445 )
2024-04-12 23:01:22 +02:00
Mike Fährmann
e02d2ff45d
[tapas] add 'creator' extractor ( #5306 )
2024-04-11 23:41:50 +02:00
Mike Fährmann
35d4a706ae
[pixiv:novel] add 'covers' option ( #5373 )
2024-04-11 22:27:49 +02:00
Mike Fährmann
b57051719f
[wikimedia] support wiki.gg wikis
2024-04-09 19:24:01 +02:00
Mike Fährmann
cf36c576d0
[docs] document 'actions' ( #4543 )
...
or at least attempt to
2024-03-31 03:52:29 +02:00
Mike Fährmann
c7edeb871b
[docs] complete Authentication info in supportedsites.md
2024-03-29 02:11:04 +01:00
Mike Fährmann
a1e64bac73
[docs] update defaults of 'sleep-request', 'browser', 'tls12'
2024-03-29 02:04:11 +01:00
Mike Fährmann
9cce461627
[kemonoparty] add 'announcements' option ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2015919188
2024-03-26 15:20:14 +01:00
Mike Fährmann
31e7ca73b6
[gelbooru] add 'order-posts' option for favorites ( #5220 )
2024-03-23 13:30:09 +01:00
Mike Fährmann
e1c51c0dfb
[vipergirls] add 'domain' option ( #4166 )
2024-03-18 17:36:16 +01:00
Mike Fährmann
ae116812cc
[vipergirls] add 'like' option ( #4166 )
2024-03-18 17:36:16 +01:00
Mike Fährmann
5c1f5861b6
[flickr] add 'contexts' option ( #5324 )
2024-03-18 17:36:16 +01:00
Mike Fährmann
03a9ce9832
[kemonoparty] add 'order-revisions' option ( #5334 )
2024-03-15 23:06:05 +01:00
Mike Fährmann
e76d5756a0
merge #5329 : fix some typos
2024-03-14 15:20:54 +01:00
teslaedison
ab1fc470b7
chore: fix some typos
...
Signed-off-by: teslaedison <qingchengqiushuang@gmail.com>
2024-03-14 16:07:02 +08:00
Mike Fährmann
d53db6e11a
[twitter] handle "account is temporarily locked" errors ( #5300 )
...
- display proper error message
- add 'locked' option
2024-03-13 22:34:25 +01:00
Mike Fährmann
416f1b8cc1
[pages] customize layout to remove unnecessary links
...
- "docs" header
- "Improve this page"
https://github.com/pages-themes/primer/blob/master/_layouts/default.html
2024-03-11 23:28:20 +01:00
Mike Fährmann
052811b57f
[docs] fix another typo ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1980094380
This on was on the same line as the previous one ... (9fd851cd
2024-03-07 00:59:02 +01:00
Mike Fährmann
40c0553523
[twitter] add 'quotes' extractor ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1981571924
It's implemented as a search for 'quoted_tweet_id:…' on Twitter.
2024-03-07 00:52:50 +01:00
Mike Fährmann
6d9e3c0eb1
[skeb] add extractor for followed users ( #5290 )
...
needs 'Authorization' header from browser session
-o headers.Authorization="Bearer ey…"
2024-03-06 22:43:01 +01:00
Mike Fährmann
ace16f00f5
[weibo] fix retweets ( #2825 , #3874 , #5263 )
...
- handle 快转 retweets
- disable 'retweets' by default
- skip all retweet media when 'retweets' are disabled
- extract all retweet media when 'retweets' is set to "original"
2024-03-06 19:36:53 +01:00
Mike Fährmann
9fd851cda1
[docs] fix typo: rebot -> robot ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1979884897
2024-03-06 02:30:38 +01:00
Mike Fährmann
40af26f68b
[docs] link to documentation files in index.md
2024-03-03 22:50:09 +01:00
Mike Fährmann
1a9b9aa310
[artstation] support video clips ( #2566 , #3309 , #3911 )
...
- add 'videos' and 'previews' options
- fix 403 errors for video previews
2024-03-03 18:00:45 +01:00
Mike Fährmann
25d2854272
[deviantart] add 'comments-avatars' option ( #4995 )
2024-03-02 21:59:16 +01:00
Mike Fährmann
cf9e99c07b
[artstation] support collections ( #146 )
...
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1972101003
2024-03-01 20:21:21 +01:00
Mike Fährmann
32ec695195
merge #5256 : [wikimedia] add azurlane.koumakan.jp
2024-02-29 21:50:24 +01:00
Mike Fährmann
5d9ec91896
[azurlanewiki] supportedsites + test
2024-02-29 21:49:13 +01:00
Mike Fährmann
c006f9c949
[docs] add ability to specify more than one 'event'
...
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1969407203
2024-02-29 14:40:18 +01:00
Mike Fährmann
495c9ee126
[bluesky] add 'reposts' option ( #4438 , #5248 )
2024-02-27 18:42:29 +01:00
Mike Fährmann
cc6b9e4c18
[zerochan] use API by default ( #3669 )
...
add 'pagination' option
2024-02-25 00:36:14 +01:00
Mike Fährmann
741fd00cec
[deviantart] extend 'metadata' option ( #5175 )
...
alloe fetching extended metadata in addition to the usual
'description', 'tags', etc by setting 'metadata' to a list of
'camera', 'stats', 'submission', 'collection', and 'gallery'
for example "metadata": "stats,submission"
2024-02-18 23:14:14 +01:00
Mike Fährmann
ccb413df71
[wikimedia] support 'pidgi.net' and 'bulbapedia.bulbagarden.net' ( #5205 , #5206 )
2024-02-17 17:35:10 +01:00
Mike Fährmann
7033cc14e9
[vsco] add 'space' extractor ( #5202 )
2024-02-17 01:54:05 +01:00
Mike Fährmann
ee7c054855
[bluesky] add 'search' extractor ( #4438 )
...
Both https://bsky.app/search?q=QUERY and https://bsky.app/search/QUERY
are recognized as search URLs, where QUERY gets forwarded unmodified as
'q' parameter for app.bsky.feed.searchPosts .
User searches are not supported yet.
2024-02-16 15:58:47 +01:00
Mike Fährmann
91e5c4fdfe
[bluesky] add 'avatar' and 'background' extractors ( #4438 )
2024-02-16 15:41:19 +01:00
Mike Fährmann
0abd9723af
[bluesky] add 'metadata' option ( #4438 )
...
allow extracting 'user' metadata and
make 'facets' extraction optional
2024-02-15 23:30:16 +01:00
Mike Fährmann
7e036ea290
[bluesky] add 'depth' option ( #4438 )
...
and reduce default depth and parentHeight values
2024-02-15 22:26:05 +01:00
Mike Fährmann
c97b92cc35
[fanbox] add 'home' and 'supporting' extractors ( #5138 )
2024-02-14 23:25:39 +01:00
Mike Fährmann
04e4ffc64c
[deviantart] combine 'png' option with 'quality' ( #4846 )
...
"quality": "png" to download PNGs instead og JPEGs
2024-02-14 22:07:29 +01:00
Mike Fährmann
9cc4ec2c58
[deviantart] add 'png' option ( #4846 )
2024-02-14 01:03:15 +01:00
Mike Fährmann
139ff3f6ab
[kemonoparty] add 'posts' extractor ( #5194 )
2024-02-13 15:41:34 +01:00
Mike Fährmann
f7f8ef8684
[twitter] support communities ( #4913 )
2024-02-13 01:30:23 +01:00
Mike Fährmann
4641937ca3
[imagetwist] add 'gallery' extractor ( #5190 )
2024-02-11 18:41:02 +01:00
Mike Fährmann
fde82ab0ce
[imagechest] add 'user' extractor ( #5143 )
2024-02-11 18:38:33 +01:00
Mike Fährmann
c83d0a1596
[weibo] add 'gifs' option ( #5183 )
2024-02-10 18:17:07 +01:00
Mike Fährmann
af61d2b037
[wikimedia] combine most wikimedia.org sites ( #1443 )
...
add wikidata.org and wikivoyage.org
2024-02-10 03:00:58 +01:00
Mike Fährmann
cf7d6be2d4
[bluesky] initial support ( #4438 , #4708 , #4722 , #5047 )
2024-02-07 19:09:33 +01:00
Mike Fährmann
34a4ddc399
[sankaku] add 'id-format' option ( #5073 )
2024-01-26 17:56:08 +01:00
Mike Fährmann
afd20ef42c
[kemonoparty] implement filtering duplicate revisions ( #5013 )
...
set 'revisions' to '"unique"' to have it ignore duplicate revisions
2024-01-26 14:44:15 +01:00
Mike Fährmann
beacfa7436
[bunkr] update domain to 'bunkr.sk' ( #5114 )
2024-01-25 23:45:41 +01:00
Mike Fährmann
f3ad91b44f
[bunkr] update domain ( #5088 )
2024-01-21 03:00:57 +01:00
Mike Fährmann
c7a42880ab
[wikimedia] support fandom wikis ( #1443 , #2677 , #3378 )
...
Wikis hosted on fandom.com are just wikimedia instances
and support its API.
2024-01-21 00:52:02 +01:00
Mike Fährmann
9ca6117c67
[hbrowse] remove module
...
website gone
2024-01-20 02:53:44 +01:00
Mike Fährmann
375eefb886
[chevereto] remove 'pixl.li'
...
"Pixl is closing down"
"All images will be deleted January 1st."
2024-01-20 02:21:40 +01:00
Mike Fährmann
b0a441f1e3
[nitter] remove 'nitter.lacontrevoie.fr'
...
"Fermeture de Nitter / Closing down Nitter"
2024-01-19 19:34:16 +01:00
Mike Fährmann
a1c1e80f67
[giantessbooru] update domain
2024-01-19 14:21:56 +01:00
Mike Fährmann
ea553a1d55
[wikimedia] generalize ( #1443 )
...
- support mediawiki.org
- support mariowiki.com (#3660 )
- combine code into a single extractor
(use prefix as subcategory)
- handle non-wiki instances
- unescape titles
2024-01-18 15:36:16 +01:00
Mike Fährmann
c3c1635ef3
[wikimedia] update
...
- rewrite using BaseExtractor
- support most Wiki* domains
- update docs/supportedsites
- add tests
2024-01-17 00:08:06 +01:00
hunter-gatherer8
6c4abc982e
[2ch] add 'thread' and 'board' extractors
...
- [2ch] add thread extractor
- [2ch] add board extractor
- [2ch] add new entry to supported sites
2024-01-15 03:51:03 +01:00
Mike Fährmann
355b909f46
merge #5041 : [steamgriddb] add support ( #5033 )
2024-01-13 00:59:15 +01:00
Mike Fährmann
71e2c3e5a2
merge #5037 : [hatenablog] add support ( #5036 )
2024-01-13 00:57:21 +01:00
blankie
8995fd5f01
[steamgriddb] implement suggestions
2024-01-13 09:55:39 +11:00
Mike Fährmann
39904c9e4e
[deviantart:avatar] add 'formats' option ( #4995 )
2024-01-10 17:13:34 +01:00
Mike Fährmann
5c43098a1a
[twitter] revert to using 'media' timeline by default ( #4953 )
...
This reverts commit a94f944148
2024-01-09 23:19:39 +01:00
blankie
0c88373a21
[docs] add steamgriddb to supportedsites.md
2024-01-09 17:22:25 +11:00
blankie
2ccb7d3bd3
[steamgriddb] add support
2024-01-09 17:12:56 +11:00
blankie
61f3b2f820
[hatenablog] add support
2024-01-09 01:29:47 +11:00
Mike Fährmann
33f228756a
[mangadex] add 'list' extractor ( #5025 )
...
supports listing manga and chapters from list feed
2024-01-07 02:59:35 +01:00
Mike Fährmann
8e1a2b5446
[komikcast] update domain to 'komikcast.lol' ( #5027 )
2024-01-06 02:16:43 +01:00
Mike Fährmann
a441249ea2
merge #4979 : [batoto] add 'chapter' and 'manga' extractors ( #1434 , #2111 )
2024-01-06 01:53:26 +01:00
Mike Fährmann
b11c352d66
[bato] rename to 'batoto'
...
to use the same category name as the previous bato.to site
2024-01-06 01:49:34 +01:00
Mike Fährmann
3aa24c3744
[bato] simplify and update
2024-01-06 01:10:04 +01:00
Mike Fährmann
11150a7d72
[nudecollect] remove module
2024-01-05 21:32:04 +01:00
Mike Fährmann
e61f016465
[szurubooru] support 'snootbooru.com' ( #5023 )
2024-01-05 17:56:39 +01:00
Mike Fährmann
7eaf648f2e
[fanbox] add 'metadata' option ( #4921 )
...
extracts 'plan' and extended 'user' metadata
2024-01-04 15:01:33 +01:00
Mike Fährmann
4f3671458e
[deviantart] add 'avatar' and 'background' extractors ( #4995 )
2024-01-03 00:07:55 +01:00
Mike Fährmann
ee65f3de43
[docs] add parent>child example ( #4621 )
2024-01-02 15:03:04 +01:00
Mike Fährmann
27d5fc3697
[docs] document 'tls12' ( #4543 )
...
https://github.com/mikf/gallery-dl/issues/4760#issuecomment-1793345940
2024-01-01 16:12:43 +01:00
Mike Fährmann
fe2147b3ef
[docs] document 'write-pages' ( #4543 )
2024-01-01 16:12:28 +01:00
Antonio
e348da7a06
[poringa] add support
2023-12-27 00:07:23 -06:00
bug-assassin
74c225f94e
[bato] add support
2023-12-26 22:33:33 -05:00
Mike Fährmann
77d46e6f0c
[lynxchan] update 'bbw-chan' domain ( #4970 )
2023-12-25 15:29:05 +01:00
Mike Fährmann
108c978073
merge #4919 : [postmill] add support ( #4917 )
2023-12-23 15:23:56 +01:00
blankie
8a42ea736a
[postmill] implement suggestions
2023-12-23 13:28:36 +11:00
Mike Fährmann
01bb75f6cb
merge #4945 : {shimmie2[ support 'rule34hentai.net' ( #861 , #4789 )
2023-12-22 00:10:26 +01:00
Mike Fährmann
79e4606893
[rule34hentai] cleanup
...
- fix using 'self._posts_rule34hentai'
- fix 'file_url' for posts
- update docs/supportedsites
- add tests
2023-12-22 00:01:36 +01:00
Mike Fährmann
fbebc58189
[deviantart] add 'intermediary' option ( #4955 )
2023-12-21 02:23:22 +01:00
Mike Fährmann
92ff99c8e5
[twitter] remove 'syndication' option ( #3889 )
2023-12-20 14:38:36 +01:00
Mike Fährmann
a94f944148
[twitter] default to 'tweets' timeline when 'replies' are enabled ( #4953 )
2023-12-20 01:57:18 +01:00
Mike Fährmann
2852404e49
[inkbunny] add 'unread' extractor ( #4934 )
2023-12-15 21:20:12 +01:00
Mike Fährmann
d95be2537a
move files from gh-pages branch to master
2023-12-15 18:05:44 +01:00
Mike Fährmann
39fb96a845
[docs] reword NSFW warning
2023-12-15 17:51:21 +01:00
blankie
fbe14a2745
[postmill] add support
2023-12-12 21:36:52 +11:00
Mike Fährmann
d59d4ebff4
[tumblr] support infinite 'fallback-retries'
2023-12-11 23:40:13 +01:00
Mike Fährmann
75697dfb26
implement -e/--error-file as a logging handler
...
similar to --write-unsupported
2023-12-10 00:06:39 +01:00
Mike Fährmann
9a8dc6b02b
[exhentai] add 'fallback-retries' option ( #4792 )
2023-12-09 02:01:59 +01:00
