Mirrors/gallery-dl
1
0
Fork 0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-22 18:53:21 +01:00
Code Issues Releases Wiki Activity
5,648 Commits 6 Branches 164 Tags 15 MiB
c83c812a1e
Commit Graph

642 Commits

Author SHA1 Message Date
Mike Fährmann
c83d0a1596
[weibo] add 'gifs' option (#5183) 2024-02-10 18:17:07 +01:00
Mike Fährmann
cf7d6be2d4
[bluesky] initial support (#4438, #4708, #4722, #5047) 2024-02-07 19:09:33 +01:00
Mike Fährmann
34a4ddc399
[sankaku] add 'id-format' option (#5073) 2024-01-26 17:56:08 +01:00
Mike Fährmann
afd20ef42c
[kemonoparty] implement filtering duplicate revisions (#5013) 
set 'revisions' to '"unique"' to have it ignore duplicate revisions
 2024-01-26 14:44:15 +01:00
Mike Fährmann
355b909f46
merge #5041: [steamgriddb] add support (#5033) 2024-01-13 00:59:15 +01:00
blankie
8995fd5f01
[steamgriddb] implement suggestions 2024-01-13 09:55:39 +11:00
Mike Fährmann
39904c9e4e
[deviantart:avatar] add 'formats' option (#4995) 2024-01-10 17:13:34 +01:00
Mike Fährmann
5c43098a1a
[twitter] revert to using 'media' timeline by default (#4953) 
This reverts commit a94f944148.
 2024-01-09 23:19:39 +01:00
blankie
2ccb7d3bd3
[steamgriddb] add support 2024-01-09 17:12:56 +11:00
Mike Fährmann
7eaf648f2e
[fanbox] add 'metadata' option (#4921) 
extracts 'plan' and extended 'user' metadata
 2024-01-04 15:01:33 +01:00
Mike Fährmann
4f3671458e
[deviantart] add 'avatar' and 'background' extractors (#4995) 2024-01-03 00:07:55 +01:00
Mike Fährmann
27d5fc3697
[docs] document 'tls12' (#4543) 
https://github.com/mikf/gallery-dl/issues/4760#issuecomment-1793345940
 2024-01-01 16:12:43 +01:00
Mike Fährmann
fe2147b3ef
[docs] document 'write-pages' (#4543) 2024-01-01 16:12:28 +01:00
Mike Fährmann
108c978073
merge #4919: [postmill] add support (#4917) 2023-12-23 15:23:56 +01:00
blankie
8a42ea736a
[postmill] implement suggestions 2023-12-23 13:28:36 +11:00
Mike Fährmann
fbebc58189
[deviantart] add 'intermediary' option (#4955) 2023-12-21 02:23:22 +01:00
Mike Fährmann
92ff99c8e5
[twitter] remove 'syndication' option (#3889) 2023-12-20 14:38:36 +01:00
Mike Fährmann
a94f944148
[twitter] default to 'tweets' timeline when 'replies' are enabled (#4953) 2023-12-20 01:57:18 +01:00
blankie
fbe14a2745
[postmill] add support 2023-12-12 21:36:52 +11:00
Mike Fährmann
d59d4ebff4
[tumblr] support infinite 'fallback-retries' 2023-12-11 23:40:13 +01:00
Mike Fährmann
75697dfb26
implement -e/--error-file as a logging handler 
similar to --write-unsupported
 2023-12-10 00:06:39 +01:00
Mike Fährmann
9a8dc6b02b
[exhentai] add 'fallback-retries' option (#4792) 2023-12-09 02:01:59 +01:00
Mike Fährmann
042a9da451
add 'output.errorfile' config option 2023-12-08 17:29:54 +01:00
Mike Fährmann
9dd5cb8c8a
interactively prompt for passwords on login when none is provided 2023-12-06 22:12:59 +01:00
Mike Fährmann
4e15513415
[docs] fix 'Example' -> 'Default' from b43be672 
copy-paste mistake
 2023-11-22 22:14:30 +01:00
Mike Fährmann
b43be67206
[exhentai] add 'gp' option (#4576) 2023-11-22 20:15:00 +01:00
Mike Fährmann
cb9a1176e6
[pixeldrain] add 'api-key' option (#4839) 2023-11-22 19:13:51 +01:00
Mike Fährmann
aea15f6d17
add 'metadata-extractor' option (#4549) 2023-11-20 22:16:15 +01:00
Mike Fährmann
34a387b6e2
support 'metadata-*' names for '*-metadata' options 
For example, instead of 'url-metadata' it is now also possible to use
'metadata-url' as option name.

- metadata-url
- metadata-path
- metadata-http
- metadata-version
- metadata-parent
 2023-11-18 23:52:10 +01:00
Mike Fährmann
07cb584231
[behance] add 'modules' option (#4799) 2023-11-17 22:54:38 +01:00
Mike Fährmann
7a0f145cbe
[twitter] ignore promoted Tweets (#4790, #3894) 
add 'ads' option in case someone actually wants to
download promoted content for whatever reason
 2023-11-10 23:46:46 +01:00
Mike Fährmann
f4e61fd1d5
reword 'reddit.client-id' instructions (#4749) 2023-11-04 00:52:18 +01:00
Mike Fährmann
007c433677
[patreon] support 'id:<campaign_id>' in place of a user name 
https://patreon.com/id:12345
… and remove 'campaign-id' config option
 2023-11-04 00:17:41 +01:00
Mike Fährmann
12a800ce21
[patreon] improve 'campaign_id' handling (#4699, #4715) 
- add ways to directly specify a 'campaign_id'
  - 'campaign-id' config option
  - 'c' or 'campaign_id' URL query parameter
- more descriptive error messages
- show 'campaign_id' value in debug log
 2023-10-25 17:18:06 +02:00
Mike Fährmann
0d52b775cb
[kemonoparty] add 'revisions' option (#4498, #4597) 2023-10-20 15:20:49 +02:00
Mike Fährmann
2d41702762
[deviantart] implement '"group": "skip"' (#4630) 2023-10-12 22:14:20 +02:00
Mike Fährmann
992e86ec94
[deviantart] disable 'jwt' (#4652) 2023-10-12 21:37:10 +02:00
Mike Fährmann
2974b8e3c8
[moebooru] add 'metadata' option (#4646) 
for extended 'pool' metadata
 2023-10-12 21:34:25 +02:00
Mike Fährmann
0c5d8b1505
[deviantart] re-add 'quality' option and 'intermediary' transform 2023-09-24 17:36:05 +02:00
Mike Fährmann
20d1683c47
[deviantart] fix JWT replacement (#293, #4548, #4563) 
And again, a huge thank you to @Ironchest337
for discovering this.
 2023-09-24 15:06:16 +02:00
Mike Fährmann
82296b1f05
[reddit] add 'previews' option (#4322) 
another way to disable this new behavior
 2023-09-22 18:10:44 +02:00
Mike Fährmann
9d8317d963
[deviantart] disable JWT updates (#4548, #4563) 
back to lowres images ...
 2023-09-22 17:13:05 +02:00
Mike Fährmann
3ecb512722
send Referer headers by default 2023-09-19 00:02:04 +02:00
Mike Fährmann
6178177227
[twitter] fix '_extractor' of following results (#4536) 
regression from 20ed647f
 2023-09-15 23:04:30 +02:00
Mike Fährmann
f2de70f254
[gfycat] remove module 2023-09-04 18:27:11 +02:00
Mike Fährmann
ceb59e176f
fix default Firefox user agent string 
note to self: do not trust some random third-party website
 2023-09-02 22:22:23 +02:00
Mike Fährmann
5ed245317d
[exhentai] add 'fav' option (#4409) 
The name 'favorite' is already taken as extractor subcategory
 2023-08-23 23:58:11 +02:00
Mike Fährmann
410f783a33
implement 'subconfigs' option (#4440) 2023-08-21 21:18:40 +02:00
Mike Fährmann
c1c73c0b0e
[pp:ugoira] add '"framerate": "uniform"' (#4421) 2023-08-21 19:43:47 +02:00
Mike Fährmann
70bdf32a88
[pp:ugoira] extend 'ffmpeg-output' (#4421) 
- when setting this option to a string value,
  pass -hide-banner and -loglevel to FFmpeg
- change default to "error"
 2023-08-21 18:19:53 +02:00
Mike Fährmann
84089c7368
[docs] add note about 'path-restrict' implementation 
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1671892152
 2023-08-11 18:00:11 +02:00
Mike Fährmann
f9fb276e81
[postprocessor] add 'prepare-after' event (#4083) 2023-08-10 21:28:48 +02:00
Mike Fährmann
0ef1fcab20
[postprocessor] update 'finalize' events 
Add 'finalize-error' and 'finalize-success' events that trigger
depending on whether error(s) did or did not happen.

'finalize' itself now always triggers regardless of error status.
(was supposed to have the same behavior as the new 'finalize-success')
 2023-08-10 19:46:37 +02:00
Mike Fährmann
9d67655397
add "ascii+" as a special 'path-restrict' value (#4371) 2023-08-01 19:33:53 +02:00
Mike Fährmann
1ece3b92ff
[mangadex] allow multiple values for 'lang' (#4093) 
This was already possible by setting 'lang' to a list of strings,
but now it can also be done as a more command-line friendly string.

-o lang=fr,it
 2023-07-26 17:39:27 +02:00
Mike Fährmann
c6d70c7483
[docs] fix typo (#4350) 2023-07-26 14:24:19 +02:00
Mike Fährmann
7cd5130e88
[docs] small fixes/updates 2023-07-24 14:27:37 +02:00
Mike Fährmann
54d974deb0
add 'python' post processor 
similar to 'exec' but calls a Python function
 2023-07-24 14:06:14 +02:00
Mike Fährmann
ceebacc9e1
remove 'pyopenssl' option 2023-07-19 20:44:07 +02:00
Mike Fährmann
90231f2d5a
[twitter] add 'tweet-endpoint' option (#4307) 
use the newer TweetResultByRestId only for guests by default
 2023-07-18 17:19:32 +02:00
Mike Fährmann
20ed647f6f
[twitter] add 'user' extractor and 'include' option (#4275) 2023-07-18 16:42:55 +02:00
Mike Fährmann
86be197d11
[twitter] remove '/search/adaptive.json' 2023-07-18 15:45:37 +02:00
Mike Fährmann
fc43c74694
[docs] update reddit client-id instructions (#4292) 
add clearing cached access tokens and getting a new refresh token
 2023-07-13 20:43:36 +02:00
Mike Fährmann
7444fc125b
[gfycat] implement login support (#3770, #4271) 
For the record: '/webtoken' and '/weblogin' are not the same ...
 2023-07-06 18:56:34 +02:00
Mike Fährmann
5b59a0d143
update default User-Agent header to Firefox 115 ESR 2023-07-05 15:12:50 +02:00
Mike Fährmann
1bf9f52c99
[twitter] add 'ratelimit' option (#4251) 2023-07-04 18:17:32 +02:00
Mike Fährmann
f86fdf64a6
[twitter] use GraphQL search by default (#4264) 2023-07-04 17:55:22 +02:00
Mike Fährmann
6ae3101fd0
[mangapark] add 'source' option (#3969) 2023-07-02 15:07:22 +02:00
Mike Fährmann
c45a913bfd
[flickr] add 'exif' option 2023-07-01 19:19:39 +02:00
Mike Fährmann
ccbc1a1d55
[flickr] add 'metadata' option (#4227) 2023-06-26 16:49:48 +02:00
Mike Fährmann
c1cce4a80b
[twitter] extend 'conversations' option (#4211) 2023-06-24 21:34:34 +02:00
Mike Fährmann
f50b81d3e9
[docs] add novel-related keys to 'pixiv.include' (#4111) 2023-06-19 15:01:53 +02:00
Mike Fährmann
deff3b434d
[vipergirls] implement login support (#4166) 2023-06-13 21:05:09 +02:00
Mike Fährmann
54cf1fa3e7
[twitter] use GraphQL search endpoint (#3942) 
for guest users; selectable with 'search-endpoint' option.

adapted from 9c7b888ffa
 2023-06-01 21:37:31 +02:00
Mike Fährmann
0cf7282fa0
[pixiv] add 'full-series' option for novels (#4111) 2023-06-01 13:07:20 +02:00
Mike Fährmann
28f6487c64
[instagram] add 'metadata' option (#3107) 2023-05-27 15:51:13 +02:00
Mike Fährmann
f3cca50b9e
[mangadex] update links to API docs 2023-05-24 12:32:13 +02:00
Mike Fährmann
65a9f4b124
merge #3950: [misskey] add 'favorite' extractor 2023-05-23 22:18:32 +02:00
Mike Fährmann
c76f0f3a1b
[misskey] update 
- rename to 'MisskeyFavoriteExtractor'
- add 'access-token' option to docs
- add test URLs for other instances
- simplify 'pattern'
 2023-05-23 22:17:17 +02:00
Mike Fährmann
3fca455b82
[pixiv] add 'embeds' option (#1241) 2023-05-23 12:14:06 +02:00
Mike Fährmann
e6f55d1555
[imagechest] add API support and 'access-token' option (#4065) 2023-05-20 17:00:27 +02:00
Mike Fährmann
77abcf5ab3
[gofile] automatically fetch 'website-token' by default 
the hardcoded token changed yet again
 2023-05-20 17:00:27 +02:00
Mike Fährmann
a83983c651
[instagram] add 'order-posts' option (#4017, #3993) 2023-05-18 22:50:12 +02:00
Mike Fährmann
d680623db3
[instagram] add 'order-files' option (#4017, #3993) 2023-05-18 22:34:33 +02:00
Mike Fährmann
5037013e2b
[gofile] update 'website-token' (#4056) 2023-05-15 14:59:44 +02:00
Mike Fährmann
a14b63d941
support selecting a domain for '--cookies-from-browser' 
for example 'gallery-dl --cookies-from-browser firefox/twitter.com'
 2023-05-06 15:09:49 +02:00
Mike Fährmann
3ca5dac8b6
extend 'cookies-update' functionality 
Allow writing cookies to a different file than a given cookies.txt,
making it possible to export cookies imported with --cookies-from-browser

To convert browser cookies to cookies.txt format:
  gallery-dl --cookies-fr chromium \
             -o cookies-update=cookies.txt \
             --no-download \
             http://example.org/file.jpg
 2023-05-04 15:10:47 +02:00
Mike Fährmann
79f47f98dd
[nana] remove module 
permanently gone since 2023-03-13
 2023-05-03 18:05:53 +02:00
Mike Fährmann
c182094ebf
merge #3748: [downloader:http] add 'consume-content' option 2023-04-26 23:03:18 +02:00
Mike Fährmann
b81ce381f0
fix backticks for 'extractor.redgifs.format' docs 
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1518331927
 2023-04-21 23:12:01 +02:00
Mike Fährmann
aaf58a1259
[imgur] document 'client-id' option (#3937) 2023-04-21 15:08:50 +02:00
Mike Fährmann
0a7eee3ee0
[deviantart] add 'public' option 2023-04-08 23:04:34 +02:00
Mike Fährmann
75666cf9c3
[danbooru] reduce API requests for fetching extended 'metadata' 
Instead of using one additional API request per post object (N+1),
this requires only one request per 200-post batch.
 2023-04-02 20:11:52 +02:00
Mike Fährmann
00f0233b28
[postprocessor:metadata] add 'skip' option (#3786) 2023-03-17 23:30:11 +01:00
Mike Fährmann
a1ca2404f9
add 'globals' instead of overwriting the default (#3773) 2023-03-16 18:37:00 +01:00
ClosedPort22
fcaeaf539c
[downloader:http] handle exceptions while consuming content 2023-03-11 21:36:37 +08:00
ClosedPort22
df77271438
[downloader:http] add 'consume-content' option 
* fix connection not being released when the response is neither
  successful nor retried
* add the ability to consume the HTTP response body instead of closing
  the connection

reference:

https://docs.python-requests.org/en/latest/user/advanced/#body-content-workflow
 2023-03-09 21:07:10 +08:00
Mike Fährmann
da9840a39d
[reddit] update 'videos' option (#3712) 
- add 'dash' to directly extract DASH manifest URLs
  (was default behavior since a7c79531)
- change default strategy back to before a7c79531
- disable 'Falling back on generic information extractor' warning
 2023-03-06 12:18:25 +01:00
enduser420
e1867cf5eb [misskey] add 'renotes' and 'replies' options 2023-03-02 19:56:19 +05:30
Mike Fährmann
0d142e403c
[szurubooru] add 'tag' and 'post' extractors (#3583, #3713) 2023-03-01 18:47:10 +01:00