1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-26 04:32:51 +01:00
Commit Graph

4430 Commits

Author SHA1 Message Date
Mike Fährmann
2bb937014f
[twitter] fall back to legacy /media endpoint when not logged in 2023-03-17 20:54:35 +01:00
Mike Fährmann
b68094d326
[twitter] support 'note_tweet's 2023-03-17 19:36:07 +01:00
Mike Fährmann
3dcabc97ed
[twitter] update API endpoints and parameters 2023-03-17 19:25:53 +01:00
Mike Fährmann
a1ca2404f9
add 'globals' instead of overwriting the default (#3773) 2023-03-16 18:37:00 +01:00
Mike Fährmann
dcb8af659a
[gelbooru] extract favorites without needing cookies (#3704)
TODO: fix --range
2023-03-15 19:21:35 +01:00
Mike Fährmann
b756dc13aa
[gelbooru] warn about missing cookies for favorites (#3704)
and add docstring so it shows up in --list-extractors
2023-03-15 14:58:55 +01:00
Mike Fährmann
17bd053d94
[hiperdex] fix extraction (#3768) 2023-03-15 14:28:03 +01:00
Mike Fährmann
e7898936df
add link to 'Get cookies.txt LOCALLY' to README 2023-03-14 23:01:36 +01:00
Mike Fährmann
f7ce33c85c
[output] set 'errors=replace' for output streams (#3765)
fixes regression from e480a933
2023-03-14 13:30:04 +01:00
Mike Fährmann
a14a2d6e59
release version 1.25.0 2023-03-11 21:05:28 +01:00
Mike Fährmann
4235d412c4
implement 'actions'
continuation of d37e7f48
but more versatile and extendable

Example:

"actions": [
    # change debug messages to info
    ["debug", "level ~info"],

    # change exit status to a non-zero value
    ["info:^No results for", "status |= 1"],

    # exit with status 2 on 429
    ["warning:429", "exit 2"],

    # restart extractor when no cookies found
    ["warning:^[Nn]o .*cookies", "restart"]
]
2023-03-10 22:08:10 +01:00
Mike Fährmann
817fc0fbd1
[nitter] remove nitter.pussthecat.org
"Shutdown"
2023-03-09 23:48:39 +01:00
Mike Fährmann
67ec91cdbd
[downloader:http] change '_http_retry' to accept a Python function
and rename '_http_retry_codes' to '_http_retry'

(#3569)
2023-03-09 23:30:15 +01:00
Mike Fährmann
175822e065
merge #3738: [generic] add tests 2023-03-09 22:26:20 +01:00
Mike Fährmann
4883420e67
[generic] revert pattern change 2023-03-09 22:25:23 +01:00
Mike Fährmann
9037128315
[twitter] fix some 'original' retweets not downloading (#3744) 2023-03-08 18:33:19 +01:00
Mike Fährmann
ea3d95e7e8
merge #3740: [deviantart] add support for fxdeviantart.com URLs 2023-03-08 17:30:06 +01:00
Mike Fährmann
9abcb2b6e5
update headers and ciphers for '"browser": "chrome"' 2023-03-08 17:19:59 +01:00
ClosedPort22
c489aecb3e
[deviantart] add support for fxdeviantart.com URLs
fxdeviantart.com is a service that fixes embeds on Discord, similar to
fxtwitter.com
2023-03-07 16:04:17 +08:00
ClosedPort22
34a7fab0e2
[generic] add support for IDNs
(internationalized domain name)
2023-03-06 22:42:36 +08:00
Mike Fährmann
c9a7345228
[newgrounds] prevent archive ID overlap (#3681)
add an 'i' and 'a' prefix to image and audio files
(/art/view/, /audio/listen/)
since their numeric ID may conflict with movies and other media
2023-03-06 15:03:49 +01:00
Mike Fährmann
8148c2a097
[downloader:ytdl] prevent exception on empty results
a7c7953107 (commitcomment-92042240)
2023-03-06 12:25:12 +01:00
Mike Fährmann
da9840a39d
[reddit] update 'videos' option (#3712)
- add 'dash' to directly extract DASH manifest URLs
  (was default behavior since a7c79531)
- change default strategy back to before a7c79531
- disable 'Falling back on generic information extractor' warning
2023-03-06 12:18:25 +01:00
Mike Fährmann
143e82258f
add .editorconfig 2023-03-05 20:09:28 +01:00
Mike Fährmann
8f8b4de0e8
[ytdl] fix '--parse-metadata' (#3663) 2023-03-05 19:57:23 +01:00
Mike Fährmann
11df3a021d
[formatter] enclose f-strings with """ instead of ''' 2023-03-03 20:03:27 +01:00
Mike Fährmann
baf41d7437
[misskey] update (#3717)
- add module docstring
- add options to docs/gallery-dl.conf
2023-03-03 15:52:50 +01:00
Mike Fährmann
7610d9cf82
merge #3675: [pixiv] fix --write-tags for '"tags": "original"' 2023-03-02 21:48:31 +01:00
Mike Fährmann
6762d99515
merge #3717: [misskey] add misskey extractors 2023-03-02 19:31:41 +01:00
Mike Fährmann
b8a702929d
[oauth] import extractor modules on demand 2023-03-02 18:39:54 +01:00
Mike Fährmann
dd88740ec7
replace remaining instances of base64 with binascii 2023-03-02 18:25:47 +01:00
Mike Fährmann
83e7a25b6b
extend OAuth tests 2023-03-02 17:26:51 +01:00
enduser420
e1867cf5eb [misskey] add 'renotes' and 'replies' options 2023-03-02 19:56:19 +05:30
enduser420
a95b5e0d8e [misskey] add misskey extractors 2023-03-02 19:49:47 +05:30
Mike Fährmann
0d142e403c
[szurubooru] add 'tag' and 'post' extractors (#3583, #3713) 2023-03-01 18:47:10 +01:00
Mike Fährmann
075c965512
add '--config-create' command-line option
(#2333)
2023-03-01 14:49:40 +01:00
Mike Fährmann
26d06e0bb2
move executable check into util.py 2023-02-28 23:10:23 +01:00
Mike Fährmann
de2f35d068
simplify config.load() 2023-02-28 22:02:15 +01:00
Mike Fährmann
632d5d7745
allow loading config files in TOML format with --config-toml 2023-02-28 21:54:46 +01:00
Mike Fährmann
9e870eb930
rename --ignore-config to --config-ignore
--ignore-config still works as before,
but is no longer shown by --help
2023-02-28 21:07:42 +01:00
Mike Fährmann
d66257f2c8
improve option.Formatter performance
as always, only a very marginal difference,
but it still uses less resources than before
2023-02-28 20:57:28 +01:00
Mike Fährmann
d788e6c60c
implement 'globals' option 2023-02-28 18:18:55 +01:00
Mike Fährmann
b14f8d5817
[gelbooru] add 'favorite' extractor (#3704)
requires logged in cookies to work
2023-02-27 18:03:47 +01:00
Mike Fährmann
e480a93337
add 'output.stdout', '.stdin', and '.stderr' options
(#1621, #2152, #2529)

Allow setting custom input/output encodings and options
without having to rely on Python's defaults.
2023-02-26 14:56:19 +01:00
Mike Fährmann
a70a3e5da6
[mangasee] extract 'author' and 'genre' metadata (#3703)
Both are lists/arrays. Use {author!S} or {genre:J, } to format them.
2023-02-26 14:12:19 +01:00
Mike Fährmann
6b03506655
[deviantart] allow searching when not logged in 2023-02-25 19:04:18 +01:00
Mike Fährmann
511a051705
[fanbox] fix crash with missing images (#3673) 2023-02-23 23:30:55 +01:00
Mike Fährmann
3fa456d989
[deviantart] remove mature scraps warning (#3691)
warn about private deviations
when paginating over eclipse results
2023-02-23 22:56:37 +01:00
Mike Fährmann
51301e0c31
replace remaining time.sleep() calls
with Extractor.sleep() or request_interval
2023-02-23 00:35:37 +01:00
Mike Fährmann
6ed4309aba
[deviantart] add 'gallery-search' extractor (#1695) 2023-02-22 17:25:31 +01:00