Mike Fährmann
2bb937014f
[twitter] fall back to legacy /media endpoint when not logged in
2023-03-17 20:54:35 +01:00
Mike Fährmann
b68094d326
[twitter] support 'note_tweet's
2023-03-17 19:36:07 +01:00
Mike Fährmann
3dcabc97ed
[twitter] update API endpoints and parameters
2023-03-17 19:25:53 +01:00
Mike Fährmann
a1ca2404f9
add 'globals' instead of overwriting the default ( #3773 )
2023-03-16 18:37:00 +01:00
Mike Fährmann
dcb8af659a
[gelbooru] extract favorites without needing cookies ( #3704 )
...
TODO: fix --range
2023-03-15 19:21:35 +01:00
Mike Fährmann
b756dc13aa
[gelbooru] warn about missing cookies for favorites ( #3704 )
...
and add docstring so it shows up in --list-extractors
2023-03-15 14:58:55 +01:00
Mike Fährmann
17bd053d94
[hiperdex] fix extraction ( #3768 )
2023-03-15 14:28:03 +01:00
Mike Fährmann
e7898936df
add link to 'Get cookies.txt LOCALLY' to README
2023-03-14 23:01:36 +01:00
Mike Fährmann
f7ce33c85c
[output] set 'errors=replace' for output streams ( #3765 )
...
fixes regression from e480a933
2023-03-14 13:30:04 +01:00
Mike Fährmann
a14a2d6e59
release version 1.25.0
2023-03-11 21:05:28 +01:00
Mike Fährmann
4235d412c4
implement 'actions'
...
continuation of d37e7f48
but more versatile and extendable
Example:
"actions": [
# change debug messages to info
["debug", "level ~info"],
# change exit status to a non-zero value
["info:^No results for", "status |= 1"],
# exit with status 2 on 429
["warning:429", "exit 2"],
# restart extractor when no cookies found
["warning:^[Nn]o .*cookies", "restart"]
]
2023-03-10 22:08:10 +01:00
Mike Fährmann
817fc0fbd1
[nitter] remove nitter.pussthecat.org
...
"Shutdown"
2023-03-09 23:48:39 +01:00
Mike Fährmann
67ec91cdbd
[downloader:http] change '_http_retry' to accept a Python function
...
and rename '_http_retry_codes' to '_http_retry'
(#3569 )
2023-03-09 23:30:15 +01:00
Mike Fährmann
175822e065
merge #3738 : [generic] add tests
2023-03-09 22:26:20 +01:00
Mike Fährmann
4883420e67
[generic] revert pattern change
2023-03-09 22:25:23 +01:00
Mike Fährmann
9037128315
[twitter] fix some 'original' retweets not downloading ( #3744 )
2023-03-08 18:33:19 +01:00
Mike Fährmann
ea3d95e7e8
merge #3740 : [deviantart] add support for fxdeviantart.com URLs
2023-03-08 17:30:06 +01:00
Mike Fährmann
9abcb2b6e5
update headers and ciphers for '"browser": "chrome"'
2023-03-08 17:19:59 +01:00
ClosedPort22
c489aecb3e
[deviantart] add support for fxdeviantart.com URLs
...
fxdeviantart.com is a service that fixes embeds on Discord, similar to
fxtwitter.com
2023-03-07 16:04:17 +08:00
ClosedPort22
34a7fab0e2
[generic] add support for IDNs
...
(internationalized domain name)
2023-03-06 22:42:36 +08:00
Mike Fährmann
c9a7345228
[newgrounds] prevent archive ID overlap ( #3681 )
...
add an 'i' and 'a' prefix to image and audio files
(/art/view/, /audio/listen/)
since their numeric ID may conflict with movies and other media
2023-03-06 15:03:49 +01:00
Mike Fährmann
8148c2a097
[downloader:ytdl] prevent exception on empty results
...
a7c7953107 (commitcomment-92042240)
2023-03-06 12:25:12 +01:00
Mike Fährmann
da9840a39d
[reddit] update 'videos' option ( #3712 )
...
- add 'dash' to directly extract DASH manifest URLs
(was default behavior since a7c79531
)
- change default strategy back to before a7c79531
- disable 'Falling back on generic information extractor' warning
2023-03-06 12:18:25 +01:00
Mike Fährmann
143e82258f
add .editorconfig
2023-03-05 20:09:28 +01:00
Mike Fährmann
8f8b4de0e8
[ytdl] fix '--parse-metadata' ( #3663 )
2023-03-05 19:57:23 +01:00
Mike Fährmann
11df3a021d
[formatter] enclose f-strings with """ instead of '''
2023-03-03 20:03:27 +01:00
Mike Fährmann
baf41d7437
[misskey] update ( #3717 )
...
- add module docstring
- add options to docs/gallery-dl.conf
2023-03-03 15:52:50 +01:00
Mike Fährmann
7610d9cf82
merge #3675 : [pixiv] fix --write-tags for '"tags": "original"'
2023-03-02 21:48:31 +01:00
Mike Fährmann
6762d99515
merge #3717 : [misskey] add misskey extractors
2023-03-02 19:31:41 +01:00
Mike Fährmann
b8a702929d
[oauth] import extractor modules on demand
2023-03-02 18:39:54 +01:00
Mike Fährmann
dd88740ec7
replace remaining instances of base64 with binascii
2023-03-02 18:25:47 +01:00
Mike Fährmann
83e7a25b6b
extend OAuth tests
2023-03-02 17:26:51 +01:00
enduser420
e1867cf5eb
[misskey] add 'renotes' and 'replies' options
2023-03-02 19:56:19 +05:30
enduser420
a95b5e0d8e
[misskey] add misskey extractors
2023-03-02 19:49:47 +05:30
Mike Fährmann
0d142e403c
[szurubooru] add 'tag' and 'post' extractors ( #3583 , #3713 )
2023-03-01 18:47:10 +01:00
Mike Fährmann
075c965512
add '--config-create' command-line option
...
(#2333 )
2023-03-01 14:49:40 +01:00
Mike Fährmann
26d06e0bb2
move executable check into util.py
2023-02-28 23:10:23 +01:00
Mike Fährmann
de2f35d068
simplify config.load()
2023-02-28 22:02:15 +01:00
Mike Fährmann
632d5d7745
allow loading config files in TOML format with --config-toml
2023-02-28 21:54:46 +01:00
Mike Fährmann
9e870eb930
rename --ignore-config to --config-ignore
...
--ignore-config still works as before,
but is no longer shown by --help
2023-02-28 21:07:42 +01:00
Mike Fährmann
d66257f2c8
improve option.Formatter performance
...
as always, only a very marginal difference,
but it still uses less resources than before
2023-02-28 20:57:28 +01:00
Mike Fährmann
d788e6c60c
implement 'globals' option
2023-02-28 18:18:55 +01:00
Mike Fährmann
b14f8d5817
[gelbooru] add 'favorite' extractor ( #3704 )
...
requires logged in cookies to work
2023-02-27 18:03:47 +01:00
Mike Fährmann
e480a93337
add 'output.stdout', '.stdin', and '.stderr' options
...
(#1621 , #2152 , #2529 )
Allow setting custom input/output encodings and options
without having to rely on Python's defaults.
2023-02-26 14:56:19 +01:00
Mike Fährmann
a70a3e5da6
[mangasee] extract 'author' and 'genre' metadata ( #3703 )
...
Both are lists/arrays. Use {author!S} or {genre:J, } to format them.
2023-02-26 14:12:19 +01:00
Mike Fährmann
6b03506655
[deviantart] allow searching when not logged in
2023-02-25 19:04:18 +01:00
Mike Fährmann
511a051705
[fanbox] fix crash with missing images ( #3673 )
2023-02-23 23:30:55 +01:00
Mike Fährmann
3fa456d989
[deviantart] remove mature scraps warning ( #3691 )
...
warn about private deviations
when paginating over eclipse results
2023-02-23 22:56:37 +01:00
Mike Fährmann
51301e0c31
replace remaining time.sleep() calls
...
with Extractor.sleep() or request_interval
2023-02-23 00:35:37 +01:00
Mike Fährmann
6ed4309aba
[deviantart] add 'gallery-search' extractor ( #1695 )
2023-02-22 17:25:31 +01:00