nifnat
7f34f99a26
Reverse engineered obfuscated JS function and reimplemented in python.
2023-01-27 21:30:06 +00:00
Mike Fährmann
e60ec1699a
only rewrite utility files if contents changed
2023-01-27 18:04:13 +01:00
Mike Fährmann
0d818d3540
[fantia] send 'X-CSRF-Token' headers ( #3576 )
2023-01-27 16:18:57 +01:00
Mike Fährmann
f58215705a
add '-O/--postprocessor-option' command-line option ( #3565 )
2023-01-26 14:59:24 +01:00
enduser420
2a5903dc16
[nudecollect] add 'image' and 'album' extractors
2023-01-26 17:25:33 +05:30
Mike Fährmann
c8fdd5096e
merge #3571 : [bunkr] Fix extracting mkv and ts files
2023-01-26 12:05:59 +01:00
Mike Fährmann
58c008e30a
[hiperdex] update domain ( #3572 )
2023-01-26 12:01:16 +01:00
Luc Ritchie
842064e597
[bunkr] Fix extracting ts files
2023-01-25 15:24:14 -05:00
Luc Ritchie
99ca0437e4
[bunkr] Fix extracting mkv files
2023-01-25 14:36:13 -05:00
Mike Fährmann
a050fe0d94
replace relative with absolute URLs for PyPI listing
2023-01-25 12:32:40 +01:00
Mike Fährmann
c37f6dac29
remove link to 'Get cookies.txt' from README
...
latest version sends tracking information
https://github.com/ytdl-org/youtube-dl/issues/31465
2023-01-25 11:16:17 +01:00
Mike Fährmann
76b01b64cf
[kemonoparty] remove MD5 hash extraction ( #3531 )
...
This partially reverts commit 20d6194ffa
2023-01-25 11:10:09 +01:00
Mike Fährmann
09fb212414
[philomena] match URLs with www subdomain
2023-01-24 22:43:24 +01:00
Mike Fährmann
7e2fd2e573
merge #3560 : [deviantart] add support for /deviation/ and fav.me URLs
2023-01-23 14:16:18 +01:00
Mike Fährmann
caae8fefe1
merge #3541 : [deviantart] add extractor for status updates
2023-01-23 13:54:51 +01:00
ClosedPort22
c90b4ea8d9
[deviantart] add support for fav.me URLs
2023-01-23 20:35:03 +08:00
Mike Fährmann
d63af4f3d3
merge #3555 : [generic] fix regex for non-src image URLs
2023-01-23 13:18:23 +01:00
Mike Fährmann
8993b10751
[mastodon] add 'num' and 'count' metadata fields ( #3517 )
2023-01-23 13:10:11 +01:00
Mike Fährmann
d817d23ccb
[instagram] update csrf token handling
...
- update internal value according to cookie
- do not send a second 'csrftoken' cookie
2023-01-23 13:01:35 +01:00
Mike Fährmann
00b94946b3
[instagram] show -o cursor=… after every error ( #3440 )
2023-01-23 13:00:44 +01:00
ClosedPort22
674c719646
[deviantart] refactor base36 conversion
2023-01-23 17:59:55 +08:00
ClosedPort22
293abb8921
[deviantart] add support for /deviation/ URLs
2023-01-23 17:37:57 +08:00
thatfuckingbird
8cfeed78b1
[generic] fix regex for non-src image URLs
2023-01-21 22:32:42 +01:00
Mike Fährmann
fc6ea8ee5c
[instagram] update API domain and headers
2023-01-21 17:30:39 +01:00
ClosedPort22
597b89245e
[deviantart] misc improvements to status extractor
...
- relax regex pattern
- handle invalid 'items' field
- add a test for shared sta.sh item
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2023-01-21 13:04:27 +08:00
Mike Fährmann
137de090dd
merge #3549 : [twitter] fix search ( #3536 )
2023-01-20 14:46:30 +01:00
Mike Fährmann
02e314c1b6
merge #3537 : [wikifeet/wikifeetx] add 'gallery' extractor
2023-01-20 14:44:25 +01:00
Mike Fährmann
568112dfbb
[oauth] improve output
...
- show which api key / client id gets used (#3518 )
- show in which browser authorization URLs gets opened in
2023-01-20 12:33:26 +01:00
ClosedPort22
ab58c375b4
[twitter] fix search ( #3536 )
...
- partially revert 18fe4b334d
2023-01-20 14:12:25 +08:00
Mike Fährmann
df91ebb945
[oauth] simplify OAuth 1.0a init
2023-01-19 18:34:54 +01:00
ClosedPort22
013733c9e9
[deviantart] fix index fields for embedded/shared images
2023-01-19 12:17:27 +08:00
ClosedPort22
c4aeca7a5a
[deviantart] improve handling of statuses
...
- recursively yield statuses
- ignore items with missing or unexpected field(s)
2023-01-19 11:48:21 +08:00
ClosedPort22
3b32671fbd
[deviantart] add extractor for status updates
...
extract user status updates using the '/user/statuses/' endpoint
2023-01-19 11:30:48 +08:00
Mike Fährmann
107c60c973
[sankaku] update URL pattern ( #3523 )
...
match tag searches with language codes without a trailing slash
2023-01-18 21:38:01 +01:00
enduser420
5cb263fdd2
[wikifeet/wikifeetx] add 'gallery' extractor
2023-01-16 21:08:45 +05:30
Mike Fährmann
35a30498bc
merge #3531 : [kemonoparty] improve hash extraction
...
- extract md5 hashes if available
- extract discord file hashes
2023-01-16 15:15:32 +01:00
Mike Fährmann
ec9ff7640d
merge #3535 : [downloader:http] add signature checks for .blend, .obj, and .clip files
2023-01-16 15:09:10 +01:00
Mike Fährmann
9683d79bb7
[twitter] "fix" search pagination ( #3536 , #3534 )
...
- properly process instructions
- do not expect a predetermined instruction order
2023-01-16 14:58:30 +01:00
Mike Fährmann
4e86aaa4db
document 'extractor.headers' and 'extractor.ciphers'
2023-01-16 14:49:56 +01:00
Mike Fährmann
4fec848858
[twitter] use "browser": "firefox" by default ( #3522 )
...
and reenable TLS 1.2 ciphers
2023-01-15 22:11:04 +01:00
Mike Fährmann
78937564fd
[twitter] fix login after 32b03433
2023-01-15 22:10:21 +01:00
ClosedPort22
b6706b373a
[downloader:http] add signature checks for some formats
...
also add the MIME type for .obj files
2023-01-15 23:40:55 +08:00
ClosedPort22
20d6194ffa
[kemonoparty] improve hash extraction
...
- extract MD5 hash from URLs
- extract MD5 and SHA256 hash from Discord URLs (kemono.party only)
- minor optimization (do not call 'hashes.add' when 'duplicates' is
true)
- update tests accordingly
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2023-01-15 12:01:13 +08:00
Mike Fährmann
80a2ff2d38
support setting 'write-pages' to "ALL"
...
to show authentication header, cookies, etc
2023-01-14 22:34:46 +01:00
Mike Fährmann
d6793b2c7d
include request body in 'write-pages=all' output
2023-01-14 22:33:59 +01:00
Mike Fährmann
c881548a27
add 'extractor.retry-codes' option ( #3313 )
...
do not retry 429 and 430 by default
2023-01-14 17:25:30 +01:00
Mike Fährmann
e30e8aeef7
[mastodon] rename '_check_move' -> '_check_moved'
2023-01-14 14:46:24 +01:00
Mike Fährmann
32b0343334
[twitter] refresh guest tokens ( #3445 , #3458 )
2023-01-13 22:19:25 +01:00
Mike Fährmann
512abeb4ae
[booru] add 'url' option
2023-01-13 16:32:32 +01:00
Mike Fährmann
c87bd1a752
[danbooru] extend 'metadata' option
...
make it possible to specify a custom list of metadata includes
2023-01-13 16:20:01 +01:00
