Mike Fährmann
107c60c973
[sankaku] update URL pattern ( #3523 )
...
match tag searches with language codes without a trailing slash
2023-01-18 21:38:01 +01:00
enduser420
5cb263fdd2
[wikifeet/wikifeetx] add 'gallery' extractor
2023-01-16 21:08:45 +05:30
Mike Fährmann
35a30498bc
merge #3531 : [kemonoparty] improve hash extraction
...
- extract md5 hashes if available
- extract discord file hashes
2023-01-16 15:15:32 +01:00
Mike Fährmann
ec9ff7640d
merge #3535 : [downloader:http] add signature checks for .blend, .obj, and .clip files
2023-01-16 15:09:10 +01:00
Mike Fährmann
9683d79bb7
[twitter] "fix" search pagination ( #3536 , #3534 )
...
- properly process instructions
- do not expect a predetermined instruction order
2023-01-16 14:58:30 +01:00
Mike Fährmann
4e86aaa4db
document 'extractor.headers' and 'extractor.ciphers'
2023-01-16 14:49:56 +01:00
Mike Fährmann
4fec848858
[twitter] use "browser": "firefox" by default ( #3522 )
...
and reenable TLS 1.2 ciphers
2023-01-15 22:11:04 +01:00
Mike Fährmann
78937564fd
[twitter] fix login after 32b03433
2023-01-15 22:10:21 +01:00
ClosedPort22
b6706b373a
[downloader:http] add signature checks for some formats
...
also add the MIME type for .obj files
2023-01-15 23:40:55 +08:00
ClosedPort22
20d6194ffa
[kemonoparty] improve hash extraction
...
- extract MD5 hash from URLs
- extract MD5 and SHA256 hash from Discord URLs (kemono.party only)
- minor optimization (do not call 'hashes.add' when 'duplicates' is
true)
- update tests accordingly
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2023-01-15 12:01:13 +08:00
Mike Fährmann
80a2ff2d38
support setting 'write-pages' to "ALL"
...
to show authentication header, cookies, etc
2023-01-14 22:34:46 +01:00
Mike Fährmann
d6793b2c7d
include request body in 'write-pages=all' output
2023-01-14 22:33:59 +01:00
Mike Fährmann
c881548a27
add 'extractor.retry-codes' option ( #3313 )
...
do not retry 429 and 430 by default
2023-01-14 17:25:30 +01:00
Mike Fährmann
e30e8aeef7
[mastodon] rename '_check_move' -> '_check_moved'
2023-01-14 14:46:24 +01:00
Mike Fährmann
32b0343334
[twitter] refresh guest tokens ( #3445 , #3458 )
2023-01-13 22:19:25 +01:00
Mike Fährmann
512abeb4ae
[booru] add 'url' option
2023-01-13 16:32:32 +01:00
Mike Fährmann
c87bd1a752
[danbooru] extend 'metadata' option
...
make it possible to specify a custom list of metadata includes
2023-01-13 16:20:01 +01:00
Mike Fährmann
26c3292538
[twitter] disable TLS 1.2 ciphers by default ( #3522 )
2023-01-13 16:05:43 +01:00
Mike Fährmann
18fe4b334d
[twitter] remove 'tweet_search_mode' from search parameters ( #3522 )
...
and update API root and general query parameters
2023-01-13 15:50:46 +01:00
Mike Fährmann
ec04c97075
release version 1.24.4
2023-01-11 16:19:57 +01:00
Mike Fährmann
c0d7d2be35
[downloader:http] add 'validate' option
2023-01-11 15:37:40 +01:00
Mike Fährmann
85bd1cbc89
[kemonoparty] fix regression from 473bd380 ( #3519 )
...
- do not access 'response.content' unless necessary
- only validate responses if filename extensions differ
2023-01-11 15:25:01 +01:00
Mike Fährmann
805a5663ec
release version 1.24.3
2023-01-10 21:31:58 +01:00
Mike Fährmann
473bd380c8
[kemonoparty] reject invalid/empty files ( #3510 )
2023-01-10 19:04:47 +01:00
Mike Fährmann
4833ec323e
[imagefap] add 'folder' extractor ( #3504 )
2023-01-08 16:57:31 +01:00
Mike Fährmann
cb9d100bac
update Authentication support in docs
...
https://github.com/mikf/gallery-dl/pull/3075#issuecomment-1374723412
2023-01-08 16:57:31 +01:00
Mike Fährmann
71d3143c35
fix bug in test_extractors.py
...
pattern matching tests would succeed
if there is exactly one match
but for the wrong extractor
2023-01-08 15:35:05 +01:00
Mike Fährmann
362cd6991b
[pixiv] implement 'metadata-bookmark' option ( #3417 )
2023-01-07 23:19:43 +01:00
Mike Fährmann
0895e6afee
merge #3462 : [docs] Update links and fix field typo
2023-01-07 15:22:03 +01:00
Mike Fährmann
4b9bb632f2
[docs] update links
2023-01-07 15:21:40 +01:00
Mike Fährmann
2142b9c7ae
merge #3503 : [myhentaigallery] handle whitespace before title tag
2023-01-07 15:15:11 +01:00
Mike Fährmann
3a0450adbf
[behance] use default delay between requests ( #2507 )
2023-01-07 14:49:26 +01:00
Mike Fährmann
2cae4567ba
[telegraph] fix file URLs ( #3506 )
2023-01-07 14:35:06 +01:00
Mike Fährmann
cbaeee9533
[imagefap] warn about redirects to '/human-verification' ( #1140 )
2023-01-07 13:04:42 +01:00
Mike Fährmann
435de1329a
[imagefap] use default delay between requests ( #1140 )
2023-01-07 12:59:09 +01:00
Erik Rimskog
a8a982359e
[myhentaigallery] handle whitespace before the title tag
2023-01-06 16:33:04 +01:00
Mike Fährmann
d1dd52349a
merge #3189 : [tcbscans] add 'chapter' and 'manga' extractors
2023-01-06 13:42:27 +01:00
Mike Fährmann
ac78712618
merge #3496 : [docs] update OAuth guide in README.rst
2023-01-06 13:36:23 +01:00
Mike Fährmann
2f31d21509
merge #3455 : [twitter] apply tweet type checks before uniqueness check
2023-01-06 13:32:50 +01:00
Mike Fährmann
64435cc37e
[twitter] update docs
2023-01-06 13:32:08 +01:00
Mike Fährmann
b125fcafc5
update docs/configuration.rst
...
- document metadata.indent
- add concrete mappings to object types
- fix lists for code examples
- fix typos
2023-01-06 13:07:33 +01:00
enduser420
e8541a131d
[tcbscans] add 'chapter' and 'manga' extractors
2023-01-06 16:16:31 +05:30
Mike Fährmann
3c03928d75
simplify 'docs/options.md' generation
...
use the plain text output from '--help'
instead of trying to generate 'fancy' HTML with Markdown restrictions
2023-01-06 11:21:47 +01:00
Mike Fährmann
9695c4e88d
emit debug logging message when loading cookies from file
...
attempt nr. 2
no idea how I managed to remove 6514828da918ce29
2023-01-06 11:13:44 +01:00
ClosedPort22
c94692f39b
[docs] document 'access-token' for Mastodon instances
2023-01-06 13:20:41 +08:00
Mike Fährmann
30a31836e7
merge #3449 : [twitter] force HTTPS for TwitPic URLs
2023-01-05 14:57:03 +01:00
Mike Fährmann
e18482e9ae
[twitter] improve 'http' -> 'https' replacement
2023-01-05 14:55:55 +01:00
Mike Fährmann
4fd6da474f
merge #3473 : [twitter] fix crash when using 'expand' and 'syndication'
2023-01-05 14:19:47 +01:00
Mike Fährmann
818f6fa71f
merge #3453 : [twitter] document #1396 and #2712
2023-01-05 14:18:21 +01:00
Mike Fährmann
a918ce29b5
run tests on ubuntu-20.04
...
and remove Python 3.4, since that's no longer available
on this test runner
2023-01-05 13:33:27 +01:00
