1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-25 20:22:36 +01:00
Commit Graph

5856 Commits

Author SHA1 Message Date
Mike Fährmann
009aa90c3f
[tests] update extractor results
at least some of them
2024-06-01 20:28:04 +02:00
Mike Fährmann
6cfbc1071f
workaround for requests 2.32.3 (#5665)
manually call 'load_default_certs()' for SSLContexts
in custom HTTPAdapter instances
2024-06-01 16:02:18 +02:00
Mike Fährmann
330162f774
limit requests to '<2.32' for Docker and executables (#5665)
at least for the time being until requests fixed all
HTTPAdapter / SSLContext bugs
2024-06-01 15:57:25 +02:00
Mike Fährmann
807e2f7094
[realbooru] fix videos and provide fallback URLs (#2530)
revert acc94ac187.
2024-05-31 23:58:40 +02:00
Mike Fährmann
deacbcbfdf
[tbscans] remove excess whitespace in 'manga' 2024-05-31 22:32:59 +02:00
Mike Fährmann
00440b8fb1
[slideshare] fix extraction 2024-05-31 21:05:50 +02:00
Mike Fährmann
281ab33f87
[4archive] fix extraction 2024-05-31 17:42:53 +02:00
Mike Fährmann
a53db09ca0
[artstation] disable TLS 1.2 ciphers by default (#5564, #5658) 2024-05-30 23:54:19 +02:00
Mike Fährmann
7ba2b209f1
fix exit status of --clear-cache/--list-modules/--list-extractors
All three would always cause gallery-dl to exit with status 1,
regardless of error or success.
2024-05-29 02:56:25 +02:00
Mike Fährmann
3d033a48ea
[workflows:executables] change dev/linux binary name to …_linux
This reverts commit 05f8435e09.
2024-05-29 02:46:29 +02:00
Mike Fährmann
e35317118a
[workflows:executables] set bash as default shell for all runners
should fix environment variables on Windows
2024-05-28 22:20:13 +02:00
Mike Fährmann
05f8435e09
[workflows:executables] restore 'gallery-dl_ubuntu' name 2024-05-28 22:20:13 +02:00
Mike Fährmann
53aadb0c44
[update] implement '--update-to'
to switch between update channels (stable or dev (alias nightly & master))
or to install a specific version

Examples:
--update-to dev
--update-to dev@2024.05.25
--update-to v1.25.2
2024-05-28 20:40:03 +02:00
Mike Fährmann
5018bd42f8
[update] implement '--update-check'
to check if a new update is available without downloading it
2024-05-28 03:42:58 +02:00
Mike Fährmann
2e323ef0a2
[update] implement '-U/--update'
to auto-update executable files in-place
2024-05-28 02:26:13 +02:00
Mike Fährmann
601f5becc8
[version] add __variant__
Specifies origin and OS of executable files.
For example 'stable/windows'.
2024-05-27 21:37:01 +02:00
Mike Fährmann
020050ea8b
merge #5641: [pixeldrain] add support for single file album download 2024-05-25 23:43:43 +02:00
Mike Fährmann
154a890399
[pixeldrain] integrate into 'album' extractor 2024-05-25 23:42:23 +02:00
HornyQT
24e70b956b [pixeldrain] add support for single file album download 2024-05-25 16:06:50 +02:00
Mike Fährmann
0761b22a7f
[hiperdex] update domain to 'hiperdex.top' (#5635) 2024-05-24 17:13:10 +02:00
Mike Fährmann
f6d2786daa
[docs] update link to "nightly" builds (#5618) 2024-05-24 03:46:49 +02:00
Mike Fährmann
a6e0258020
[workflows:executables] include commit link in release notes 2024-05-24 02:05:27 +02:00
Mike Fährmann
ea434963ae
[subscribestar] fix file URLs (#5631) 2024-05-23 19:12:01 +02:00
Mike Fährmann
6198dfa424
[seiga] re-implement login with username & password 2024-05-23 18:52:53 +02:00
Mike Fährmann
329da4db5e
[newgrounds] update and fix login procedure (#5109) 2024-05-23 17:06:22 +02:00
Mike Fährmann
895e633c44
implement 'keywords-eval' option (#5621)
to allow evaluating 'keywords' values as format strings
2024-05-22 22:53:34 +02:00
Mike Fährmann
bc25636e63
[patreon] fix bootstrap data extraction (#5624)
again
2024-05-22 00:17:49 +02:00
Mike Fährmann
141efc2ad3
[twitter] transfer 'twitter.com' cookies to 'x.com' (#5597) 2024-05-21 23:46:42 +02:00
Jan Wikholm
ece3837408
Enable user_has_liked as IG download filter
Background and context:

1. Instagram by default requires you to be logged in.
2. Your account can LIKE posts.
3. Getting all of your likes from IG can be a pain.

As an active IG user, I want to be able to download only posts I've liked.

The information of whether or not your logged-in user has liked the target post is available in the API results, but was not available to the end-user for filtering.

This small change allows `user_has_liked` to be used to e.g. download only liked posts of an entire IG account.

Example use:

```
$ gallery-dl --cookies-from-browser FIREFOX--filter 'user_has_liked' https://www.instagram.com/imgur/
```

This will only download the posts that have `has_liked: True` set in the returned REST API data.

Note: it will still need to loop through the entire account's posts since this is done per-post basis instead of looping just the liked posts, but at least you are able to use this IG feature as a download marker.
2024-05-18 12:05:08 +03:00
Mike Fährmann
6276f5cd94
[twitter] update domain to x.com (#5597) 2024-05-17 22:59:52 +02:00
Mike Fährmann
bfcb66af05
[poipiku] send LANG cookie to ensure English UI (#5590) 2024-05-17 22:59:31 +02:00
Mike Fährmann
f651b3b6ab
merge #5601: [twitter] match '/video/' Tweet URLs 2024-05-17 22:49:12 +02:00
Mike Fährmann
2dec4bef60
merge #5591: [poipoku] avoid language-specific extraction 2024-05-17 22:47:51 +02:00
Mike Fährmann
7f1ed909d5
[imgur] match gallery/album/image URLs with title slugs (#5593) 2024-05-17 22:44:37 +02:00
Delphox
8ba73e2ec9
[twitter] match /video/ tweet urls 2024-05-17 16:50:51 -03:00
fireattack
831f922c1c [poipoku] avoid language-specific extr 2024-05-14 02:42:02 +08:00
Mike Fährmann
07d962d60a
[workflows:tests] remove Python 3.5
currently causing errors in the setup phase:

  Error: Could not find a version that satisfies the requirement pip
  Error: No matching distribution found for pip
  Error: The process '/usr/bin/bash' failed with exit code 1
2024-05-12 16:52:38 +02:00
Mike Fährmann
33b07c4603
[twitter] wait for rate limit reset before 429 error (#5532) 2024-05-12 01:13:30 +02:00
Mike Fährmann
3b6f306a8b
[exhentai] fix blank page detection 2024-05-11 22:01:34 +02:00
Mike Fährmann
90b3741643
[cookies] set proper 'expires' value for Chrome session cookies
https://github.com/yt-dlp/yt-dlp/pull/9747
2024-05-11 19:46:35 +02:00
Mike Fährmann
f178839fc2
[exhentai] fix multi-page viewer detection (#4969) 2024-05-11 18:32:52 +02:00
Mike Fährmann
5b6b5dd81b
[8chan] fix downloaded files by sending 'TOS' cookie (#5578) 2024-05-11 15:34:21 +02:00
Mike Fährmann
d2f50ecf09
add 'skip-filter' option (#5255) 2024-05-10 22:59:52 +02:00
Mike Fährmann
fd734b9222
[archive] add 'archive-mode' option (#5255) 2024-05-10 22:59:51 +02:00
Mike Fährmann
28039229fe
[common] use 'create_urllib3_context' for creating SSLContexts
enables dumping TLS session keys by setting SSLKEYLOGFILE (#5215)
as well as other potentially useful settings.
2024-05-10 22:59:29 +02:00
Mike Fährmann
33006fe126
[common] disable 'check_hostname' for non-urllib3 SSLContexts
e.g. when 'browser' is set to a non-empty value and gallery-dl creates
its own SSLContext instance instead of using requests' and urllib3's
defaults.

urllib3 disables this option for its default contexts,
since it does this check on its own.

Fixes "ValueError: Cannot set verify_mode to CERT_NONE when
check_hostname is enabled" when using --no-check-certificate.

(#3614, #4891, #5576)
2024-05-10 18:20:08 +02:00
Mike Fährmann
215abbc3e4
[archive] implement DownloadArchiveMemory class (#5255)
keeps archive IDs in memory
and only writes them to disk in a 'finalize' step
2024-05-10 01:15:44 +02:00
Mike Fährmann
88f94190f4
[archive] move DownloadArchive into its own module 2024-05-10 01:05:28 +02:00
Mike Fährmann
2ee9ffeed6
merge #5568: [furaffinity] match 'xfuraffinity' URLs 2024-05-09 19:20:12 +02:00
Mike Fährmann
b27ffd790a
[poipiku] fix downloading R-18 posts (#5567)
… by automatically sending a `POIPIKU_CONTENTS_VIEW_MODE=1` cookie
to enable "adult" mode.
2024-05-09 15:14:08 +02:00