1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-25 20:22:36 +01:00
Commit Graph

3654 Commits

Author SHA1 Message Date
Mike Fährmann
232ab626a7
[downloader:ytdl] prevent crash in '_progress_hook()'
https://github.com/mikf/gallery-dl/discussions/1964#discussioncomment-1516702
2021-10-21 22:57:04 +02:00
Mike Fährmann
bcbf9bcf36
[kemonoparty] split 'discord' extractor (#1940)
in 'server' and 'channel'
2021-10-18 04:04:58 +02:00
Mike Fährmann
db857b40d8
[kemonoparty] improve inline extraction (#1899) 2021-10-17 21:47:11 +02:00
Mike Fährmann
975e0a4fe0
[furaffinity] unquote search queries (#1958)
instead of unescape
(unquote -> url params, unescape -> html entities)
2021-10-17 20:48:08 +02:00
Mike Fährmann
8d676151b7
[patreon] implement 'files' option (#1935) 2021-10-17 04:17:10 +02:00
Mike Fährmann
6695ef2e10
[patreon] better filenames for 'content' images (#1954) 2021-10-16 23:21:14 +02:00
Mike Fährmann
80314e981b
small corrections to gallery-dl-example.conf
use "'_reddit' in locals()"
instead of ""locals().get('_reddit')"
since the reddit metadata dict could be empty. The latter expression
would evaluate to False in that case, even though it has a reddit parent.
2021-10-16 20:50:39 +02:00
Mike Fährmann
3ecf4a9729
update gallery-dl-example.conf
- add comments
- remove/replace some older options
- display more post processor settings
2021-10-16 17:35:56 +02:00
Mike Fährmann
70005e3275
[kemonoparty:discord] support downloading from a specific channel
https://kemono.party/discord/server/<server-id>#<channel-name>>
2021-10-15 18:50:08 +02:00
Mike Fährmann
003f25931d
[kemonoparty:discord] provide a 'channel_name' 2021-10-15 18:37:08 +02:00
Mike Fährmann
28bdd58e6d
[nhentai] simplify 2021-10-14 16:45:53 +02:00
Mike Fährmann
50098762e3
[nhentai] add 'tag' extractor (closes #1950) 2021-10-14 16:23:47 +02:00
Mike Fährmann
fe6ce5495a
[kemonoparty] add 'discord' extractor (#1827, #1940) 2021-10-13 20:33:05 +02:00
Mike Fährmann
f2d6b3e6b4
run tests without using 'nose'
run_tests.sh -> run_tests.py
2021-10-13 04:07:41 +02:00
Mike Fährmann
918fc9974d
[picarto] add 'gallery' extractor (closes #1931) 2021-10-13 01:22:10 +02:00
Mike Fährmann
e33125ad39
[pixiv] add 'sketch' extractor (#1497) 2021-10-13 00:02:11 +02:00
Mike Fährmann
e9dc6ff262
[inkbunny] add 'following' extractor (#515) 2021-10-11 21:10:20 +02:00
Mike Fährmann
9c8fc6e7b4
[inkbunny] match "long" URLs for pools and favorites (#1937) 2021-10-11 17:24:22 +02:00
Mike Fährmann
f33c2ef73b
[cyberdrop] extract direct download URLs (#1943)
do not rely on redirects from f.cyberdrop.cc
2021-10-10 23:05:29 +02:00
Mike Fährmann
b93915c113
[inkbunny] add 'pool' extractor (#1937) 2021-10-09 22:07:07 +02:00
Mike Fährmann
373d3e1c57
[seisoparty] implement login with username & password (#1906) 2021-10-08 22:44:31 +02:00
Mike Fährmann
7c5f62b453
[seisoparty] add 'favorite' extractor (#1906) 2021-10-08 22:26:34 +02:00
Mike Fährmann
d93b5474c3
[mangadex] update parameter handling for API requests
- move common parameters into '_pagination()'
- add 'ratings' (#1908) and 'api-parameters' options
2021-10-05 19:46:48 +02:00
Mike Fährmann
cd66c3c415
[twitter] add 'size' option (#1881) 2021-10-05 19:14:54 +02:00
Mike Fährmann
df8050b81d
[postprocessor:compare] add 'equal' option (#1592)
Move functionality from cdd72e14 to its own option,
where it can be used with any 'action'
2021-10-05 03:03:37 +02:00
Mike Fährmann
f8410203ef
release version 1.19.0 2021-10-01 22:02:07 +02:00
Mike Fährmann
cdd72e1413
[postprocessor:compare] extend 'action' option (#1592)
allow setting it to "abort", "terminate", or "exit" as with 'skip'
2021-10-01 20:18:36 +02:00
Mike Fährmann
fb98b3fdaf
[redgifs][gfycat] remove webtoken code (fixes #1907) 2021-10-01 17:08:33 +02:00
Mike Fährmann
96215c926e
[mangadex] fix retrieving chapters from 'pornographic' titles
(fixes #1908)
2021-10-01 16:48:53 +02:00
Mike Fährmann
da9685609c
[kemonoparty] update file download URLs
(closes #1902, fixes #1903)
2021-09-30 23:02:46 +02:00
Mike Fährmann
783eae6fc5
[hiperdex] fix extraction 2021-09-30 00:32:34 +02:00
Mike Fährmann
12fc646c53
fix filename formatting tests 2021-09-29 23:39:02 +02:00
Mike Fährmann
2977f1a6b9
re-enable py2exe in setup.py
had to patch the native 'certifi' hook to

def hook_certifi(finder, module):
    import certifi
    finder.add_datafile_to_zip("certifi/cacert.pem", certifi.where())

to make everything work
2021-09-29 18:41:11 +02:00
Mike Fährmann
28f1c36da2
simplify and adjust download progress indicator (#1519) 2021-09-29 18:40:36 +02:00
Mike Fährmann
e0bdacd932
[fappic] add 'image' extractor (closes #1898) 2021-09-28 23:35:29 +02:00
Mike Fährmann
c22ff97743
remove 'unit' argument from 'util.format_value()' 2021-09-28 23:07:55 +02:00
Mike Fährmann
8c29a6e491
add example for 'url-metadata' option (closes #1884) 2021-09-28 22:59:37 +02:00
Mike Fährmann
d0761454b1
implement a download progress indicator (#1519) 2021-09-28 22:48:58 +02:00
Mike Fährmann
cad85640de
move 'util.PathFormat' into its own 'path' module
to prevent circular imports between 'formatter' and 'util'
2021-09-27 21:29:37 +02:00
Mike Fährmann
0038a8c1a4
implement a way to specify 'extended' format strings
Starting a format string with '\f<Type> ' allows to set a different
format string type than the default. Available ones are

- T: A template file containing the actual format string
     "\fT ~/.templates/booru.txt

- E: An arbitrary Python expression
     "\fE title.upper().replace(' ', '-')"

- M: Name of a Python module followed by a function name inside it.
     This function gets called with the current metadata dict as
     argument and should return a string.
     "\fM my_module:generate_text"

'\f' was chosen since it is highly unlikely that a regular format string
would start with it, but that character could be changed to for example
'\\' or '/' etc.
2021-09-27 19:46:14 +02:00
Mike Fährmann
76c7d3f977
add FUNDING.yml (#1877) 2021-09-27 19:21:39 +02:00
Mike Fährmann
74145467dd
move 'util.Formatter' into its own 'formatter' module 2021-09-27 02:37:04 +02:00
Mike Fährmann
9377543162
[mastodon] add 'following' extractor (#1891) 2021-09-26 00:12:34 +02:00
Mike Fährmann
2c2932973c
[mastodon] support specifying accounts by ID
Same as a3b473bd for Twitter

Instead of just
https://instance.tld/@user

it is now also possible to refer to that account with
https://instance.tld/users/user
https://instance.tld/@id:12345
https://instance.tld/users/id:12345
2021-09-25 20:28:16 +02:00
Mike Fährmann
94143eb86c
[twitter] add 'quote_by' metadata field (#1481)
Only present for tweets quoted by another tweet.
Represents the tweet_id of said tweet quoting this one.
2021-09-25 18:15:14 +02:00
Mike Fährmann
1cc73e11aa
add '--write-infojson' command-line option 2021-09-23 18:02:20 +02:00
Mike Fährmann
a23f5d45d7
[deviantart] fix bug with fetching premium content (#1879)
When a user has both 'watchers' and 'paid' folders and one of them is
inaccessible, the other one could get handled as inaccessible as well.
2021-09-23 18:02:20 +02:00
Mike Fährmann
ada36c2044
[deviantart] update default archive_fmt for single deviations
(#1874)
use the same as gallery downloads
2021-09-23 18:02:19 +02:00
Mike Fährmann
140a7bfdcd
update --clear-cache command in deviantart client-id instructions 2021-09-23 18:02:19 +02:00
Mike Fährmann
da16eabb82
[twitter] ensure card entries have a 'url' (#1868) 2021-09-23 18:02:19 +02:00