Mirrors/gallery-dl
1
0
Fork 0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-23 11:12:40 +01:00
Code Issues Releases Wiki Activity
4,051 Commits 6 Branches 164 Tags 16 MiB
b0cb4a1b9c
Commit Graph

58 Commits

Author SHA1 Message Date
Mike Fährmann
b0cb4a1b9c
replace 'text.extract()' with 'text.extr()' where possible 2022-11-05 01:14:09 +01:00
Mike Fährmann
77173694d5
[kemonoparty] fix 'dms' extraction (#3106) 2022-10-26 14:25:43 +02:00
Mike Fährmann
94a2dfe205
[kemonoparty] update pagination offset 2022-10-17 10:22:12 +02:00
Mike Fährmann
78694a61bb
[kemonoparty] restore 'favorites' API endpoints (#2994) 2022-10-01 12:15:32 +02:00
Mike Fährmann
b84982b2f9
[kemonoparty] send Referer headers (#2989, #2990) 2022-10-01 11:45:56 +02:00
Mike Fährmann
779e75c6f8
[kemonoparty] fix attachment IDs overwriting post IDs (#2984) 
regression from 09a5cc61
 2022-09-30 16:47:09 +02:00
Mike Fährmann
09a5cc6103
[kemonoparty] add 'count' metadata field (#2952) 2022-09-23 10:44:12 +02:00
enduser420
574e38a287
[kemonoparty] add 'favorites' option (#2826) (#2831) 
* [kemonoparty] add 'favorites' option (#2826)

* [kemonoparty] add regex for the url parameter and fallback on the config
option

* [kemonoparty] simplify
 2022-08-18 18:01:42 +02:00
Mike Fährmann
7c0505868c
[kemonoparty] ensure all files have an 'extension' (#2740) 2022-07-10 13:53:07 +02:00
Mike Fährmann
ba69fb669d
[kemonoparty] add 'duplicates' option (closes #2440) 2022-03-24 11:58:38 +01:00
Mike Fährmann
fac8047899
[kemonoparty] limit default filename length (#2373) 2022-03-08 21:14:47 +01:00
Mike Fährmann
bddcec49f1
implement 'text.root_from_url()' 
use domain from input URL for kemono
 2022-03-01 03:09:57 +01:00
Mike Fährmann
92c492dc09
[kemonoparty] match beta.kemono.party URLs (#2348) 2022-03-01 03:02:30 +01:00
Mike Fährmann
a57a44f510
[kemonoparty] handle files without 'name' (fixes #2276) 2022-02-08 18:27:05 +01:00
Mike Fährmann
d7b8e04b50
[kemonoparty] use 'Accept-Encoding: identity' for all downloads 
(#2267)

fixes issues when data send with 'Content-Encoding: gzip' or other
encodings is larger than the actual file
 2022-02-05 18:06:58 +01:00
Mike Fährmann
a2eecc6aa8
[kemonoparty] fix DMs extraction (#2008) 2022-01-25 23:16:13 +01:00
Mike Fährmann
6af8d71da6
[kemonoparty] use service as subcategory (closes #2147) 2021-12-29 22:46:17 +01:00
Mike Fährmann
8ed282f7f2
[kemonoparty] support coomer.party URLs (#2100) 2021-12-15 16:21:05 +01:00
Mike Fährmann
f1b142e993
{kemonoparty[ change default 'files' order to attachments,file,inline 
(#1991)
 2021-11-29 04:41:30 +01:00
Mike Fährmann
e298882acc
[kemonoparty] match URLs with www subdomain 2021-11-26 18:58:26 +01:00
Mike Fährmann
af6424f398
allow testing metadata in list elements 2021-11-21 22:46:34 +01:00
Mike Fährmann
c67756e187
[kemonoparty] add 'dms' option (#2008) 2021-11-20 23:36:16 +01:00
Mike Fährmann
9bc83af3a6
[kemonoparty] 'postfile' -> 'file' (#1991) 
to stay consistent with the existing file types for kemono
 2021-11-19 01:50:48 +01:00
Mike Fährmann
d433735750
[kemonoparty] skip duplicate files (#2032, #1991, #1899) 
Extract the SHA-256 file hash from URLs
and skip files with the same hash in the same post.

- provide a 'hash' metadata field (empty string if not available)
- remove 'patreon-skip-file' option
 2021-11-17 22:44:15 +01:00
Mike Fährmann
d4ec245554
[kemonoparty] implement a 'files' option (#1991) 
similar to 8d676151
 2021-11-17 22:43:41 +01:00
Mike Fährmann
6e3658ef52
[kemonoparty] provide 'date' metadata for gumroad (#2007) 
Not the 'published' or 'edited' values since they are 'null',
but still better then nothing at all.
 2021-11-11 19:38:10 +01:00
Mike Fährmann
f0fc3b0ba1
[kemonoparty] add 'comments' option (#1980) 2021-11-03 23:02:13 +01:00
Mike Fährmann
f1487a3cfa
[kemonoparty:discord] improve 'inline' extraction (#1940) 
- extract media.discordapp.*NET* URLs
- rewrite media.discordapp.net to cdn.discordapp.com
- use a more restricted set of characters for the URL path
 2021-10-24 21:15:21 +02:00
Mike Fährmann
b6443c576d
[kemonoparty:discord] extract 'inline' files 2021-10-22 02:50:47 +02:00
Mike Fährmann
bcbf9bcf36
[kemonoparty] split 'discord' extractor (#1940) 
in 'server' and 'channel'
 2021-10-18 04:04:58 +02:00
Mike Fährmann
db857b40d8
[kemonoparty] improve inline extraction (#1899) 2021-10-17 21:47:11 +02:00
Mike Fährmann
70005e3275
[kemonoparty:discord] support downloading from a specific channel 
https://kemono.party/discord/server/<server-id>#<channel-name>>
 2021-10-15 18:50:08 +02:00
Mike Fährmann
003f25931d
[kemonoparty:discord] provide a 'channel_name' 2021-10-15 18:37:08 +02:00
Mike Fährmann
fe6ce5495a
[kemonoparty] add 'discord' extractor (#1827, #1940) 2021-10-13 20:33:05 +02:00
Mike Fährmann
da9685609c
[kemonoparty] update file download URLs 
(closes #1902, fixes #1903)
 2021-09-30 23:02:46 +02:00
Mike Fährmann
4ec11af6a4
[kemonoparty] implement login with username & password (#1824) 2021-09-09 01:06:25 +02:00
Mike Fährmann
83bbb628d8
[kemonoparty] add 'favorite' extractor (#1824) 2021-09-08 00:32:49 +02:00
Mike Fährmann
bb6a130942
automatically set required DDoS-GUARD cookies (#1779) 
for kemono.party and seiso.party
 2021-08-16 17:40:29 +02:00
Mike Fährmann
c34dbc86bb
[kemonoparty] update file server domain (#1764) 2021-08-10 22:24:08 +02:00
Mike Fährmann
5eca3781be
[kemonoparty] fix username extraction (#1750) 2021-08-04 16:09:22 +02:00
Mike Fährmann
486474800f
[kemonoparty] skip duplicated patreon files (closes #1689) 
this behavior can be disabled with the 'patreon-skip-file' option
 2021-07-23 16:38:57 +02:00
Mike Fährmann
d287d2eb88
[kemonoparty] parse 'o' query parameters (#1674) 2021-07-09 18:29:50 +02:00
Mike Fährmann
8b036778e3
[kemonoparty] add 'max-posts' option (#1674) 2021-07-09 18:19:02 +02:00
Mike Fährmann
9ee45f3617
[kemonoparty] warn about missing DDoS-GUARD cookies 2021-06-28 23:34:58 +02:00
Mike Fährmann
759735fb02
[kemonoparty] fix 'username' extraction (fixes #1652) 
The site's <title> content changed from

<title>NAME | Kemono</title>

to

<title>
    NAME | Kemono
</title>
 2021-06-25 15:35:20 +02:00
Mike Fährmann
e9ab97396f
[kemonoparty] update default filenames and archive IDs (#1514) 
Add an enumeration index so that attachments and regular files with the
same filename still get downloaded and not counted as duplicate files
(even though for patreon posts they usually are)

This invalidates all previously generated archive IDs.
To keep using old names and IDs, set
'filename' to "{id}_{title}_{filename}.{extension}" and
'archive-format' to "{service}_{user}_{id}_{filename}.{extension}".
 2021-06-18 16:32:45 +02:00
Mike Fährmann
c0fa5058da
[kemonoparty] actually add a 'type' metadata field (#1556) 2021-05-27 22:11:31 +02:00
Mike Fährmann
2b5d80862e
[kemonoparty] add 'type' metadata field (#1556) 
'file', 'attachment', or 'inline'
 2021-05-15 01:13:41 +02:00
Mike Fährmann
0717456b4e
[kemonoparty] add 'metadata' option (closes #1548) 
to fetch creator names with an additional HTTP request
 2021-05-14 19:56:49 +02:00
Mike Fährmann
66f28e471c
[kemonoparty] update file URLs directly linking to kemono.party 
(#1514)
 2021-05-01 02:30:10 +02:00