1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-22 02:32:33 +01:00
Commit Graph

6054 Commits

Author SHA1 Message Date
Mike Fährmann
c5be50fdaa
[pixiv] implement workaround for 'limit_sanity_level' works
(#4327, #4747, #5054, #5435, #5651, #5655)

Metadata should be ~95% identical (there might be some 'date' differences)
and there could be issues with R-18 works, as these require some URL
manipulation to transform /c/250x250_80_a2/ thumbnail URLs into
/img-original/ ones.
2024-10-04 21:07:56 +02:00
Mike Fährmann
d1432d02a1
[pixiv] move file/ugoira extraction into a separate function 2024-10-04 16:21:19 +02:00
Mike Fährmann
3fa639fc2d
[boosty] support audio files (#2387) 2024-10-04 09:20:25 +02:00
Mike Fährmann
57c30fdc5b
[bunkr] support 'bunkr.pk' URLs (#6272) 2024-10-04 09:16:31 +02:00
Mike Fährmann
5b968a0a7c
[boosty] extend image URLs with 'signedQuery' (#2387) 2024-10-03 20:25:12 +02:00
Mike Fährmann
8548fc3a70
[boosty] add 'bought' option (#2387) 2024-10-03 20:25:12 +02:00
Mike Fährmann
ee8c4e2e49
[boosty] fix typo causing 'links' to always be empty (#2387) 2024-10-03 20:25:12 +02:00
Mike Fährmann
274d99e7d6
[boosty] add 'feed' and 'following' extractors (#2387) 2024-10-03 18:09:31 +02:00
Mike Fährmann
aa31c153e3
[patreon] include 'attachments_media' in API results (#6268)
continuation of fb6be2dd34
2024-10-03 10:24:05 +02:00
Mike Fährmann
1ad58cab84
[boosty] add initial support (#2387) 2024-10-02 20:39:55 +02:00
Mike Fährmann
7dbd53e9b4
[deviantart] extract journal HTML from webpage (#6254, #6207, #6196) 2024-10-01 21:47:14 +02:00
Mike Fährmann
fb6be2dd34
[patreon] extract 'attachments_media' files (#6241)
https://github.com/mikf/gallery-dl/issues/6241#issuecomment-2386343160
2024-10-01 20:28:30 +02:00
Mike Fährmann
b03ee3c4c4
[text] implement 'parse_query_list()' 2024-10-01 20:28:30 +02:00
Mike Fährmann
9f49cf16e8
[text] implement 'parse_query()' without using 'urllib.parse.parse_qsl'
doesn't support bytes anymore, but is twice as fast
2024-10-01 20:28:11 +02:00
Mike Fährmann
a120295632
[util] use minimal separators for 'json_dumps()' 2024-10-01 17:03:13 +02:00
Mike Fährmann
ed859f05ed
[deviantart] fix & improve journal/literature extraction (#6254, #6207)
fetch text from HTML __INITIAL_STATE__,
since the API doesn't reliably work and is unusable for sta.sh journals
2024-10-01 14:36:49 +02:00
Mike Fährmann
8f09e4eb02
[cohost] remove 'plainTextBody' from default filenames (#6262) 2024-10-01 14:36:49 +02:00
Mike Fährmann
2e87a91e97
[oauth] prevent empty browser names 2024-10-01 08:22:50 +02:00
Mike Fährmann
3d4191fc0d
[patreon] handle exception for suspended accounts 2024-10-01 08:22:50 +02:00
Mike Fährmann
319c3a4c9b
[patreon] use 'self.groups' to access matched URL values 2024-10-01 08:22:50 +02:00
Mike Fährmann
321161c769
[patreon] use mobile UA (#6241, #6239, #6140) 2024-10-01 08:22:16 +02:00
Mike Fährmann
7d0e5877ce
[newgrounds] add more fallback URLs for 'art-images' files 2024-10-01 08:22:16 +02:00
Mike Fährmann
f3f27496d6
[newgrounds] support more comment embed formats (#6253) 2024-09-30 08:20:50 +02:00
Mike Fährmann
987f6c36c0
[civitai] ensure image files have an 'id' (#6251) 2024-09-29 19:25:55 +02:00
Mike Fährmann
53ae5e3fd8
[tests] allow testing for alternative values 2024-09-29 19:16:18 +02:00
Mike Fährmann
a937b72034
[ao3] add 'subscriptions' extractor (#6247) 2024-09-29 13:01:51 +02:00
Mike Fährmann
9a0acbe7c4
[flickr] remove debug remains (#6252)
fixes regression introduced in a051e1c9
2024-09-29 13:01:51 +02:00
Mike Fährmann
6c0cce8dff
[build] remove setuptools and requests version restrictions 2024-09-29 12:57:10 +02:00
Mike Fährmann
df4ecef364
release version 1.27.5 2024-09-28 11:44:10 +02:00
Mike Fährmann
0389575e0f
[8chan] dynamically generate 'TOS' cookie name 2024-09-28 11:04:27 +02:00
Mike Fährmann
4e9dd036e7
[civitai] add 'nsfw' option (#3706) 2024-09-28 08:44:35 +02:00
Mike Fährmann
1ab90dd9e2
[civitai] improve model 'gallery' extraction (#3706) 2024-09-27 22:14:14 +02:00
Mike Fährmann
bc11dc0de2
[deviantart] add 'previews' option (#3782, #6124) 2024-09-27 10:41:26 +02:00
Mike Fährmann
928e170721
[deviantart] work around OAuth API returning empty journal texts
(#6196, #6207, #5916)
2024-09-27 10:41:26 +02:00
Mike Fährmann
f8f67dab22
[cookies] add 'cookies-select' option 2024-09-27 10:41:26 +02:00
Mike Fährmann
a783d6473c
[jpgfish] update domain to 'jpg5.su' (#6231) 2024-09-26 15:23:22 +02:00
Mike Fährmann
f0267f969a
[skeb] prevent 429 errors and need for 'request_key' cookie
https://github.com/danbooru/danbooru/pull/5795
2024-09-26 15:15:37 +02:00
Mike Fährmann
e8c5b57a33
merge #6115: [inkbunny:favorite] update default directory
- extract 'favs_username' metadata
- store files in 'favs_username' directory
2024-09-25 20:28:14 +02:00
Mike Fährmann
ac3ff25236
[inkbunny:favorite] update test 2024-09-25 20:25:33 +02:00
Mike Fährmann
050d87d024
merge #6113: [weasyl:favorite] fix pagination, support readable URLs 2024-09-25 20:08:36 +02:00
Mike Fährmann
9d7f8f892d
[weasyl:favorite] update
- use 'self.groups' to access userid and username
- safe one request by not doing an explicit username -> userid lookup
- safe one request by following the 'Next' link instead of detecting an
  empty page
2024-09-25 20:02:01 +02:00
Mike Fährmann
3eb3564b5d
[civitai] support using internal tRPC API endpoints (#3706) 2024-09-25 18:46:18 +02:00
Mike Fährmann
daa220370c
[civitai] improve image URL handling (#3706)
- support building URLs from URL-hash values
- rename '_orig' to '_url'
2024-09-25 17:29:35 +02:00
Mike Fährmann
a2db0d5c0d
[civitai] add 'quality' option (#3706)
download 'original=true' files by default
2024-09-25 17:23:08 +02:00
Mike Fährmann
92bbb9bf31
[civitai] add 'image' extractors (#3706, #6220) 2024-09-23 10:13:30 +02:00
Deer-Spangle
cbecaecc43 Fix infinite loop in Weasyl Favs downloader 2024-09-22 11:12:34 +01:00
Mike Fährmann
933dc568c3
[tests] ensure 'extractor.find' and 'from_url' extractors are identical 2024-09-22 10:58:59 +02:00
Mike Fährmann
14c57f771c
[tests] make "#category" result entries optional
use categories of the given "#class"
when "#category" is not specified
2024-09-21 21:45:45 +02:00
Mike Fährmann
8bf081d295
[ao3] fix bookmark extraction, support 'series' bookmarks (#6013) 2024-09-21 13:54:42 +02:00
Mike Fährmann
5c062f95c1
[ao3] fix 'title' of restricted works (#6013) 2024-09-21 13:21:45 +02:00