Mike Fährmann
ee8c4e2e49
[boosty] fix typo causing 'links' to always be empty ( #2387 )
2024-10-03 20:25:12 +02:00
Mike Fährmann
274d99e7d6
[boosty] add 'feed' and 'following' extractors ( #2387 )
2024-10-03 18:09:31 +02:00
Mike Fährmann
aa31c153e3
[patreon] include 'attachments_media' in API results ( #6268 )
...
continuation of fb6be2dd34
2024-10-03 10:24:05 +02:00
Mike Fährmann
1ad58cab84
[boosty] add initial support ( #2387 )
2024-10-02 20:39:55 +02:00
Mike Fährmann
7dbd53e9b4
[deviantart] extract journal HTML from webpage ( #6254 , #6207 , #6196 )
2024-10-01 21:47:14 +02:00
Mike Fährmann
fb6be2dd34
[patreon] extract 'attachments_media' files ( #6241 )
...
https://github.com/mikf/gallery-dl/issues/6241#issuecomment-2386343160
2024-10-01 20:28:30 +02:00
Mike Fährmann
b03ee3c4c4
[text] implement 'parse_query_list()'
2024-10-01 20:28:30 +02:00
Mike Fährmann
9f49cf16e8
[text] implement 'parse_query()' without using 'urllib.parse.parse_qsl'
...
doesn't support bytes anymore, but is twice as fast
2024-10-01 20:28:11 +02:00
Mike Fährmann
a120295632
[util] use minimal separators for 'json_dumps()'
2024-10-01 17:03:13 +02:00
Mike Fährmann
ed859f05ed
[deviantart] fix & improve journal/literature extraction ( #6254 , #6207 )
...
fetch text from HTML __INITIAL_STATE__,
since the API doesn't reliably work and is unusable for sta.sh journals
2024-10-01 14:36:49 +02:00
Mike Fährmann
8f09e4eb02
[cohost] remove 'plainTextBody' from default filenames ( #6262 )
2024-10-01 14:36:49 +02:00
Mike Fährmann
2e87a91e97
[oauth] prevent empty browser names
2024-10-01 08:22:50 +02:00
Mike Fährmann
3d4191fc0d
[patreon] handle exception for suspended accounts
2024-10-01 08:22:50 +02:00
Mike Fährmann
319c3a4c9b
[patreon] use 'self.groups' to access matched URL values
2024-10-01 08:22:50 +02:00
Mike Fährmann
321161c769
[patreon] use mobile UA ( #6241 , #6239 , #6140 )
2024-10-01 08:22:16 +02:00
Mike Fährmann
7d0e5877ce
[newgrounds] add more fallback URLs for 'art-images' files
2024-10-01 08:22:16 +02:00
Mike Fährmann
f3f27496d6
[newgrounds] support more comment embed formats ( #6253 )
2024-09-30 08:20:50 +02:00
Mike Fährmann
987f6c36c0
[civitai] ensure image files have an 'id' ( #6251 )
2024-09-29 19:25:55 +02:00
Mike Fährmann
a937b72034
[ao3] add 'subscriptions' extractor ( #6247 )
2024-09-29 13:01:51 +02:00
Mike Fährmann
9a0acbe7c4
[flickr] remove debug remains ( #6252 )
...
fixes regression introduced in a051e1c9
2024-09-29 13:01:51 +02:00
Mike Fährmann
6c0cce8dff
[build] remove setuptools and requests version restrictions
2024-09-29 12:57:10 +02:00
Mike Fährmann
df4ecef364
release version 1.27.5
2024-09-28 11:44:10 +02:00
Mike Fährmann
0389575e0f
[8chan] dynamically generate 'TOS' cookie name
2024-09-28 11:04:27 +02:00
Mike Fährmann
4e9dd036e7
[civitai] add 'nsfw' option ( #3706 )
2024-09-28 08:44:35 +02:00
Mike Fährmann
1ab90dd9e2
[civitai] improve model 'gallery' extraction ( #3706 )
2024-09-27 22:14:14 +02:00
Mike Fährmann
bc11dc0de2
[deviantart] add 'previews' option ( #3782 , #6124 )
2024-09-27 10:41:26 +02:00
Mike Fährmann
928e170721
[deviantart] work around OAuth API returning empty journal texts
...
(#6196 , #6207 , #5916 )
2024-09-27 10:41:26 +02:00
Mike Fährmann
f8f67dab22
[cookies] add 'cookies-select' option
2024-09-27 10:41:26 +02:00
Mike Fährmann
a783d6473c
[jpgfish] update domain to 'jpg5.su' ( #6231 )
2024-09-26 15:23:22 +02:00
Mike Fährmann
f0267f969a
[skeb] prevent 429 errors and need for 'request_key' cookie
...
https://github.com/danbooru/danbooru/pull/5795
2024-09-26 15:15:37 +02:00
Mike Fährmann
e8c5b57a33
merge #6115 : [inkbunny:favorite] update default directory
...
- extract 'favs_username' metadata
- store files in 'favs_username' directory
2024-09-25 20:28:14 +02:00
Mike Fährmann
ac3ff25236
[inkbunny:favorite] update test
2024-09-25 20:25:33 +02:00
Mike Fährmann
050d87d024
merge #6113 : [weasyl:favorite] fix pagination, support readable URLs
2024-09-25 20:08:36 +02:00
Mike Fährmann
9d7f8f892d
[weasyl:favorite] update
...
- use 'self.groups' to access userid and username
- safe one request by not doing an explicit username -> userid lookup
- safe one request by following the 'Next' link instead of detecting an
empty page
2024-09-25 20:02:01 +02:00
Mike Fährmann
3eb3564b5d
[civitai] support using internal tRPC API endpoints ( #3706 )
2024-09-25 18:46:18 +02:00
Mike Fährmann
daa220370c
[civitai] improve image URL handling ( #3706 )
...
- support building URLs from URL-hash values
- rename '_orig' to '_url'
2024-09-25 17:29:35 +02:00
Mike Fährmann
a2db0d5c0d
[civitai] add 'quality' option ( #3706 )
...
download 'original=true' files by default
2024-09-25 17:23:08 +02:00
Mike Fährmann
92bbb9bf31
[civitai] add 'image' extractors ( #3706 , #6220 )
2024-09-23 10:13:30 +02:00
Deer-Spangle
cbecaecc43
Fix infinite loop in Weasyl Favs downloader
2024-09-22 11:12:34 +01:00
Mike Fährmann
8bf081d295
[ao3] fix bookmark extraction, support 'series' bookmarks ( #6013 )
2024-09-21 13:54:42 +02:00
Mike Fährmann
5c062f95c1
[ao3] fix 'title' of restricted works ( #6013 )
2024-09-21 13:21:45 +02:00
Mike Fährmann
91eb04b0d0
[ao3] detect member-only and adult works ( #6013 )
2024-09-21 13:20:42 +02:00
Mike Fährmann
3348b05df0
[ao3] implement login with username & password ( #6013 )
2024-09-21 13:15:50 +02:00
Mike Fährmann
93eca64a73
[civitai] add initial support ( #3706 , #3787 , #4129 , #5995 )
2024-09-20 17:21:17 +02:00
Mike Fährmann
fe190be589
[8chan] update 'TOS' cookie name
2024-09-19 20:50:58 +02:00
Mike Fährmann
2c7a0c3ca8
add alternatives for deprecated utc datetime functions
2024-09-19 20:47:05 +02:00
Mike Fährmann
a051e1c955
directly pass exception instances as 'exc_info' logger argument
2024-09-19 14:50:08 +02:00
Mike Fährmann
dd56bb2187
include debug exception info for GalleryDLException errors
2024-09-19 13:51:27 +02:00
Mike Fährmann
68bff76d90
[formatter] implement 'L' conversion
2024-09-19 13:50:52 +02:00
Mike Fährmann
b44f0cdab0
[formatter] allow accessing 'util.NONE' via global '_nul'
2024-09-19 13:28:59 +02:00
Mike Fährmann
2dfdc92b21
[ao3] extract detailed 'chapters' metadata ( #6013 )
2024-09-18 09:48:57 +02:00
Mike Fährmann
1d7df9cef2
[ao3] extract 'date_completed' and 'date_updated' metadata ( #6013 )
2024-09-17 17:26:54 +02:00
Mike Fährmann
064bc890fc
[ao3] parse 'series' metadata ( #6013 )
2024-09-17 17:14:44 +02:00
Mike Fährmann
6b8628b23f
merge #6191 : [cohost] support downloading likes
2024-09-17 10:50:28 +02:00
Mike Fährmann
8f777668d0
[ao3] match URLs with 'com' and 'net' TLDs and 'ao3.org' ( #6013 )
2024-09-17 09:59:55 +02:00
Kae
31af0a12c7
[cohost] Support for downloading likes
...
turns out it's almost the same as tags, so I was able to get it working pretty easily
2024-09-17 12:50:59 +10:00
Mike Fährmann
73f833d08a
[cookies:firefox] support using domain + container filters together
2024-09-16 14:58:44 +02:00
Mike Fährmann
a9dc7a6f98
[deviantart] warn about empty journal texts ( #5916 )
...
https://github.com/mikf/gallery-dl/issues/5916#issuecomment-2351069092
2024-09-16 10:12:25 +02:00
Mike Fährmann
4c391805de
[bluesky] simplify file extraction code ( #6183 )
2024-09-16 09:37:18 +02:00
Mike Fährmann
638a676495
[ao3] add initial support ( #6013 )
2024-09-15 22:38:21 +02:00
Mike Fährmann
7d6520e15d
[bluesky] support video downloads ( #6183 )
2024-09-15 22:38:03 +02:00
Mike Fährmann
af8cba089e
[zzup] support 'up.zzup.com' galleries ( #6181 )
2024-09-15 11:01:27 +02:00
Mike Fährmann
7abf6e445c
[cohost] add 'tag' extractor ( #4483 )
2024-09-13 11:11:53 +02:00
Mike Fährmann
0d67d54162
[cohost] support 'attachment-row' blocks ( #4483 )
2024-09-13 10:33:05 +02:00
Mike Fährmann
29279f07d4
[cohost] warn about inaccessible posts ( #4483 )
2024-09-13 10:31:28 +02:00
Mike Fährmann
319116c923
[pp:ugoira] update mtime of zipped files ( #6147 )
...
in zip archives generated by '"mode": "archive"'
2024-09-12 21:51:55 +02:00
Mike Fährmann
df0d7d4a12
[cohost] add 'user' and 'post' extractors ( #4483 )
2024-09-11 18:03:33 +02:00
Mike Fährmann
ff07aef776
[pp:ugoira] implement storing "original" frames in archives ( #6147 )
...
… by using '"mode": "archive"'
- rename 'ffmpeg-demuxer' option to 'mode'
- add 'metadata' option
- add 'zip' as a possible `--ugoira` format
TODO: adjust file mtimes inside archives when 'mtime' is enabled
2024-09-09 21:41:37 +02:00
Mike Fährmann
4601aa9794
[util] add 'NullContext'
...
an even more minimal 'contextlib.nullcontext'
that also works on older Python versions
2024-09-09 20:28:18 +02:00
Mike Fährmann
4da3347d18
allow filtering '--list-extractors' results
...
with blacklist/whitelist syntax, e.g.
--list-extractors pixiv
--list-extractors pixiv:user pixiv:work
--list-extractors :search
2024-09-08 09:27:32 +02:00
Mike Fährmann
0db3c11ab0
[common] use 'cf-mitigated' header to detect challenges
2024-09-07 20:16:06 +02:00
Mike Fährmann
4b04ccb3a1
[wikimedia] probe possible API endpoints when none is defined
...
instead of hardcoding it to '/api.php'
2024-09-07 20:11:44 +02:00
Mike Fährmann
061cc12fdd
[pp:ugoira] fix "KeyError: '_ugoira_frame_index'" ( #6154 )
...
fixes regression introduced in 07bd967f
2024-09-06 21:29:12 +02:00
Mike Fährmann
11a508f470
[docker] fix Docker image build
...
make commands meant to remove unnecessary caches non-fatal
(pip no longer installs setuptools and wheel directly anymore)
2024-09-06 21:27:45 +02:00
Mike Fährmann
dd62768e10
release version 1.27.4
2024-09-06 13:34:55 +02:00
Mike Fährmann
7260e236d8
[furaffinity] fix 'favorite' pagination ( #6151 )
2024-09-06 08:52:05 +02:00
Mike Fährmann
7fe0f35998
[sexcom] add 'likes' extractor ( #6149 )
2024-09-06 07:44:06 +02:00
Mike Fährmann
513fd26616
[bcbnsfw] use '*' as query when retrieving all posts ( #6135 )
2024-09-05 20:43:23 +02:00
Mike Fährmann
0b3d7280dc
do not override '"ugoira": "original"' when using '--ugoira' ( #6056 )
2024-09-05 20:26:57 +02:00
Mike Fährmann
07bd967f59
[pp:ugoira] update ( #6056 )
...
- introduce '_ugoira_frame_index' metadata field
- store Ugoira file exts separately
- add 'skip' option
2024-09-05 20:25:20 +02:00
Mike Fährmann
32d2e686c2
[batoto] return 'chapter_url' as string ( #5562 )
...
don't try to parse it as integer
2024-09-05 17:47:38 +02:00
Mike Fährmann
8072dcf717
[pp:rename] recheck if file exists only when necessary
2024-09-05 17:42:29 +02:00
Mike Fährmann
359572162b
[pp:rename] improve renaming files 'to' a format ( #5846 , #6044 )
2024-09-03 21:17:31 +02:00
Mike Fährmann
6f611de889
[ytdl] simplify '_process_entries()'
2024-09-03 21:17:31 +02:00
Mike Fährmann
4a3a255ddc
[ytdl] fix processing playlists of playlists ( #6127 )
2024-09-03 08:39:04 +02:00
Mike Fährmann
655145853a
[toyhouse] fix extraction for image URLs
2024-09-02 17:15:02 +02:00
Mike Fährmann
864484e4c6
[instagram] add 'info' as a possible 'include' value
2024-09-02 15:43:55 +02:00
Mike Fährmann
0b53f3d0e9
[deviantart] fix '"original": "images"' ( #6124 )
2024-09-02 15:15:37 +02:00
Mike Fährmann
57da9ebfb5
[pp:ugoira] initial support for "original" frames ( #6056 )
2024-09-01 21:32:00 +02:00
Mike Fährmann
9d1e5f3c9b
[pixiv] allow downloading "original" ugoira frames ( #6056 )
2024-09-01 13:37:32 +02:00
Deer-Spangle
8c40094905
Store Inkbunny favourites in the Favorites directory of the user's favs being downloaded, rather than in different directories for each submission
2024-08-31 16:37:20 +01:00
Mike Fährmann
ae9b0da755
[pp:hash] add 'hash' post processor ( #6099 )
2024-08-31 17:04:44 +02:00
Mike Fährmann
bd932b6860
[twitter] add 'info' as a possible 'include' value ( #6114 )
2024-08-31 17:04:22 +02:00
Deer-Spangle
10543c64c6
Store favourites in the Favorites directory of the user's favs being downloaded, rather than in different directories for each submission
2024-08-31 15:54:04 +01:00
Deer-Spangle
01ace529b6
Fixing syntax on python 3.5, the sad days before f-strings
2024-08-31 15:22:39 +01:00
Deer-Spangle
311272f55a
Linting
2024-08-31 15:10:02 +01:00
Deer-Spangle
b1b01f56af
Add support for the readable URL format of Weasyl favourites page
2024-08-31 12:56:50 +01:00
Mike Fährmann
ef8b1bc56e
[twitter] extract 'type' metadata ( #6111 )
2024-08-31 13:16:51 +02:00
Mike Fährmann
8eaae29bf9
[exhentai] fix 'limits' ( #6090 )
2024-08-31 10:23:07 +02:00
Mike Fährmann
60b655429f
add '--rename' and '--rename-to' command-line options ( #5846 , #6044 )
2024-08-30 18:22:46 +02:00
