Mike Fährmann
a4791f5243
[bluesky] add 'hashtag' extractor ( #4438 )
...
https://github.com/mikf/gallery-dl/issues/4438#issuecomment-2439979958
2024-10-27 13:59:46 +01:00
Mike Fährmann
cc07c81063
[mangadex] apply 'lang' only to chapter results ( #6372 )
2024-10-27 07:55:14 +01:00
Mike Fährmann
8f396cfc57
[bluesky] add 'quoted' option ( #6323 )
2024-10-25 17:22:33 +02:00
Mike Fährmann
d34e2d56aa
[mangadex] use '/manga' endpoint to get manga by author ( #6372 )
...
allows for more than 10 manga to be returned
2024-10-24 20:07:11 +02:00
Mike Fährmann
0fd98f67ba
[mangadex] add 'author' extractor ( #6372 )
2024-10-24 14:57:17 +02:00
Mike Fährmann
c243a7b060
[lensdump] fix extraction ( #6313 )
...
- support custom sort orders & query parameters
- rewrite pagination logic
2024-10-24 13:59:39 +02:00
Mike Fährmann
8f0b0b0735
[wikimedia] fix non-English Fandom/wiki.gg articles ( #6370 )
2024-10-24 13:00:02 +02:00
Mike Fährmann
75674944f0
[pixiv] implement 'sanity_level' workaround for user artworks results
...
(#4327 , #5435 , #6339 )
2024-10-22 20:38:00 +02:00
Mike Fährmann
b08da4ffc7
[reddit] add 'embeds' option ( #6357 )
2024-10-22 17:06:54 +02:00
Mike Fährmann
33161da121
[pixiv] add 'captions' option ( #4327 )
...
make extra requests for empty captions independent of 'sanity'
2024-10-22 16:31:37 +02:00
Mike Fährmann
2d15e64ea9
[pixiv] fix exception when processing deleted sanity_level work ( #6339 )
...
https://github.com/mikf/gallery-dl/issues/6339#issuecomment-2427350524
2024-10-21 21:13:26 +02:00
Mike Fährmann
9a2bccd0d9
[bunkr] update to new site layout ( #6344 , #6352 )
2024-10-21 14:17:28 +02:00
Mike Fährmann
66aa514c25
[scrolller] add initial support ( #295 , #3418 , #5051 )
2024-10-21 14:17:18 +02:00
Mike Fährmann
eacd4479a2
[patreon] support '/c/' before creator name in URLs ( #6348 )
...
and avoid '/CREATOR/posts' redirects
2024-10-21 14:11:19 +02:00
Mike Fährmann
cff3d37551
[civitai] update "My Reactions" handling ( #6263 )
...
- use "reactions" subcategory
- raise exception when no api-key or cookies are present
2024-10-20 14:56:56 +02:00
Mike Fährmann
5d984f35aa
[pinterest] support 'story' pins ( #6188 , #6078 , #4229 )
2024-10-19 17:47:31 +02:00
Mike Fährmann
4667833195
[util] add 'std' object to global eval namespace ( #6330 )
...
allows accessing standard library modules (and other external modules)
in a more straightforward manner than '__import__(...)'
* std.os.getcwd()
* std["os"].getcwd()
2024-10-17 21:08:07 +02:00
Mike Fährmann
4b31601dc0
[civitai] fix "My Reactions" results ( #6263 )
...
requires 'api-key' or authenticated cookies to work
2024-10-16 23:18:00 +02:00
Mike Fährmann
69a75b1de2
[civitai] add extractors for global 'models' and 'images' ( #6310 )
2024-10-16 23:00:51 +02:00
Mike Fährmann
a37ac3c748
[civitai] add 'uuid' metadata field & use as archive format ( #6326 )
2024-10-16 19:56:09 +02:00
Mike Fährmann
6506afb257
[bunkr] support 'bunkr.ps' URLs
2024-10-14 16:27:09 +02:00
Mike Fährmann
4358799833
[newgrounds] support page numbers in URLs ( #6320 )
...
https://USER.newgrounds.com/art/?page=5
https://USER.newgrounds.com/art/page/5
2024-10-14 14:25:09 +02:00
Mike Fährmann
93265db9b3
[8chan] support '/last/' thread URLs ( #6318 )
2024-10-14 14:25:09 +02:00
Mike Fährmann
3946fe5ac4
[cookies] return loaded cookies as list
...
don't set_cookie() them immediately into a CookieJar
also, give some more consistent names to chrome/chromium functions
2024-10-14 14:24:27 +02:00
Mike Fährmann
1df09292b5
consistent __exit__() argument names
2024-10-11 16:43:28 +02:00
Mike Fährmann
5dd17910d1
[deviantart] fix sta.sh folder extraction
2024-10-11 09:51:20 +02:00
Mike Fährmann
bc954eb7e4
[civitai] update default archive format ( #6302 )
2024-10-10 20:29:07 +02:00
Mike Fährmann
29e46f6875
[tests] use extended format strings for archive ID tests
2024-10-10 19:32:09 +02:00
Mike Fährmann
09d4c281b6
[shimmie2] remove 'loudbooru.com'
2024-10-10 18:32:42 +02:00
Mike Fährmann
51ceb33b6c
[8chan] also set TOS cookie for the previous day
2024-10-10 18:19:37 +02:00
Mike Fährmann
2818973981
[gelbooru_v02] unescape categorized tags
2024-10-10 17:30:55 +02:00
Mike Fährmann
bcd920e24d
[lolisafe] remove 'xbunkr.com'
2024-10-10 16:19:08 +02:00
Mike Fährmann
4a1cbe94a9
[pururin] remove module
...
"This domain name has been seized in accordance with a seizure warrant
issued by the United States District Court for the District of Idaho"
2024-10-10 15:57:17 +02:00
Mike Fährmann
04df813e1b
[pixiv] detect works requiring 'My pixiv' access
2024-10-10 15:57:02 +02:00
Mike Fährmann
3194bcbccc
[blogger] remove 'micmicidol.club'
2024-10-10 14:23:58 +02:00
Mike Fährmann
a25aa26577
[chevereto] remove 'deltaporno.com'
2024-10-10 13:07:08 +02:00
Mike Fährmann
e05b9b101e
[pixiv] retrieve 'caption' from AJAX API when empty ( #4327 , #5191 )
2024-10-09 17:50:27 +02:00
Mike Fährmann
4adb1df55a
[pornhub] fix KeyError when album images are missing ( #6299 )
2024-10-09 17:18:06 +02:00
Mike Fährmann
02ca1ac602
[fanbox] add 'comments' option, extend 'metadata' option ( #6287 )
2024-10-06 22:31:41 +02:00
Mike Fährmann
7f945c44f5
[pixiv] support unlisted artworks ( #5162 )
2024-10-05 17:10:03 +02:00
Mike Fährmann
c5be50fdaa
[pixiv] implement workaround for 'limit_sanity_level' works
...
(#4327 , #4747 , #5054 , #5435 , #5651 , #5655 )
Metadata should be ~95% identical (there might be some 'date' differences)
and there could be issues with R-18 works, as these require some URL
manipulation to transform /c/250x250_80_a2/ thumbnail URLs into
/img-original/ ones.
2024-10-04 21:07:56 +02:00
Mike Fährmann
57c30fdc5b
[bunkr] support 'bunkr.pk' URLs ( #6272 )
2024-10-04 09:16:31 +02:00
Mike Fährmann
ee8c4e2e49
[boosty] fix typo causing 'links' to always be empty ( #2387 )
2024-10-03 20:25:12 +02:00
Mike Fährmann
274d99e7d6
[boosty] add 'feed' and 'following' extractors ( #2387 )
2024-10-03 18:09:31 +02:00
Mike Fährmann
1ad58cab84
[boosty] add initial support ( #2387 )
2024-10-02 20:39:55 +02:00
Mike Fährmann
fb6be2dd34
[patreon] extract 'attachments_media' files ( #6241 )
...
https://github.com/mikf/gallery-dl/issues/6241#issuecomment-2386343160
2024-10-01 20:28:30 +02:00
Mike Fährmann
b03ee3c4c4
[text] implement 'parse_query_list()'
2024-10-01 20:28:30 +02:00
Mike Fährmann
a120295632
[util] use minimal separators for 'json_dumps()'
2024-10-01 17:03:13 +02:00
Mike Fährmann
ed859f05ed
[deviantart] fix & improve journal/literature extraction ( #6254 , #6207 )
...
fetch text from HTML __INITIAL_STATE__,
since the API doesn't reliably work and is unusable for sta.sh journals
2024-10-01 14:36:49 +02:00
Mike Fährmann
3d4191fc0d
[patreon] handle exception for suspended accounts
2024-10-01 08:22:50 +02:00
Mike Fährmann
f3f27496d6
[newgrounds] support more comment embed formats ( #6253 )
2024-09-30 08:20:50 +02:00
Mike Fährmann
987f6c36c0
[civitai] ensure image files have an 'id' ( #6251 )
2024-09-29 19:25:55 +02:00
Mike Fährmann
53ae5e3fd8
[tests] allow testing for alternative values
2024-09-29 19:16:18 +02:00
Mike Fährmann
a937b72034
[ao3] add 'subscriptions' extractor ( #6247 )
2024-09-29 13:01:51 +02:00
Mike Fährmann
bc11dc0de2
[deviantart] add 'previews' option ( #3782 , #6124 )
2024-09-27 10:41:26 +02:00
Mike Fährmann
e8c5b57a33
merge #6115 : [inkbunny:favorite] update default directory
...
- extract 'favs_username' metadata
- store files in 'favs_username' directory
2024-09-25 20:28:14 +02:00
Mike Fährmann
ac3ff25236
[inkbunny:favorite] update test
2024-09-25 20:25:33 +02:00
Mike Fährmann
050d87d024
merge #6113 : [weasyl:favorite] fix pagination, support readable URLs
2024-09-25 20:08:36 +02:00
Mike Fährmann
a2db0d5c0d
[civitai] add 'quality' option ( #3706 )
...
download 'original=true' files by default
2024-09-25 17:23:08 +02:00
Mike Fährmann
92bbb9bf31
[civitai] add 'image' extractors ( #3706 , #6220 )
2024-09-23 10:13:30 +02:00
Mike Fährmann
933dc568c3
[tests] ensure 'extractor.find' and 'from_url' extractors are identical
2024-09-22 10:58:59 +02:00
Mike Fährmann
14c57f771c
[tests] make "#category" result entries optional
...
use categories of the given "#class"
when "#category" is not specified
2024-09-21 21:45:45 +02:00
Mike Fährmann
8bf081d295
[ao3] fix bookmark extraction, support 'series' bookmarks ( #6013 )
2024-09-21 13:54:42 +02:00
Mike Fährmann
93eca64a73
[civitai] add initial support ( #3706 , #3787 , #4129 , #5995 )
2024-09-20 17:21:17 +02:00
Mike Fährmann
2c7a0c3ca8
add alternatives for deprecated utc datetime functions
2024-09-19 20:47:05 +02:00
Mike Fährmann
68bff76d90
[formatter] implement 'L' conversion
2024-09-19 13:50:52 +02:00
Mike Fährmann
b44f0cdab0
[formatter] allow accessing 'util.NONE' via global '_nul'
2024-09-19 13:28:59 +02:00
Mike Fährmann
2dfdc92b21
[ao3] extract detailed 'chapters' metadata ( #6013 )
2024-09-18 09:48:57 +02:00
Mike Fährmann
1d7df9cef2
[ao3] extract 'date_completed' and 'date_updated' metadata ( #6013 )
2024-09-17 17:26:54 +02:00
Mike Fährmann
064bc890fc
[ao3] parse 'series' metadata ( #6013 )
2024-09-17 17:14:44 +02:00
Mike Fährmann
8f777668d0
[ao3] match URLs with 'com' and 'net' TLDs and 'ao3.org' ( #6013 )
2024-09-17 09:59:55 +02:00
Mike Fährmann
638a676495
[ao3] add initial support ( #6013 )
2024-09-15 22:38:21 +02:00
Mike Fährmann
7d6520e15d
[bluesky] support video downloads ( #6183 )
2024-09-15 22:38:03 +02:00
Mike Fährmann
af8cba089e
[zzup] support 'up.zzup.com' galleries ( #6181 )
2024-09-15 11:01:27 +02:00
Mike Fährmann
df0d7d4a12
[cohost] add 'user' and 'post' extractors ( #4483 )
2024-09-11 18:03:33 +02:00
Mike Fährmann
7fe0f35998
[sexcom] add 'likes' extractor ( #6149 )
2024-09-06 07:44:06 +02:00
Mike Fährmann
32d2e686c2
[batoto] return 'chapter_url' as string ( #5562 )
...
don't try to parse it as integer
2024-09-05 17:47:38 +02:00
Mike Fährmann
359572162b
[pp:rename] improve renaming files 'to' a format ( #5846 , #6044 )
2024-09-03 21:17:31 +02:00
Allen
d2ef9a590f
[tumblr] add search extractor
2024-09-03 08:18:58 +02:00
Mike Fährmann
864484e4c6
[instagram] add 'info' as a possible 'include' value
2024-09-02 15:43:55 +02:00
Mike Fährmann
9d1e5f3c9b
[pixiv] allow downloading "original" ugoira frames ( #6056 )
2024-09-01 13:37:32 +02:00
Mike Fährmann
ae9b0da755
[pp:hash] add 'hash' post processor ( #6099 )
2024-08-31 17:04:44 +02:00
Mike Fährmann
bd932b6860
[twitter] add 'info' as a possible 'include' value ( #6114 )
2024-08-31 17:04:22 +02:00
Deer-Spangle
b1b01f56af
Add support for the readable URL format of Weasyl favourites page
2024-08-31 12:56:50 +01:00
Mike Fährmann
ef8b1bc56e
[twitter] extract 'type' metadata ( #6111 )
2024-08-31 13:16:51 +02:00
Mike Fährmann
510ca36b35
[tests] fix bug when running tests in a certain order
...
test_ytdl -> test_downloader -> test_extractor
would cause a test failure in Python <3.6 related to youtube_dl imports
2024-08-31 09:42:30 +02:00
Mike Fährmann
17f5ba43a8
[pp:rename] add 'rename' post processor ( #5846 , #6044 )
...
renames previously downloaded files to a different filename format
2024-08-30 18:21:36 +02:00
Mike Fährmann
e464c955b3
merge #6104 : [generic] better directory names
2024-08-30 11:47:09 +02:00
Allen
a552fb5bcd
[generic] better directory formatting/md
2024-08-29 22:30:48 +02:00
Mike Fährmann
127aa45834
[ytdl] ignore SyntaxErrors when trying to import a module
2024-08-29 19:28:08 +02:00
Mike Fährmann
4b286e80fd
merge #6050 : [wikimedia] add 'wiki' extractor
2024-08-25 09:38:24 +02:00
Mike Fährmann
65cae11b54
merge #6077 : [flickr] fix bug introduced in e92a9ae3
2024-08-25 09:30:07 +02:00
Mike Fährmann
47e7be31a5
[flickr] add 'contexts' and 'exif' test
2024-08-25 09:28:22 +02:00
Mike Fährmann
4b94b7d477
[pp:metadata] add 'include' and 'exclude' options ( #6058 )
2024-08-19 21:58:57 +02:00
Mike Fährmann
80c423a444
[cyberdrop] fix extraction
2024-08-19 13:37:14 +02:00
Mike Fährmann
6af26a424a
[hitomi] extract 'extension_original' metadata ( #6049 )
2024-08-18 12:56:50 +02:00
ClosedPort22
33d2ddd9fb
[wikimedia] add 'wiki' extractor
2024-08-18 13:20:59 +08:00
Mike Fährmann
8ea75202ed
[bunkr] fix file downloads ( #6037 )
2024-08-17 19:25:19 +02:00
Mike Fährmann
ef4c1b4fc5
[sankaku] restore old 'tags' format ( #6043 )
...
lowercase + words separated by underscores
2024-08-17 19:25:19 +02:00
Mike Fährmann
78ae0ba9f7
[formatter] implement 'A' format specifier ( #6036 )
2024-08-16 20:34:23 +02:00
