Mike Fährmann
04df813e1b
[pixiv] detect works requiring 'My pixiv' access
2024-10-10 15:57:02 +02:00
Mike Fährmann
3194bcbccc
[blogger] remove 'micmicidol.club'
2024-10-10 14:23:58 +02:00
Mike Fährmann
a25aa26577
[chevereto] remove 'deltaporno.com'
2024-10-10 13:07:08 +02:00
Mike Fährmann
e05b9b101e
[pixiv] retrieve 'caption' from AJAX API when empty ( #4327 , #5191 )
2024-10-09 17:50:27 +02:00
Mike Fährmann
4adb1df55a
[pornhub] fix KeyError when album images are missing ( #6299 )
2024-10-09 17:18:06 +02:00
Mike Fährmann
02ca1ac602
[fanbox] add 'comments' option, extend 'metadata' option ( #6287 )
2024-10-06 22:31:41 +02:00
Mike Fährmann
7f945c44f5
[pixiv] support unlisted artworks ( #5162 )
2024-10-05 17:10:03 +02:00
Mike Fährmann
c5be50fdaa
[pixiv] implement workaround for 'limit_sanity_level' works
...
(#4327 , #4747 , #5054 , #5435 , #5651 , #5655 )
Metadata should be ~95% identical (there might be some 'date' differences)
and there could be issues with R-18 works, as these require some URL
manipulation to transform /c/250x250_80_a2/ thumbnail URLs into
/img-original/ ones.
2024-10-04 21:07:56 +02:00
Mike Fährmann
57c30fdc5b
[bunkr] support 'bunkr.pk' URLs ( #6272 )
2024-10-04 09:16:31 +02:00
Mike Fährmann
ee8c4e2e49
[boosty] fix typo causing 'links' to always be empty ( #2387 )
2024-10-03 20:25:12 +02:00
Mike Fährmann
274d99e7d6
[boosty] add 'feed' and 'following' extractors ( #2387 )
2024-10-03 18:09:31 +02:00
Mike Fährmann
1ad58cab84
[boosty] add initial support ( #2387 )
2024-10-02 20:39:55 +02:00
Mike Fährmann
fb6be2dd34
[patreon] extract 'attachments_media' files ( #6241 )
...
https://github.com/mikf/gallery-dl/issues/6241#issuecomment-2386343160
2024-10-01 20:28:30 +02:00
Mike Fährmann
b03ee3c4c4
[text] implement 'parse_query_list()'
2024-10-01 20:28:30 +02:00
Mike Fährmann
a120295632
[util] use minimal separators for 'json_dumps()'
2024-10-01 17:03:13 +02:00
Mike Fährmann
ed859f05ed
[deviantart] fix & improve journal/literature extraction ( #6254 , #6207 )
...
fetch text from HTML __INITIAL_STATE__,
since the API doesn't reliably work and is unusable for sta.sh journals
2024-10-01 14:36:49 +02:00
Mike Fährmann
3d4191fc0d
[patreon] handle exception for suspended accounts
2024-10-01 08:22:50 +02:00
Mike Fährmann
f3f27496d6
[newgrounds] support more comment embed formats ( #6253 )
2024-09-30 08:20:50 +02:00
Mike Fährmann
987f6c36c0
[civitai] ensure image files have an 'id' ( #6251 )
2024-09-29 19:25:55 +02:00
Mike Fährmann
53ae5e3fd8
[tests] allow testing for alternative values
2024-09-29 19:16:18 +02:00
Mike Fährmann
a937b72034
[ao3] add 'subscriptions' extractor ( #6247 )
2024-09-29 13:01:51 +02:00
Mike Fährmann
bc11dc0de2
[deviantart] add 'previews' option ( #3782 , #6124 )
2024-09-27 10:41:26 +02:00
Mike Fährmann
e8c5b57a33
merge #6115 : [inkbunny:favorite] update default directory
...
- extract 'favs_username' metadata
- store files in 'favs_username' directory
2024-09-25 20:28:14 +02:00
Mike Fährmann
ac3ff25236
[inkbunny:favorite] update test
2024-09-25 20:25:33 +02:00
Mike Fährmann
050d87d024
merge #6113 : [weasyl:favorite] fix pagination, support readable URLs
2024-09-25 20:08:36 +02:00
Mike Fährmann
a2db0d5c0d
[civitai] add 'quality' option ( #3706 )
...
download 'original=true' files by default
2024-09-25 17:23:08 +02:00
Mike Fährmann
92bbb9bf31
[civitai] add 'image' extractors ( #3706 , #6220 )
2024-09-23 10:13:30 +02:00
Mike Fährmann
933dc568c3
[tests] ensure 'extractor.find' and 'from_url' extractors are identical
2024-09-22 10:58:59 +02:00
Mike Fährmann
14c57f771c
[tests] make "#category" result entries optional
...
use categories of the given "#class"
when "#category" is not specified
2024-09-21 21:45:45 +02:00
Mike Fährmann
8bf081d295
[ao3] fix bookmark extraction, support 'series' bookmarks ( #6013 )
2024-09-21 13:54:42 +02:00
Mike Fährmann
93eca64a73
[civitai] add initial support ( #3706 , #3787 , #4129 , #5995 )
2024-09-20 17:21:17 +02:00
Mike Fährmann
2c7a0c3ca8
add alternatives for deprecated utc datetime functions
2024-09-19 20:47:05 +02:00
Mike Fährmann
68bff76d90
[formatter] implement 'L' conversion
2024-09-19 13:50:52 +02:00
Mike Fährmann
b44f0cdab0
[formatter] allow accessing 'util.NONE' via global '_nul'
2024-09-19 13:28:59 +02:00
Mike Fährmann
2dfdc92b21
[ao3] extract detailed 'chapters' metadata ( #6013 )
2024-09-18 09:48:57 +02:00
Mike Fährmann
1d7df9cef2
[ao3] extract 'date_completed' and 'date_updated' metadata ( #6013 )
2024-09-17 17:26:54 +02:00
Mike Fährmann
064bc890fc
[ao3] parse 'series' metadata ( #6013 )
2024-09-17 17:14:44 +02:00
Mike Fährmann
8f777668d0
[ao3] match URLs with 'com' and 'net' TLDs and 'ao3.org' ( #6013 )
2024-09-17 09:59:55 +02:00
Mike Fährmann
638a676495
[ao3] add initial support ( #6013 )
2024-09-15 22:38:21 +02:00
Mike Fährmann
7d6520e15d
[bluesky] support video downloads ( #6183 )
2024-09-15 22:38:03 +02:00
Mike Fährmann
af8cba089e
[zzup] support 'up.zzup.com' galleries ( #6181 )
2024-09-15 11:01:27 +02:00
Mike Fährmann
df0d7d4a12
[cohost] add 'user' and 'post' extractors ( #4483 )
2024-09-11 18:03:33 +02:00
Mike Fährmann
7fe0f35998
[sexcom] add 'likes' extractor ( #6149 )
2024-09-06 07:44:06 +02:00
Mike Fährmann
32d2e686c2
[batoto] return 'chapter_url' as string ( #5562 )
...
don't try to parse it as integer
2024-09-05 17:47:38 +02:00
Mike Fährmann
359572162b
[pp:rename] improve renaming files 'to' a format ( #5846 , #6044 )
2024-09-03 21:17:31 +02:00
Mike Fährmann
864484e4c6
[instagram] add 'info' as a possible 'include' value
2024-09-02 15:43:55 +02:00
Mike Fährmann
9d1e5f3c9b
[pixiv] allow downloading "original" ugoira frames ( #6056 )
2024-09-01 13:37:32 +02:00
Mike Fährmann
ae9b0da755
[pp:hash] add 'hash' post processor ( #6099 )
2024-08-31 17:04:44 +02:00
Mike Fährmann
bd932b6860
[twitter] add 'info' as a possible 'include' value ( #6114 )
2024-08-31 17:04:22 +02:00
Deer-Spangle
b1b01f56af
Add support for the readable URL format of Weasyl favourites page
2024-08-31 12:56:50 +01:00
Mike Fährmann
ef8b1bc56e
[twitter] extract 'type' metadata ( #6111 )
2024-08-31 13:16:51 +02:00
Mike Fährmann
510ca36b35
[tests] fix bug when running tests in a certain order
...
test_ytdl -> test_downloader -> test_extractor
would cause a test failure in Python <3.6 related to youtube_dl imports
2024-08-31 09:42:30 +02:00
Mike Fährmann
17f5ba43a8
[pp:rename] add 'rename' post processor ( #5846 , #6044 )
...
renames previously downloaded files to a different filename format
2024-08-30 18:21:36 +02:00
Mike Fährmann
e464c955b3
merge #6104 : [generic] better directory names
2024-08-30 11:47:09 +02:00
Allen
a552fb5bcd
[generic] better directory formatting/md
2024-08-29 22:30:48 +02:00
Mike Fährmann
127aa45834
[ytdl] ignore SyntaxErrors when trying to import a module
2024-08-29 19:28:08 +02:00
Mike Fährmann
4b286e80fd
merge #6050 : [wikimedia] add 'wiki' extractor
2024-08-25 09:38:24 +02:00
Mike Fährmann
65cae11b54
merge #6077 : [flickr] fix bug introduced in e92a9ae3
2024-08-25 09:30:07 +02:00
Mike Fährmann
47e7be31a5
[flickr] add 'contexts' and 'exif' test
2024-08-25 09:28:22 +02:00
Mike Fährmann
4b94b7d477
[pp:metadata] add 'include' and 'exclude' options ( #6058 )
2024-08-19 21:58:57 +02:00
Mike Fährmann
80c423a444
[cyberdrop] fix extraction
2024-08-19 13:37:14 +02:00
Mike Fährmann
6af26a424a
[hitomi] extract 'extension_original' metadata ( #6049 )
2024-08-18 12:56:50 +02:00
ClosedPort22
33d2ddd9fb
[wikimedia] add 'wiki' extractor
2024-08-18 13:20:59 +08:00
Mike Fährmann
8ea75202ed
[bunkr] fix file downloads ( #6037 )
2024-08-17 19:25:19 +02:00
Mike Fährmann
ef4c1b4fc5
[sankaku] restore old 'tags' format ( #6043 )
...
lowercase + words separated by underscores
2024-08-17 19:25:19 +02:00
Mike Fährmann
78ae0ba9f7
[formatter] implement 'A' format specifier ( #6036 )
2024-08-16 20:34:23 +02:00
Mike Fährmann
01e8433889
fix tests & syntax for older Python versions
2024-08-15 18:16:55 +02:00
Mike Fährmann
0bbdeaaa50
[bunkr] support 'bunkr:' URL prefix ( #6017 )
...
and support 'bunkr.ax' by default
2024-08-14 19:00:59 +02:00
Mike Fährmann
f0de1685ae
[batoto] extract 'chapter_url' ( #5562 )
...
i.e. the chapter number found in the full chapter URL
2024-08-13 20:57:33 +02:00
Mike Fährmann
5208c0d28a
[util] extend CustomNone with an __index__ method ( #6009 )
...
- Make it compatible with functions expecting integer arguments
- Simplify and reuse some method definitions
2024-08-13 16:05:54 +02:00
Mike Fährmann
ad73789256
[util] extend CustomNone with arithmetic operators ( #6007 )
2024-08-13 09:41:12 +02:00
Mike Fährmann
6193c8eabc
merge #5997 : [batoto] improve chapter info regex ( #5988 )
...
… and add 'chapter_string' metadata
2024-08-12 17:54:17 +02:00
Mike Fährmann
224821bd21
[batoto] add test, improve 'info' handling
2024-08-12 17:52:28 +02:00
Mike Fährmann
8cd625fe2b
merge #5983 : [pixiv] use mobile API for series
2024-08-12 11:53:37 +02:00
Mike Fährmann
b33a53968d
[pixiv] incorporate into '_pagination'
2024-08-12 11:50:41 +02:00
Mike Fährmann
785e6f2911
[tumblr] fix 401 Unauthorized for likes when using api-key ( #5994 )
...
fixes regression introduced in 540eaa5a
2024-08-12 09:09:59 +02:00
Mike Fährmann
d1fe81dab0
merge #5970 : [bunkr] support 'bunkr.ci' and 'bunkrrr.org'
2024-08-10 12:26:39 +02:00
Mike Fährmann
ad6ed72307
[bunkr] add tests for new domains
2024-08-10 12:25:43 +02:00
Mike Fährmann
8d1805e336
[hentaicosplays] support 'hentai-cosplay-xxx.com' ( #5959 )
2024-08-10 12:14:18 +02:00
Mike Fährmann
6e7da6310c
[behance] fix video extraction ( #5965 )
...
a lot slower than before since each video now requires an extra HTTP
request and 'sleep-request' is set to 2s-4s by default.
it now also requires ytdl.
2024-08-10 11:06:54 +02:00
Mike Fährmann
c07a074418
[furaffinity] remove end of system messages
2024-08-07 18:39:34 +02:00
Mike Fährmann
846512f6cd
[furaffinity] add 'submissions' extractor ( #5954 )
2024-08-07 16:34:32 +02:00
Mike Fährmann
b4733b7ea8
[fanbox] fix pagination ( #5949 , #5951 , #5956 )
2024-08-07 10:16:14 +02:00
Mike Fährmann
605f6fba2c
[pp:metadata] implement 'base-directory' option ( #5262 , #5728 )
2024-08-07 10:15:06 +02:00
Mike Fährmann
575e5df539
[hotleak] fix AttributeError ( #5950 )
...
fixes regression introduced in 0432e057
2024-08-07 08:26:23 +02:00
Mike Fährmann
bb07313227
[deviantart] try to work around journal/status API changes ( #5916 )
...
The new /user/profile/posts endpoint is documented to
"return all journals & status updates for a given user in a single feed"
but it does not do this.
There are usually several or even all status updates missing.
2024-08-03 13:17:27 +02:00
Mike Fährmann
f87783ff26
[cien] add 'files' option ( #2885 )
2024-08-03 11:37:14 +02:00
Mike Fährmann
f68b0efc1b
[wallpapercave] support 'album' listings ( #5925 )
2024-08-02 16:13:09 +02:00
Mike Fährmann
a5be680596
[directlink] extend recognized file extensions ( #5924 )
...
bmp, svg, avif, heic, psd, pdf, m4v, mov, wav, mp3, zip, rar, 7z, swf
2024-08-02 16:13:09 +02:00
Mike Fährmann
9be7896f78
[koharu] fix 'count' for 'cbz' downloads ( #5893 )
2024-08-02 16:13:03 +02:00
Mike Fährmann
42388dc819
[tests] fix 'pattern' not being compiled before running a test
...
fixes regression introduced in 3fa74ca4
2024-08-01 12:35:01 +02:00
Mike Fährmann
c372242a06
[koharu] add 'favorite' extractor ( #5893 )
2024-08-01 12:33:18 +02:00
Mike Fährmann
2bf76461ce
[deviantart:following] use OAuth API endpoint ( #2511 )
2024-07-31 17:21:39 +02:00
Mike Fährmann
095f278d6f
[vsco] add 'include' option ( #5911 )
2024-07-31 12:32:04 +02:00
Mike Fährmann
ff58683b76
[koharu] send necessary headers for image downloads ( #5893 )
2024-07-30 19:39:50 +02:00
Mike Fährmann
399ba85841
[fallenangels] remove module
2024-07-30 17:33:16 +02:00
Mike Fährmann
84eefeebd6
[sankaku] match URLs with 'www' subdomain ( #5907 )
2024-07-30 17:05:22 +02:00
Mike Fährmann
279854cd9e
[agnph] implement 'tags' option ( #5284 )
2024-07-30 14:16:19 +02:00
Mike Fährmann
ca3e7a5e5a
[koharu] add 'date', simplify 'tags' ( #5893 )
2024-07-30 12:38:19 +02:00
Mike Fährmann
9c91935fe4
merge #5904 : [dynastyscans] extract chapter 'tags'
2024-07-29 21:17:13 +02:00
