Mike Fährmann
|
657ed93a22
|
[batoto] improve v2 manga URL pattern
and add tests
|
2024-01-07 22:23:30 +01:00 |
|
Mike Fährmann
|
33f228756a
|
[mangadex] add 'list' extractor (#5025)
supports listing manga and chapters from list feed
|
2024-01-07 02:59:35 +01:00 |
|
Mike Fährmann
|
c25bdbae91
|
[komikcast] fix 'manga' extractor (#5027)
|
2024-01-06 14:19:44 +01:00 |
|
Mike Fährmann
|
8e1a2b5446
|
[komikcast] update domain to 'komikcast.lol' (#5027)
|
2024-01-06 02:16:43 +01:00 |
|
Mike Fährmann
|
a441249ea2
|
merge #4979: [batoto] add 'chapter' and 'manga' extractors (#1434, #2111)
|
2024-01-06 01:53:26 +01:00 |
|
Mike Fährmann
|
b11c352d66
|
[bato] rename to 'batoto'
to use the same category name as the previous bato.to site
|
2024-01-06 01:49:34 +01:00 |
|
Mike Fährmann
|
3aa24c3744
|
[bato] simplify and update
|
2024-01-06 01:10:04 +01:00 |
|
Mike Fährmann
|
11150a7d72
|
[nudecollect] remove module
|
2024-01-05 21:32:04 +01:00 |
|
Mike Fährmann
|
c158927c38
|
merge #5016: [zzup] add 'gallery' extractor (#4517, #4604, #4659, #4863)
|
2024-01-05 21:25:46 +01:00 |
|
Mike Fährmann
|
217fa7f8a1
|
include 'test/results' in flake8 checks
|
2024-01-05 18:16:33 +01:00 |
|
Mike Fährmann
|
e61f016465
|
[szurubooru] support 'snootbooru.com' (#5023)
|
2024-01-05 17:56:39 +01:00 |
|
Mike Fährmann
|
b4bcf40278
|
[weibo] fix AttributeError in 'user' extractor (#5022)
yet another bug caused by a383eca7
|
2024-01-05 17:18:33 +01:00 |
|
Mike Fährmann
|
0ab0a10d2d
|
[jpgfish] update domain
|
2024-01-05 02:27:20 +01:00 |
|
enduser420
|
0f30136109
|
[zzup] add 'gallery' extractor
|
2024-01-04 21:38:59 +05:30 |
|
Mike Fährmann
|
7eaf648f2e
|
[fanbox] add 'metadata' option (#4921)
extracts 'plan' and extended 'user' metadata
|
2024-01-04 15:01:33 +01:00 |
|
Mike Fährmann
|
4f3671458e
|
[deviantart] add 'avatar' and 'background' extractors (#4995)
|
2024-01-03 00:07:55 +01:00 |
|
Mike Fährmann
|
63f649cd92
|
[idolcomplex] fix extraction & update URL patterns (#5002)
|
2024-01-01 17:38:32 +01:00 |
|
Mike Fährmann
|
7aa1c9671b
|
[tests] fix 'invalid escape sequence' warnings
|
2024-01-01 16:12:43 +01:00 |
|
Mike Fährmann
|
b6903a4c90
|
[nijie] add 'count' metadata field
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1812849102
|
2023-12-30 22:25:59 +01:00 |
|
Mike Fährmann
|
b93b351db9
|
merge #4962: [poringa] add support (#4675)
|
2023-12-30 20:39:35 +01:00 |
|
Mike Fährmann
|
9f21c839ad
|
[poringa] improvements and fixes
- add 'num' and 'count' metadata fields
- prevent crash for "private" posts
- prevent crash when there's no 'main-info'
- update tests
|
2023-12-30 20:37:09 +01:00 |
|
Mike Fährmann
|
caceb14fc2
|
[tests] fail when a results file contains syntax errors
or is otherwise not importable
|
2023-12-30 17:26:57 +01:00 |
|
Mike Fährmann
|
085411f3f1
|
[rule34] recognize URLs with 'www' subdomain (#4984)
|
2023-12-30 16:07:56 +01:00 |
|
Antonio
|
e348da7a06
|
[poringa] add support
|
2023-12-27 00:07:23 -06:00 |
|
bug-assassin
|
74c225f94e
|
[bato] add support
|
2023-12-26 22:33:33 -05:00 |
|
Mike Fährmann
|
f9544194c0
|
[paheal] restore 'extension' metadata (#4976)
|
2023-12-26 16:09:26 +01:00 |
|
Mike Fährmann
|
77d46e6f0c
|
[lynxchan] update 'bbw-chan' domain (#4970)
|
2023-12-25 15:29:05 +01:00 |
|
Mike Fährmann
|
108c978073
|
merge #4919: [postmill] add support (#4917)
|
2023-12-23 15:23:56 +01:00 |
|
Mike Fährmann
|
2a60645095
|
[deviantart] set 'is_original' for intermediary URLs to 'false'
|
2023-12-22 14:49:10 +01:00 |
|
Mike Fährmann
|
01bb75f6cb
|
merge #4945: {shimmie2[ support 'rule34hentai.net' (#861, #4789)
|
2023-12-22 00:10:26 +01:00 |
|
Mike Fährmann
|
79e4606893
|
[rule34hentai] cleanup
- fix using 'self._posts_rule34hentai'
- fix 'file_url' for posts
- update docs/supportedsites
- add tests
|
2023-12-22 00:01:36 +01:00 |
|
Mike Fährmann
|
627ed794a2
|
[danbooru] provide 'tags' as list (#4942)
keep the old 'tag_string' values around, similar to sankaku
a lot of repeat code ...
would be a lot less bad if "".split(" ") returned an empty list
|
2023-12-21 14:39:38 +01:00 |
|
Mike Fährmann
|
99aa923322
|
[inkbunny] improve '/submissionsviewall.php' patterns (#4934)
allow 'mode=…' to be in any position
don't require it to be somewhere in the middle
|
2023-12-16 19:21:20 +01:00 |
|
Mike Fährmann
|
3f9c113d78
|
[mastodon] Support non-numeric status IDs (#4936)
|
2023-12-16 01:52:31 +01:00 |
|
Mike Fährmann
|
2852404e49
|
[inkbunny] add 'unread' extractor (#4934)
|
2023-12-15 21:20:12 +01:00 |
|
Mike Fährmann
|
a37b7759bc
|
[myhentaigallery] recognize '/g/' URLs (#4920)
|
2023-12-12 20:02:28 +01:00 |
|
blankie
|
fbe14a2745
|
[postmill] add support
|
2023-12-12 21:36:52 +11:00 |
|
Mike Fährmann
|
bf74eb5c46
|
merge #4886: [urlgalleries] add 'gallery' extractor (#919, #1184, #2905)
|
2023-12-08 22:55:58 +01:00 |
|
Mike Fährmann
|
ade93c5397
|
[urlgalleries] add tests
|
2023-12-08 22:55:16 +01:00 |
|
Mike Fährmann
|
4eb3590103
|
[nijie] fix image URLs of multi-image posts (#4876)
|
2023-12-05 17:48:50 +01:00 |
|
Mike Fährmann
|
c83fbe6c2d
|
merge #4855: [nitter] fix video extraction (#4853)
|
2023-11-27 18:39:05 +01:00 |
|
Mike Fährmann
|
625e94fa7d
|
update extractor test results
still not everything, but good enough for now
|
2023-11-27 18:30:53 +01:00 |
|
enduser420
|
1e9bacd169
|
[nitter] fix video extraction
|
2023-11-27 21:58:06 +05:30 |
|
Mike Fährmann
|
bdb3ce7217
|
[foolslide] remove 'powermanga.org'
|
2023-11-26 23:19:05 +01:00 |
|
Mike Fährmann
|
f9dac43be9
|
[warosu] fix file URLs
|
2023-11-24 02:44:55 +01:00 |
|
Mike Fährmann
|
645b4627ef
|
[sankaku] update URL patterns
|
2023-11-24 02:41:52 +01:00 |
|
Mike Fährmann
|
1ae43d8123
|
merge #4841: [fapello] support '.su' TLD (#4840)
|
2023-11-22 20:18:32 +01:00 |
|
Mike Fährmann
|
e1404827a6
|
[pixeldrain] add 'file' and 'album' extractors (#4839)
|
2023-11-22 19:01:19 +01:00 |
|
enduser420
|
2402162e8a
|
[fapello] support '.su' TLD
|
2023-11-22 19:35:43 +05:30 |
|
Mike Fährmann
|
725c8dd55a
|
[tmohentai] 'categories' -> 'genres'
quite likely that the site meant 'genres' by "Genders"
|
2023-11-21 22:11:43 +01:00 |
|
Mike Fährmann
|
ce7c4cb544
|
merge #4832: [tmohentai] add 'gallery' extractor (#4808)
|
2023-11-21 20:25:49 +01:00 |
|
Mike Fährmann
|
c4a201ed42
|
[tmohentai] simplify + tests
|
2023-11-21 20:24:07 +01:00 |
|
Mike Fährmann
|
e17a48fe56
|
[blogger] inherit from BaseExtractor
- support www.micmicidol.club (#4759)
|
2023-11-21 16:52:25 +01:00 |
|
Mike Fährmann
|
0fa85360a0
|
merge #4812: [erome] add 'count' metadata field
|
2023-11-20 22:42:02 +01:00 |
|
Mike Fährmann
|
a43cf78bb7
|
[erome] tests
|
2023-11-20 22:41:12 +01:00 |
|
Mike Fährmann
|
07cb584231
|
[behance] add 'modules' option (#4799)
|
2023-11-17 22:54:38 +01:00 |
|
Mike Fährmann
|
3f591d5a4e
|
[mastodon] update test results
|
2023-11-11 21:24:07 +01:00 |
|
Mike Fährmann
|
007c433677
|
[patreon] support 'id:<campaign_id>' in place of a user name
https://patreon.com/id:12345
… and remove 'campaign-id' config option
|
2023-11-04 00:17:41 +01:00 |
|
Mike Fährmann
|
43a3d93467
|
merge #4755: [twitter] recognize fixupx.com URLs
|
2023-11-02 15:33:29 +01:00 |
|
Mike Fährmann
|
cdf77e326f
|
[twitter] add test for fixupx.com
|
2023-11-02 15:32:48 +01:00 |
|
Mike Fährmann
|
fc8f86bf24
|
[hitomi] recognize 'imageset' gallery URLs (#4756)
|
2023-11-02 15:29:44 +01:00 |
|
Mike Fährmann
|
68e72a836c
|
[exhentai] fix extraction (#4730)
- update to new API response layout
- use proper API server URL
- fix 'filesize' metadata
|
2023-10-30 13:38:49 +01:00 |
|
Mike Fährmann
|
fd8f58ad76
|
[behance] unescape embed URLs (#4742)
|
2023-10-30 13:38:49 +01:00 |
|
Mike Fährmann
|
c9a2be36d4
|
[sankaku] support '/posts/' tag search URLs (#4740)
|
2023-10-29 13:48:42 +01:00 |
|
Mike Fährmann
|
218295a4c6
|
[twitter] fix avatars without 'date' information (#4696)
|
2023-10-27 17:58:02 +02:00 |
|
Mike Fährmann
|
d0effcae20
|
[kemonoparty] add 'revision_index' metadata field (#4727)
|
2023-10-26 22:26:38 +02:00 |
|
Mike Fährmann
|
3bbaa875f1
|
[kemonoparty] fix parsing of non-standard 'dates' (#4676)
|
2023-10-26 21:50:18 +02:00 |
|
Mike Fährmann
|
a09df34bcf
|
merge #4714: [4archive] add 'thread' and 'board' extractors
(#1262, #2418, #4400, #4710)
|
2023-10-25 20:12:07 +02:00 |
|
enduser420
|
acb713b95a
|
[4archive] update
|
2023-10-25 23:08:45 +05:30 |
|
Mike Fährmann
|
6766877524
|
merge #4693: [reddit] support Reddit Mobile share links
|
2023-10-25 17:54:32 +02:00 |
|
Mike Fährmann
|
1042278bec
|
[misskey] support 'misskey.design' (#4713)
|
2023-10-25 17:47:03 +02:00 |
|
enduser420
|
c0714d5585
|
[4archive] add 'thread' and 'board' extractors
|
2023-10-24 23:05:28 +05:30 |
|
inty
|
b68aad3dab
|
[reddit] implement Reddit Mobile share links
|
2023-10-22 10:38:05 +00:00 |
|
Mike Fährmann
|
7958ab1946
|
[newgrounds] support 'imageData' files (#4642)
|
2023-10-21 13:22:55 +02:00 |
|
Mike Fährmann
|
b52fd91ac6
|
[sankaku] support '/posts/' URLs (#4688)
|
2023-10-21 13:20:35 +02:00 |
|
Mike Fährmann
|
b2c3db3e24
|
[bunkr] add extractor for media URLs (#4684)
|
2023-10-20 15:22:44 +02:00 |
|
Mike Fährmann
|
6e830ffc9e
|
[kemonoparty] support post searches (#3385, #4057)
|
2023-10-19 23:06:06 +02:00 |
|
Mike Fährmann
|
aaf539009b
|
[kemonoparty] initial support for post revisions (#4498, #4597)
- single revision
https://kemono.party/SERVICE/user/12345/post/12345/revision/12345
- all revisions
https://kemono.party/SERVICE/user/12345/post/12345/revisions
|
2023-10-19 22:32:51 +02:00 |
|
Mike Fährmann
|
174191cb79
|
[kemonoparty] restore discord pagination (#4676)
|
2023-10-19 21:57:27 +02:00 |
|
Mike Fährmann
|
c9a976d8a6
|
[kemonoparty] various updates and fixes (#4676, #4681)
- fix pagination
- fix 'date' metadata
- fix discord channel API endpoint
|
2023-10-19 17:36:16 +02:00 |
|
Mike Fährmann
|
bfdc07632a
|
[deviantart] expand nested comment replies (#4653)
|
2023-10-17 19:40:53 +02:00 |
|
Mike Fährmann
|
390d14dbcc
|
[chevereto] support 'img.kiwi' and 'deltaporno.com' (#4664, #1381)
|
2023-10-16 18:14:30 +02:00 |
|
Mike Fährmann
|
727c8eec6c
|
merge #4667: [redgifs] fix 'niches' extraction (#4666)
|
2023-10-16 14:20:01 +02:00 |
|
Mike Fährmann
|
2911ed1240
|
[chevereto] add generic extractors (#4664)
- support jpgfish
- support pixl.li / pixl.is (#3179, #4357)
|
2023-10-16 14:15:39 +02:00 |
|
enduser420
|
db3363ac0b
|
[redgifs] fix 'niches' extraction
|
2023-10-16 16:51:30 +05:30 |
|
Mike Fährmann
|
ade8347ead
|
[kemonoparty] fix DM dates
|
2023-10-15 19:54:28 +02:00 |
|
Mike Fährmann
|
6dfe200ae4
|
[kemonoparty] support discord URLs with channel IDs (#4662)
|
2023-10-15 19:45:22 +02:00 |
|
Mike Fährmann
|
c6a3892210
|
[imgbb] update username extraction (#4626)
|
2023-10-14 20:55:39 +02:00 |
|
Mike Fährmann
|
13ce3a9acb
|
[warosu] fix extraction (#4634)
|
2023-10-13 23:03:39 +02:00 |
|
Mike Fährmann
|
c4c4e4d2f4
|
[newgrounds] improve 'art-image' extraction (#4642)
- download files in original resolution
- replace .webp with extension of first file
|
2023-10-13 20:10:55 +02:00 |
|
Mike Fährmann
|
833dce141f
|
[fantia] add 'content_count' and 'content_num' metadata fields (#4627)
|
2023-10-13 20:10:55 +02:00 |
|
Mike Fährmann
|
2d41702762
|
[deviantart] implement '"group": "skip"' (#4630)
|
2023-10-12 22:14:20 +02:00 |
|
Mike Fährmann
|
a9c3442d4e
|
[deviantart] add a couple 'deactivated account' test URLs
|
2023-10-12 21:40:10 +02:00 |
|
Mike Fährmann
|
2974b8e3c8
|
[moebooru] add 'metadata' option (#4646)
for extended 'pool' metadata
|
2023-10-12 21:34:25 +02:00 |
|
Mike Fährmann
|
9a008523ac
|
[hentaifoundry] fix '.swf' file downloads (#4641)
|
2023-10-09 11:45:55 +02:00 |
|
Mike Fährmann
|
15f940819b
|
[newgrounds] support 'art-image' files (#4642)
|
2023-10-09 11:20:10 +02:00 |
|
Mike Fährmann
|
efaab4fbfa
|
[twitter] fix crash due to missing 'source' (#4620)
regression caused by 06aaedde
|
2023-10-04 23:01:04 +02:00 |
|
Mike Fährmann
|
84fbbd96aa
|
[shimmie2] remove 'meme.museum'
|
2023-10-02 20:41:25 +02:00 |
|
Mike Fährmann
|
c7bd9925d9
|
[tests] use fallback URLs for content tests (#3163)
|
2023-09-30 21:00:55 +02:00 |
|
Mike Fährmann
|
b92645cd37
|
[bunkr] fix extraction (#4514, #4532, #4529, #4540)
|
2023-09-30 18:05:12 +02:00 |
|
Mike Fährmann
|
bd3f7a5bbc
|
[tests] support one regex per URL for #pattern
|
2023-09-28 21:56:09 +02:00 |
|
Mike Fährmann
|
0c5d8b1505
|
[deviantart] re-add 'quality' option and 'intermediary' transform
|
2023-09-24 17:36:05 +02:00 |
|
Mike Fährmann
|
dbd820d7c5
|
[tests] allow checking for exact URL results
|
2023-09-24 01:52:47 +02:00 |
|
Mike Fährmann
|
1e31fce37b
|
[pillowfort] support '/tagged/' URLs (#4570)
|
2023-09-23 00:11:01 +02:00 |
|
Mike Fährmann
|
1d2fd0b831
|
[pillowfort] extract 'b2_lg_url' media (#4570)
|
2023-09-23 00:05:26 +02:00 |
|
Mike Fährmann
|
50e2ebaff0
|
[danbooru] support 'donmai.moe' URLs
|
2023-09-22 20:58:38 +02:00 |
|
Mike Fährmann
|
918ba4f847
|
[redgifs] match gfycat image URLs (#4558)
|
2023-09-22 18:02:55 +02:00 |
|
Mike Fährmann
|
2cd801232b
|
fix --range causing crashes (#4557)
regression caused by a383eca7
|
2023-09-22 16:28:20 +02:00 |
|
Mike Fährmann
|
24a1d46391
|
[mastodon] support '/@USER/following' URLs
Previously, only '/users/USER/following' got matched.
|
2023-09-13 23:42:51 +02:00 |
|
Mike Fährmann
|
65b6011cc5
|
update test/test_extractor.py
|
2023-09-11 17:20:06 +02:00 |
|
Mike Fährmann
|
a833c244c8
|
add exported extractor results
|
2023-09-10 14:45:01 +02:00 |
|