1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-25 12:12:34 +01:00
gallery-dl/gallery_dl/extractor
Mike Fährmann b069783578
[newgrounds] fix metadata extraction (#6463)
- fix 'comment' metadata
- fix 'following' extractor pattern
- use own 'type' values, since 'og:type' is no longer available
- update test results
2024-11-18 16:21:59 +01:00
..
__init__.py [bilibili] initial support (#2824) 2024-11-10 00:21:27 +02:00
2ch.py [2ch] update 2024-01-15 04:09:05 +01:00
2chan.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
2chen.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
3dbooru.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
4archive.py [4archive] fix extraction 2024-05-31 17:42:53 +02:00
4chan.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
4chanarchives.py [4chanarchives] disable Referer headers by default (#4686) 2023-10-20 17:39:50 +02:00
8chan.py [8chan] don't make network requests in '_init()' (#6387) 2024-10-27 19:36:49 +01:00
8muses.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
35photo.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
500px.py send Referer headers by default 2023-09-19 00:02:04 +02:00
adultempire.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
agnph.py [agnph] implement 'tags' option (#5284) 2024-07-30 14:16:19 +02:00
ao3.py [ao3] add 'subscriptions' extractor (#6247) 2024-09-29 13:01:51 +02:00
architizer.py [architizer] fix extraction (#4537) 2023-09-17 15:19:19 +02:00
artstation.py [artstation] disable TLS 1.2 ciphers by default (#5564, #5658) 2024-05-30 23:54:19 +02:00
aryion.py [aryion] update favorite extractor 2024-07-21 12:34:06 +02:00
batoto.py [batoto] return 'chapter_url' as string (#5562) 2024-09-05 17:47:38 +02:00
bbc.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
behance.py [dl:ytdl] implement explicit HLS/DASH handling 2024-10-16 15:16:21 +02:00
bilibili.py [bilibili] add workarounds for getting rate-limited (#6443) 2024-11-14 23:06:26 +01:00
blogger.py [blogger] remove 'micmicidol.club' 2024-10-10 14:23:58 +02:00
bluesky.py [bluesky] match fxbsky.app and vxbsky.app 2024-11-02 16:00:43 -03:00
booru.py [booru] allow multiple 'url' keys (#5859) 2024-07-17 20:49:52 +02:00
boosty.py [boosty] update default video format list (#2387) 2024-10-31 20:55:32 +01:00
bunkr.py [bunkr] support 'bunkr.cr' URLs 2024-11-10 20:43:33 +01:00
catbox.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
chevereto.py [chevereto] remove 'deltaporno.com' 2024-10-10 13:07:08 +02:00
cien.py [cien] fix extraction when authenticated (#5934) 2024-08-03 21:57:18 +02:00
civitai.py [civitai] add 'metadata' option (#6383) 2024-10-27 15:46:00 +01:00
cohost.py use 'True if COND else False' for bool conversions 2024-10-14 20:57:47 +02:00
comicvine.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
common.py [common] add 'proxy-env' option 2024-11-15 18:03:56 +01:00
cyberdrop.py [cyberdrop] fix extraction 2024-08-19 13:37:14 +02:00
danbooru.py [danbooru] add 'artist-search' extractor (#5348) 2024-11-17 16:58:54 +01:00
desktopography.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
deviantart.py allow passing cookies to OAuth extractors 2024-11-09 18:06:27 +01:00
directlink.py [directlink] extend recognized file extensions (#5924) 2024-08-02 16:13:09 +02:00
dynastyscans.py [dynastyscans] extract chapter 'tags' 2024-07-29 16:50:47 +05:30
e621.py [e621] reorder 2024-08-12 18:01:29 +02:00
erome.py [erome] extract 'date' metadata (#5796) 2024-06-27 21:07:23 +02:00
everia.py [everia] update 2024-11-03 17:51:04 +01:00
exhentai.py [exhentai] implement 'tags' option (#2117) 2024-11-15 21:47:13 +01:00
fanbox.py [fanbox] add 'comments' option, extend 'metadata' option (#6287) 2024-10-06 22:31:41 +02:00
fanleaks.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
fantia.py [fantia] simplify 'tags' to a list of strings (#4752) 2023-11-02 15:25:01 +01:00
fapachi.py [fapachi] ignore empty entries 2024-02-16 22:43:37 +01:00
fapello.py fapello.py Fullsize image 2024-03-21 18:08:18 +01:00
flickr.py [flickr] fix video download URLs (#6464) 2024-11-13 20:56:37 +01:00
foolfuuka.py use 'v[0] == "c"' instead of 'v.startswith("c")' 2024-10-15 08:24:06 +02:00
foolslide.py [foolslide] remove 'powermanga.org' 2023-11-26 23:19:05 +01:00
furaffinity.py [furaffinity] fix 'favorite' pagination (#6151) 2024-09-06 08:52:05 +02:00
fuskator.py [fuskator] make metadata extraction non-fatal (#5039) 2024-01-08 19:18:12 +01:00
gelbooru_v01.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
gelbooru_v02.py [misc] 'api_root' -> 'root_api' 2024-11-14 23:44:15 +01:00
gelbooru.py [gelbooru] improve pagination logic for meta tags (#5478) 2024-04-15 23:14:48 +02:00
generic.py [generic] ensure 'path' metadata is always defined 2024-10-10 14:06:47 +02:00
gofile.py [gofile] fix "KeyError: 'childrenIds'" (#5993) 2024-08-11 15:26:58 +02:00
hatenablog.py [hatenablog] implement additional suggestion 2024-01-13 10:43:25 +11:00
hentai2read.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hentaicosplays.py [hentaicosplays] support 'hentai-cosplay-xxx.com' (#5959) 2024-08-10 12:14:18 +02:00
hentaifoundry.py [hentaifoundry] add 'tag' extractor (#6465) 2024-11-13 20:56:37 +01:00
hentaifox.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hentaihand.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hentaihere.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hentainexus.py [hentainexus] fix error for spread pages (#5827) 2024-07-05 21:36:29 +02:00
hiperdex.py [hiperdex] update domain to 'hipertoon.com' (#6420) 2024-11-05 15:54:42 +01:00
hitomi.py [hitomi] update 2024-10-29 16:56:52 +01:00
hotleak.py [hotleak] fix AttributeError (#5950) 2024-08-07 08:26:23 +02:00
idolcomplex.py [idolcomplex] fix metadata extraction 2024-03-22 01:43:05 +01:00
imagebam.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
imagechest.py [imagechest] simplify 2024-11-16 09:17:13 +01:00
imagefap.py [imagefap] fix '{num}' in default filenames for single images 2024-10-10 13:40:50 +02:00
imagehosts.py [imagetwist] add 'gallery' extractor (#5190) 2024-02-11 18:41:02 +01:00
imgbb.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
imgbox.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
imgth.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
imgur.py [imgur] match gallery/album/image URLs with title slugs (#5593) 2024-05-17 22:44:37 +02:00
inkbunny.py [inkbunny:favorite] update test 2024-09-25 20:25:33 +02:00
instagram.py [instagram] fix using numeric cursor values (#6414) 2024-11-03 12:03:01 +01:00
issuu.py [issuu] fix extraction 2024-01-20 16:44:48 +01:00
itaku.py send Referer headers by default 2023-09-19 00:02:04 +02:00
itchio.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
jschan.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
kabeuchi.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
keenspot.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
kemonoparty.py [kemonoparty:favorite] fix exception when sorting None (#5692) 2024-06-05 16:49:30 +02:00
khinsider.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
koharu.py [koharu] implement 'tags' option 2024-11-15 23:49:58 +01:00
komikcast.py [komikcast] update domain to 'komikcast.cz' 2024-10-10 16:52:40 +02:00
lensdump.py [lensdump] fix extraction (#6313) 2024-10-24 13:59:39 +02:00
lexica.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
lightroom.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
livedoor.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
lolisafe.py [saint] add 'album' and 'media' extractors (#4405, #6324) 2024-10-27 22:27:30 +01:00
luscious.py [luscious] fix IndexError for files without thumbnail (#5122) 2024-01-28 01:43:29 +01:00
lynxchan.py [lynxchan] update 'bbw-chan' domain (#4970) 2023-12-25 15:29:05 +01:00
mangadex.py [mangadex] apply 'lang' only to chapter results (#6372) 2024-10-27 07:55:14 +01:00
mangafox.py send Referer headers by default 2023-09-19 00:02:04 +02:00
mangahere.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
mangakakalot.py use 'v[0] == "c"' instead of 'v.startswith("c")' 2024-10-15 08:24:06 +02:00
manganelo.py [manganelo] fix extraction & recognize '.to' TLDs (#5005) 2024-01-01 22:05:21 +01:00
mangapark.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
mangaread.py [mangaread] fix extraction 2023-11-25 23:53:27 +01:00
mangasee.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
mangoxo.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
mastodon.py allow passing cookies to OAuth extractors 2024-11-09 18:06:27 +01:00
message.py remove 'Message.Metadata' (#866) 2021-01-31 02:12:37 +01:00
misskey.py [misskey] support 'misskey.design' (#4713) 2023-10-25 17:47:03 +02:00
moebooru.py [moebooru] add 'metadata' option (#4646) 2023-10-12 21:34:25 +02:00
myhentaigallery.py [myhentaigallery] fix 'tags' extraction 2024-10-10 17:06:17 +02:00
myportfolio.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
naver.py [naver] unescape post 'title' and 'description' 2024-03-06 00:46:19 +01:00
naverwebtoon.py [naverwebtoon] support '/webtoon/' paths for all comics (#5123) 2024-02-04 21:38:46 +01:00
newgrounds.py [newgrounds] fix metadata extraction (#6463) 2024-11-18 16:21:59 +01:00
nhentai.py [nhentai] support ',webp' files (#6442) 2024-11-08 17:46:38 +01:00
nijie.py [nijie] fix image URLs for single image posts (#5842) 2024-07-10 15:06:25 +02:00
nitter.py [nitter] remove instances 2024-06-02 18:15:53 +02:00
noop.py [noop] add 'noop' extractor 2024-10-28 19:45:24 +01:00
nozomi.py use 'True if COND else False' for bool conversions 2024-10-14 20:57:47 +02:00
nsfwalbum.py [nsfwalbum] detect '/error.jpg' images (#4598) 2023-10-02 15:38:22 +02:00
oauth.py [oauth] prevent empty browser names 2024-10-01 08:22:50 +02:00
paheal.py [paheal] implement fast '--range' support (#5905) 2024-07-30 12:55:57 +02:00
patreon.py [patreon] use legacy mobile UA when no 'session_id' is set 2024-10-31 17:26:33 +01:00
philomena.py [philomena] switch default ponybooru filter to get everything by default 2024-11-07 20:08:42 -08:00
photovogue.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
picarto.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
piczel.py [misc] 'api_root' -> 'root_api' 2024-11-14 23:44:15 +01:00
pillowfort.py [pillowfort] provide 'count' metadata field (#6478) 2024-11-15 08:27:52 +01:00
pinterest.py [pinterest] detect video/audio by block content (#6421) 2024-11-05 15:55:24 +01:00
pixeldrain.py [pixeldrain] integrate into 'album' extractor 2024-05-25 23:42:23 +02:00
pixiv.py allow passing cookies to OAuth extractors 2024-11-09 18:06:27 +01:00
pixnet.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
plurk.py replace static 'sleep-request' defaults with dynamic ones 2023-12-18 22:06:26 +01:00
poipiku.py [poipiku] return 'count' as proper number (#6445) 2024-11-10 08:26:43 +01:00
poringa.py [poringa] improvements and fixes 2023-12-30 20:37:09 +01:00
pornhub.py [pornhub] fix KeyError when album images are missing (#6299) 2024-10-09 17:18:06 +02:00
pornpics.py [pornpics] update 'channel' extraction & add test 2024-02-13 23:48:46 +01:00
postmill.py use 'v[0] == "c"' instead of 'v.startswith("c")' 2024-10-15 08:24:06 +02:00
reactor.py replace static 'sleep-request' defaults with dynamic ones 2023-12-18 22:06:26 +01:00
readcomiconline.py [readcomiconline] update (#5866) 2024-07-23 18:56:49 +02:00
recursive.py [recursive] simplify 2023-09-13 21:47:20 +02:00
reddit.py [reddit] simplify 2024-10-28 14:44:15 +01:00
redgifs.py Update redgifs.py to include 0-9 regex 2024-07-28 02:34:17 -04:00
rule34us.py [rule34us] make 'file_url' extraction more robust (#6289) 2024-10-10 09:11:38 +02:00
rule34vault.py [rule34vault] update 2024-11-03 09:59:25 +01:00
rule34xyz.py [rule34xyz] add 'format' option (#1078) 2024-11-05 15:45:52 +01:00
saint.py [saint] add 'album' and 'media' extractors (#4405, #6324) 2024-10-27 22:27:30 +01:00
sankaku.py [sankaku] improve tag categorization code 2024-11-03 09:21:39 +01:00
sankakucomplex.py [sankakucomplex] update domain to 'news.sankakucomplex.com' 2024-07-26 20:39:55 +02:00
scrolller.py [scrolller] add initial support (#295, #3418, #5051) 2024-10-21 14:17:18 +02:00
seiga.py [seiga] re-implement login with username & password 2024-05-23 18:52:53 +02:00
senmanga.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
sexcom.py [sexcom] add 'likes' extractor (#6149) 2024-09-06 07:44:06 +02:00
shimmie2.py [shimmie2] use 'self.groups' to access matched URL values 2024-10-10 19:01:30 +02:00
shopify.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
simplyhentai.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
skeb.py [skeb] prevent 429 errors and need for 'request_key' cookie 2024-09-26 15:15:37 +02:00
slickpic.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
slideshare.py [slideshare] fix extraction 2024-05-31 21:05:50 +02:00
smugmug.py allow passing cookies to OAuth extractors 2024-11-09 18:06:27 +01:00
soundgasm.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
speakerdeck.py [speakerdeck] inherit from GalleryExtractor 2024-06-15 21:56:51 +02:00
steamgriddb.py [steamgriddb] raise proper exception for deleted assets 2024-03-22 17:53:06 +01:00
subscribestar.py Fix subscribestar date parsing in udated posts 2024-06-24 16:40:59 +02:00
szurubooru.py [bcbnsfw] use '*' as query when retrieving all posts (#6135) 2024-09-05 20:43:23 +02:00
tapas.py [tapas] add 'creator' extractor (#5306) 2024-04-11 23:41:50 +02:00
tcbscans.py [tcbscans] support other domains 2024-06-21 21:29:11 +05:30
telegraph.py use 'v[0] == "c"' instead of 'v.startswith("c")' 2024-10-15 08:24:06 +02:00
tmohentai.py [tmohentai] 'categories' -> 'genres' 2023-11-21 22:11:43 +01:00
toyhouse.py [toyhouse] fix extraction for image URLs 2024-09-02 17:15:02 +02:00
tsumino.py use 'v[0] == "c"' instead of 'v.startswith("c")' 2024-10-15 08:24:06 +02:00
tumblr.py allow passing cookies to OAuth extractors 2024-11-09 18:06:27 +01:00
tumblrgallery.py [tumblrgallery] fix file downloads (#6391) 2024-10-29 08:38:59 +01:00
twibooru.py [philomena] support downloading SVG files (#5643) 2024-06-05 16:48:51 +02:00
twitter.py [twitter] make 'source' metadata extraction non-fatal (#6472) 2024-11-14 18:59:01 +01:00
unsplash.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
uploadir.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
urlgalleries.py [urlgalleries] fix 'root' and update 'request_interval' 2024-11-10 20:28:55 +01:00
urlshortener.py add 'config_instance' method 2024-01-18 03:20:36 +01:00
vanillarock.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
vichan.py [vichan] remove 'wikieat.club' 2024-06-02 18:16:24 +02:00
vipergirls.py [vipergirls] improve 'thread' URL pattern 2024-06-29 17:38:57 +02:00
vk.py [vk] document 'offset', add '--range' support 2024-10-17 21:20:21 +02:00
vsco.py [vsco] add 'include' option (#5911) 2024-07-31 12:32:04 +02:00
wallhaven.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
wallpapercave.py [wallpapercave] support 'album' listings (#5925) 2024-08-02 16:13:09 +02:00
warosu.py [warosu] fix extraction 2024-07-26 21:09:07 +02:00
weasyl.py [weasyl:favorite] update 2024-09-25 20:02:01 +02:00
webmshare.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
webtoons.py [webtoons] extract 'episode_no' for comic results (#6439) 2024-11-08 14:19:17 +01:00
weibo.py [weibo] simplify 'livephoto' extraction (#6471) 2024-11-16 08:19:02 +01:00
wikiart.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
wikifeet.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
wikimedia.py [wikimedia] fix non-English Fandom/wiki.gg articles (#6370) 2024-10-24 13:00:02 +02:00
xhamster.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
xvideos.py [xvideos] fix galleries with more than 500 images (#5244) 2024-02-26 15:36:41 +01:00
ytdl.py [ytdl] simplify '_process_entries()' 2024-09-03 21:17:31 +02:00
zerochan.py [zerochan] improve redirect handling, add 'redirects' option (#5891) 2024-08-10 11:32:30 +02:00
zzup.py [zzup] support 'up.zzup.com' galleries (#6181) 2024-09-15 11:01:27 +02:00