1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-25 20:22:36 +01:00
gallery-dl/gallery_dl/extractor
2024-09-28 11:04:27 +02:00
..
__init__.py [civitai] add initial support (#3706, #3787, #4129, #5995) 2024-09-20 17:21:17 +02:00
2ch.py [2ch] update 2024-01-15 04:09:05 +01:00
2chan.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
2chen.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
3dbooru.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
4archive.py [4archive] fix extraction 2024-05-31 17:42:53 +02:00
4chan.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
4chanarchives.py [4chanarchives] disable Referer headers by default (#4686) 2023-10-20 17:39:50 +02:00
8chan.py [8chan] dynamically generate 'TOS' cookie name 2024-09-28 11:04:27 +02:00
8muses.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
35photo.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
500px.py send Referer headers by default 2023-09-19 00:02:04 +02:00
adultempire.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
agnph.py [agnph] implement 'tags' option (#5284) 2024-07-30 14:16:19 +02:00
ao3.py [ao3] fix bookmark extraction, support 'series' bookmarks (#6013) 2024-09-21 13:54:42 +02:00
architizer.py [architizer] fix extraction (#4537) 2023-09-17 15:19:19 +02:00
artstation.py [artstation] disable TLS 1.2 ciphers by default (#5564, #5658) 2024-05-30 23:54:19 +02:00
aryion.py [aryion] update favorite extractor 2024-07-21 12:34:06 +02:00
batoto.py [batoto] return 'chapter_url' as string (#5562) 2024-09-05 17:47:38 +02:00
bbc.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
behance.py [behance] fix video extraction (#5965) 2024-08-10 11:06:54 +02:00
blogger.py Combine lh*(-**).googleusercontent.com URL regex into one line. 2024-01-20 15:53:11 -06:00
bluesky.py [bluesky] simplify file extraction code (#6183) 2024-09-16 09:37:18 +02:00
booru.py [booru] allow multiple 'url' keys (#5859) 2024-07-17 20:49:52 +02:00
bunkr.py [bunkr] add 'tlds' option to allow URLs with all TLDs (#5875, #6017) 2024-08-24 20:45:44 +02:00
catbox.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
chevereto.py [jpgfish] update domain to 'jpg5.su' (#6231) 2024-09-26 15:23:22 +02:00
cien.py [cien] fix extraction when authenticated (#5934) 2024-08-03 21:57:18 +02:00
civitai.py [civitai] add 'nsfw' option (#3706) 2024-09-28 08:44:35 +02:00
cohost.py [cohost] Support for downloading likes 2024-09-17 12:50:59 +10:00
comicvine.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
common.py [cookies] add 'cookies-select' option 2024-09-27 10:41:26 +02:00
cyberdrop.py [cyberdrop] fix extraction 2024-08-19 13:37:14 +02:00
danbooru.py [danbooru] provide 'tags' as list (#4942) 2023-12-21 14:39:38 +01:00
desktopography.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
deviantart.py [deviantart] add 'previews' option (#3782, #6124) 2024-09-27 10:41:26 +02:00
directlink.py [directlink] extend recognized file extensions (#5924) 2024-08-02 16:13:09 +02:00
dynastyscans.py [dynastyscans] extract chapter 'tags' 2024-07-29 16:50:47 +05:30
e621.py [e621] reorder 2024-08-12 18:01:29 +02:00
erome.py [erome] extract 'date' metadata (#5796) 2024-06-27 21:07:23 +02:00
exhentai.py [exhentai] fix 'limits' (#6090) 2024-08-31 10:23:07 +02:00
fanbox.py [fanbox] fix pagination (#5949, #5951, #5956) 2024-08-07 10:16:14 +02:00
fanleaks.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
fantia.py [fantia] simplify 'tags' to a list of strings (#4752) 2023-11-02 15:25:01 +01:00
fapachi.py [fapachi] ignore empty entries 2024-02-16 22:43:37 +01:00
fapello.py fapello.py Fullsize image 2024-03-21 18:08:18 +01:00
flickr.py directly pass exception instances as 'exc_info' logger argument 2024-09-19 14:50:08 +02:00
foolfuuka.py [foolfuuka] improve 'board' pattern & support pages (#5408) 2024-04-01 22:31:25 +02:00
foolslide.py [foolslide] remove 'powermanga.org' 2023-11-26 23:19:05 +01:00
furaffinity.py [furaffinity] fix 'favorite' pagination (#6151) 2024-09-06 08:52:05 +02:00
fuskator.py [fuskator] make metadata extraction non-fatal (#5039) 2024-01-08 19:18:12 +01:00
gelbooru_v01.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
gelbooru_v02.py [gelbooru_v02] use total number of posts as end marker (#5830) 2024-07-12 22:51:46 +02:00
gelbooru.py [gelbooru] improve pagination logic for meta tags (#5478) 2024-04-15 23:14:48 +02:00
generic.py [generic] better directory formatting/md 2024-08-29 22:30:48 +02:00
gofile.py [gofile] fix "KeyError: 'childrenIds'" (#5993) 2024-08-11 15:26:58 +02:00
hatenablog.py [hatenablog] implement additional suggestion 2024-01-13 10:43:25 +11:00
hentai2read.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hentaicosplays.py [hentaicosplays] support 'hentai-cosplay-xxx.com' (#5959) 2024-08-10 12:14:18 +02:00
hentaifoundry.py [hentaifoundry] check for and update expired sessions (#4694) 2023-11-13 00:27:22 +01:00
hentaifox.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hentaihand.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hentaihere.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hentainexus.py [hentainexus] fix error for spread pages (#5827) 2024-07-05 21:36:29 +02:00
hiperdex.py [hiperdex] update domain to 'hiperdex.top' (#5635) 2024-05-24 17:13:10 +02:00
hitomi.py [hitomi] extract 'extension_original' metadata (#6049) 2024-08-18 12:56:50 +02:00
hotleak.py [hotleak] fix AttributeError (#5950) 2024-08-07 08:26:23 +02:00
idolcomplex.py [idolcomplex] fix metadata extraction 2024-03-22 01:43:05 +01:00
imagebam.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
imagechest.py [imagechest] add 'user' extractor (#5143) 2024-02-11 18:38:33 +01:00
imagefap.py Reduce default numbering to 4 digits of zero-padding. 2024-07-27 01:11:50 +00:00
imagehosts.py [imagetwist] add 'gallery' extractor (#5190) 2024-02-11 18:41:02 +01:00
imgbb.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
imgbox.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
imgth.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
imgur.py [imgur] match gallery/album/image URLs with title slugs (#5593) 2024-05-17 22:44:37 +02:00
inkbunny.py [inkbunny:favorite] update test 2024-09-25 20:25:33 +02:00
instagram.py [instagram] add 'info' as a possible 'include' value 2024-09-02 15:43:55 +02:00
issuu.py [issuu] fix extraction 2024-01-20 16:44:48 +01:00
itaku.py send Referer headers by default 2023-09-19 00:02:04 +02:00
itchio.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
jschan.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
kabeuchi.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
keenspot.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
kemonoparty.py [kemonoparty:favorite] fix exception when sorting None (#5692) 2024-06-05 16:49:30 +02:00
khinsider.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
koharu.py [koharu] improve format selection (#6088) 2024-08-29 09:33:24 +02:00
komikcast.py [komikcast] fix 'manga' extractor (#5027) 2024-01-06 14:19:44 +01:00
lensdump.py [lensdump] support more direct link formats (#5293) 2024-03-09 23:33:58 +01:00
lexica.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
lightroom.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
livedoor.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
lolisafe.py [bunkr] support 'bunkr:' URL prefix (#6017) 2024-08-14 19:00:59 +02:00
luscious.py [luscious] fix IndexError for files without thumbnail (#5122) 2024-01-28 01:43:29 +01:00
lynxchan.py [lynxchan] update 'bbw-chan' domain (#4970) 2023-12-25 15:29:05 +01:00
mangadex.py [tests] check extractor category values 2024-01-19 14:21:09 +01:00
mangafox.py send Referer headers by default 2023-09-19 00:02:04 +02:00
mangahere.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
mangakakalot.py [mangakakalot] update domain 2023-09-19 00:18:21 +02:00
manganelo.py [manganelo] fix extraction & recognize '.to' TLDs (#5005) 2024-01-01 22:05:21 +01:00
mangapark.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
mangaread.py [mangaread] fix extraction 2023-11-25 23:53:27 +01:00
mangasee.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
mangoxo.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
mastodon.py [mastodon] add support for card images 2024-05-01 16:00:07 +02:00
message.py remove 'Message.Metadata' (#866) 2021-01-31 02:12:37 +01:00
misskey.py [misskey] support 'misskey.design' (#4713) 2023-10-25 17:47:03 +02:00
moebooru.py [moebooru] add 'metadata' option (#4646) 2023-10-12 21:34:25 +02:00
myhentaigallery.py [myhentaigallery] recognize '/g/' URLs (#4920) 2023-12-12 20:02:28 +01:00
myportfolio.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
naver.py [naver] unescape post 'title' and 'description' 2024-03-06 00:46:19 +01:00
naverwebtoon.py [naverwebtoon] support '/webtoon/' paths for all comics (#5123) 2024-02-04 21:38:46 +01:00
newgrounds.py directly pass exception instances as 'exc_info' logger argument 2024-09-19 14:50:08 +02:00
nhentai.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
nijie.py [nijie] fix image URLs for single image posts (#5842) 2024-07-10 15:06:25 +02:00
nitter.py [nitter] remove instances 2024-06-02 18:15:53 +02:00
nozomi.py send Referer headers by default 2023-09-19 00:02:04 +02:00
nsfwalbum.py [nsfwalbum] detect '/error.jpg' images (#4598) 2023-10-02 15:38:22 +02:00
oauth.py improve a1bb3279, fix oauth:pixiv (#5757) 2024-06-18 16:50:04 +02:00
paheal.py [paheal] implement fast '--range' support (#5905) 2024-07-30 12:55:57 +02:00
patreon.py [patreon] fix bootstrap data extraction (#5624) 2024-05-22 00:17:49 +02:00
philomena.py [philomena] support downloading SVG files (#5643) 2024-06-05 16:48:51 +02:00
photovogue.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
picarto.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
piczel.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
pillowfort.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
pinterest.py [pinterest] fix section URLs for boards with /?# in name (#5104) 2024-02-05 15:54:06 +01:00
pixeldrain.py [pixeldrain] integrate into 'album' extractor 2024-05-25 23:42:23 +02:00
pixiv.py add alternatives for deprecated utc datetime functions 2024-09-19 20:47:05 +02:00
pixnet.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
plurk.py replace static 'sleep-request' defaults with dynamic ones 2023-12-18 22:06:26 +01:00
poipiku.py [poipiku] send LANG cookie to ensure English UI (#5590) 2024-05-17 22:59:31 +02:00
poringa.py [poringa] improvements and fixes 2023-12-30 20:37:09 +01:00
pornhub.py [pornhub:gif] extract 'viewkey' and 'timestamp' metadata (#4463) 2024-03-22 18:00:20 +01:00
pornpics.py [pornpics] update 'channel' extraction & add test 2024-02-13 23:48:46 +01:00
postmill.py [postmill] implement suggestions 2023-12-23 13:28:36 +11:00
pururin.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
reactor.py replace static 'sleep-request' defaults with dynamic ones 2023-12-18 22:06:26 +01:00
readcomiconline.py [readcomiconline] update (#5866) 2024-07-23 18:56:49 +02:00
recursive.py [recursive] simplify 2023-09-13 21:47:20 +02:00
reddit.py [docs] update docs/configuration links (#5059, #5369, #5423) 2024-04-13 02:18:44 +02:00
redgifs.py Update redgifs.py to include 0-9 regex 2024-07-28 02:34:17 -04:00
rule34us.py [rule34us] add fallback for 'video-cdn1' videos (#4985) 2023-12-30 18:33:46 +01:00
sankaku.py [sankaku] restore old 'tags' format (#6043) 2024-08-17 19:25:19 +02:00
sankakucomplex.py [sankakucomplex] update domain to 'news.sankakucomplex.com' 2024-07-26 20:39:55 +02:00
seiga.py [seiga] re-implement login with username & password 2024-05-23 18:52:53 +02:00
senmanga.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
sexcom.py [sexcom] add 'likes' extractor (#6149) 2024-09-06 07:44:06 +02:00
shimmie2.py [shimmie2] support 'vidya.pics' (#5632) 2024-06-06 15:08:56 +02:00
shopify.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
simplyhentai.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
skeb.py [skeb] prevent 429 errors and need for 'request_key' cookie 2024-09-26 15:15:37 +02:00
slickpic.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
slideshare.py [slideshare] fix extraction 2024-05-31 21:05:50 +02:00
smugmug.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
soundgasm.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
speakerdeck.py [speakerdeck] inherit from GalleryExtractor 2024-06-15 21:56:51 +02:00
steamgriddb.py [steamgriddb] raise proper exception for deleted assets 2024-03-22 17:53:06 +01:00
subscribestar.py Fix subscribestar date parsing in udated posts 2024-06-24 16:40:59 +02:00
szurubooru.py [bcbnsfw] use '*' as query when retrieving all posts (#6135) 2024-09-05 20:43:23 +02:00
tapas.py [tapas] add 'creator' extractor (#5306) 2024-04-11 23:41:50 +02:00
tcbscans.py [tcbscans] support other domains 2024-06-21 21:29:11 +05:30
telegraph.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
tmohentai.py [tmohentai] 'categories' -> 'genres' 2023-11-21 22:11:43 +01:00
toyhouse.py [toyhouse] fix extraction for image URLs 2024-09-02 17:15:02 +02:00
tsumino.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
tumblr.py [tumblr] fix 401 Unauthorized for likes when using api-key (#5994) 2024-08-12 09:09:59 +02:00
tumblrgallery.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
twibooru.py [philomena] support downloading SVG files (#5643) 2024-06-05 16:48:51 +02:00
twitter.py [twitter] add 'info' as a possible 'include' value (#6114) 2024-08-31 17:04:22 +02:00
unsplash.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
uploadir.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
urlgalleries.py [urlgalleries] simplify + resolve redirects 2023-12-08 22:43:56 +01:00
urlshortener.py add 'config_instance' method 2024-01-18 03:20:36 +01:00
vanillarock.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
vichan.py [vichan] remove 'wikieat.club' 2024-06-02 18:16:24 +02:00
vipergirls.py [vipergirls] improve 'thread' URL pattern 2024-06-29 17:38:57 +02:00
vk.py [vk] transform image URLs to non-blurred versions (#5017) 2024-01-07 00:19:10 +01:00
vsco.py [vsco] add 'include' option (#5911) 2024-07-31 12:32:04 +02:00
wallhaven.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
wallpapercave.py [wallpapercave] support 'album' listings (#5925) 2024-08-02 16:13:09 +02:00
warosu.py [warosu] fix extraction 2024-07-26 21:09:07 +02:00
weasyl.py [weasyl:favorite] update 2024-09-25 20:02:01 +02:00
webmshare.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
webtoons.py [webtoons] fix extracting comic and episode name with commas 2024-01-21 09:50:27 +11:00
weibo.py [weibo] rework pagination logic (#4168) 2024-03-14 00:06:25 +01:00
wikiart.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
wikifeet.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
wikimedia.py [wikimedia] probe possible API endpoints when none is defined 2024-09-07 20:11:44 +02:00
xhamster.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
xvideos.py [xvideos] fix galleries with more than 500 images (#5244) 2024-02-26 15:36:41 +01:00
ytdl.py [ytdl] simplify '_process_entries()' 2024-09-03 21:17:31 +02:00
zerochan.py [zerochan] improve redirect handling, add 'redirects' option (#5891) 2024-08-10 11:32:30 +02:00
zzup.py [zzup] support 'up.zzup.com' galleries (#6181) 2024-09-15 11:01:27 +02:00