1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-25 20:22:36 +01:00
gallery-dl/gallery_dl/extractor
Mike Fährmann 0abd9723af
[bluesky] add 'metadata' option (#4438)
allow extracting 'user' metadata and
make 'facets' extraction optional
2024-02-15 23:30:16 +01:00
..
__init__.py [bluesky] initial support (#4438, #4708, #4722, #5047) 2024-02-07 19:09:33 +01:00
2ch.py [2ch] update 2024-01-15 04:09:05 +01:00
2chan.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
2chen.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
3dbooru.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
4archive.py [4archive] update 2023-10-25 23:08:45 +05:30
4chan.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
4chanarchives.py [4chanarchives] disable Referer headers by default (#4686) 2023-10-20 17:39:50 +02:00
8chan.py send Referer headers by default 2023-09-19 00:02:04 +02:00
8muses.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
35photo.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
500px.py send Referer headers by default 2023-09-19 00:02:04 +02:00
adultempire.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
architizer.py [architizer] fix extraction (#4537) 2023-09-17 15:19:19 +02:00
artstation.py send Referer headers by default 2023-09-19 00:02:04 +02:00
aryion.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
batoto.py [batoto] support more mirror domains (#5042) 2024-01-09 18:02:49 +01:00
bbc.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
behance.py [behance] add 'modules' option (#4799) 2023-11-17 22:54:38 +01:00
blogger.py Combine lh*(-**).googleusercontent.com URL regex into one line. 2024-01-20 15:53:11 -06:00
bluesky.py [bluesky] add 'metadata' option (#4438) 2024-02-15 23:30:16 +01:00
booru.py [booru] add 'url' option 2023-01-13 16:32:32 +01:00
bunkr.py [bunkr] fix extraction (#5088, #5151, #5153) 2024-02-11 22:36:03 +01:00
catbox.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
chevereto.py [chevereto] remove 'pixl.li' 2024-01-20 02:21:40 +01:00
comicvine.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
common.py add 'config_instance' method 2024-01-18 03:20:36 +01:00
cyberdrop.py [cyberdrop] update to site layout changes 2023-11-26 18:03:13 +01:00
danbooru.py [danbooru] provide 'tags' as list (#4942) 2023-12-21 14:39:38 +01:00
desktopography.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
deviantart.py [deviantart] combine 'png' option with 'quality' (#4846) 2024-02-14 22:07:29 +01:00
directlink.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
dynastyscans.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
e621.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
erome.py [erome] fix 'count' metadata 2024-01-20 00:26:41 +01:00
exhentai.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
fallenangels.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
fanbox.py [fanbox] add 'home' and 'supporting' extractors (#5138) 2024-02-14 23:25:39 +01:00
fanleaks.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
fantia.py [fantia] simplify 'tags' to a list of strings (#4752) 2023-11-02 15:25:01 +01:00
fapachi.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
fapello.py [fapello] support '.su' TLD 2023-11-22 19:35:43 +05:30
flickr.py [flickr] handle non-JSON errors (#5131) 2024-02-06 21:22:10 +01:00
foolfuuka.py [archivedmoe] fix thebarchive webm URLs (#5116) 2024-01-27 00:24:41 +01:00
foolslide.py [foolslide] remove 'powermanga.org' 2023-11-26 23:19:05 +01:00
furaffinity.py fix --range causing crashes (#4557) 2023-09-22 16:28:20 +02:00
fuskator.py [fuskator] make metadata extraction non-fatal (#5039) 2024-01-08 19:18:12 +01:00
gelbooru_v01.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
gelbooru_v02.py [realbooru] fix extraction 2024-01-20 17:56:07 +01:00
gelbooru.py [gelbooru] support 'all' and empty tag (#5076) 2024-01-18 21:49:33 +01:00
generic.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
gofile.py [gofile] update 'website_token' extraction 2024-01-27 01:10:14 +01:00
hatenablog.py [hatenablog] implement additional suggestion 2024-01-13 10:43:25 +11:00
hentai2read.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hentaicosplays.py [hentaicosplays] force 'https://' for download URLs 2023-11-26 02:08:12 +01:00
hentaifoundry.py [hentaifoundry] check for and update expired sessions (#4694) 2023-11-13 00:27:22 +01:00
hentaifox.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hentaihand.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hentaihere.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hiperdex.py [hiperdex] fix 'manga' metadata 2023-11-26 01:24:42 +01:00
hitomi.py [hitomi] recognize 'imageset' gallery URLs (#4756) 2023-11-02 15:29:44 +01:00
hotleak.py send Referer headers by default 2023-09-19 00:02:04 +02:00
idolcomplex.py [idolcomplex] fix pagination for tags containing ':' (#5171) 2024-02-09 17:51:08 +01:00
imagebam.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
imagechest.py [imagechest] add 'user' extractor (#5143) 2024-02-11 18:38:33 +01:00
imagefap.py [imagefap] fix single image resolution 2023-11-26 00:30:52 +01:00
imagehosts.py [imagetwist] add 'gallery' extractor (#5190) 2024-02-11 18:41:02 +01:00
imgbb.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
imgbox.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
imgth.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
imgur.py send Referer headers by default 2023-09-19 00:02:04 +02:00
inkbunny.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
instagram.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
issuu.py [issuu] fix extraction 2024-01-20 16:44:48 +01:00
itaku.py send Referer headers by default 2023-09-19 00:02:04 +02:00
itchio.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
jschan.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
kabeuchi.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
keenspot.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
kemonoparty.py [kemonoparty] add 'posts' extractor (#5194) 2024-02-13 15:41:34 +01:00
khinsider.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
komikcast.py [komikcast] fix 'manga' extractor (#5027) 2024-01-06 14:19:44 +01:00
lensdump.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
lexica.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
lightroom.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
livedoor.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
lolisafe.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
luscious.py [luscious] fix IndexError for files without thumbnail (#5122) 2024-01-28 01:43:29 +01:00
lynxchan.py [lynxchan] update 'bbw-chan' domain (#4970) 2023-12-25 15:29:05 +01:00
mangadex.py [tests] check extractor category values 2024-01-19 14:21:09 +01:00
mangafox.py send Referer headers by default 2023-09-19 00:02:04 +02:00
mangahere.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
mangakakalot.py [mangakakalot] update domain 2023-09-19 00:18:21 +02:00
manganelo.py [manganelo] fix extraction & recognize '.to' TLDs (#5005) 2024-01-01 22:05:21 +01:00
mangapark.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
mangaread.py [mangaread] fix extraction 2023-11-25 23:53:27 +01:00
mangasee.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
mangoxo.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
mastodon.py add 'config_instance' method 2024-01-18 03:20:36 +01:00
message.py remove 'Message.Metadata' (#866) 2021-01-31 02:12:37 +01:00
misskey.py [misskey] support 'misskey.design' (#4713) 2023-10-25 17:47:03 +02:00
moebooru.py [moebooru] add 'metadata' option (#4646) 2023-10-12 21:34:25 +02:00
myhentaigallery.py [myhentaigallery] recognize '/g/' URLs (#4920) 2023-12-12 20:02:28 +01:00
myportfolio.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
naver.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
naverwebtoon.py [naverwebtoon] support '/webtoon/' paths for all comics (#5123) 2024-02-04 21:38:46 +01:00
newgrounds.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
nhentai.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
nijie.py [nijie] fix image URL for single image posts (#5049) 2024-01-11 05:07:38 +01:00
nitter.py [nitter] remove 'nitter.lacontrevoie.fr' 2024-01-19 19:34:16 +01:00
nozomi.py send Referer headers by default 2023-09-19 00:02:04 +02:00
nsfwalbum.py [nsfwalbum] detect '/error.jpg' images (#4598) 2023-10-02 15:38:22 +02:00
oauth.py add 'config_instance' method 2024-01-18 03:20:36 +01:00
paheal.py [paheal] fix 'source' metadata 2024-01-19 22:24:39 +01:00
patreon.py [patreon] prevent HttpError for stream.mux.com URLs 2024-01-21 22:50:40 +01:00
philomena.py add 'config_instance' method 2024-01-18 03:20:36 +01:00
photobucket.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
photovogue.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
picarto.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
piczel.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
pillowfort.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
pinterest.py [pinterest] fix section URLs for boards with /?# in name (#5104) 2024-02-05 15:54:06 +01:00
pixeldrain.py use custom HTTPBasicAuth class 2023-12-07 01:40:31 +01:00
pixiv.py modify useragent of pixiv 2024-01-06 23:15:15 +09:00
pixnet.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
plurk.py replace static 'sleep-request' defaults with dynamic ones 2023-12-18 22:06:26 +01:00
poipiku.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
poringa.py [poringa] improvements and fixes 2023-12-30 20:37:09 +01:00
pornhub.py [pornhub] fix 'user' metadata for gifs 2023-11-26 23:52:24 +01:00
pornpics.py [pornpics] update 'channel' extraction & add test 2024-02-13 23:48:46 +01:00
postmill.py [postmill] implement suggestions 2023-12-23 13:28:36 +11:00
pururin.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
reactor.py replace static 'sleep-request' defaults with dynamic ones 2023-12-18 22:06:26 +01:00
readcomiconline.py replace static 'sleep-request' defaults with dynamic ones 2023-12-18 22:06:26 +01:00
recursive.py [recursive] simplify 2023-09-13 21:47:20 +02:00
reddit.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
redgifs.py [redgifs] fix 'niches' extraction 2023-10-16 16:51:30 +05:30
rule34us.py [rule34us] add fallback for 'video-cdn1' videos (#4985) 2023-12-30 18:33:46 +01:00
sankaku.py [sankaku] add 'id-format' option (#5073) 2024-01-26 17:56:08 +01:00
sankakucomplex.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
seiga.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
senmanga.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
sexcom.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
shimmie2.py [giantessbooru] update domain 2024-01-19 14:21:56 +01:00
shopify.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
simplyhentai.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
skeb.py [skeb] rename 'data' -> 'file' & add tests 2024-02-10 19:35:50 +01:00
slickpic.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
slideshare.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
smugmug.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
soundgasm.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
speakerdeck.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
steamgriddb.py [steamgriddb] implement another suggestion 2024-01-13 10:12:15 +11:00
subscribestar.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
szurubooru.py [szurubooru] support 'snootbooru.com' (#5023) 2024-01-05 17:56:39 +01:00
tapas.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
tcbscans.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
telegraph.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
test.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
tmohentai.py [tmohentai] 'categories' -> 'genres' 2023-11-21 22:11:43 +01:00
toyhouse.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
tsumino.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
tumblr.py [tumblr] fix exception after waiting for rate limit (#4916) 2023-12-12 19:14:06 +01:00
tumblrgallery.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
twibooru.py replace static 'sleep-request' defaults with dynamic ones 2023-12-18 22:06:26 +01:00
twitter.py [twitter] support communities (#4913) 2024-02-13 01:30:23 +01:00
unsplash.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
uploadir.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
urlgalleries.py [urlgalleries] simplify + resolve redirects 2023-12-08 22:43:56 +01:00
urlshortener.py add 'config_instance' method 2024-01-18 03:20:36 +01:00
vanillarock.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
vichan.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
vipergirls.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
vk.py [vk] transform image URLs to non-blurred versions (#5017) 2024-01-07 00:19:10 +01:00
vsco.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
wallhaven.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
wallpapercave.py [wallpapercave] fix extraction 2023-11-24 21:54:21 +01:00
warosu.py [warosu] fix file URLs 2023-11-24 02:44:55 +01:00
weasyl.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
webmshare.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
webtoons.py [webtoons] fix extracting comic and episode name with commas 2024-01-21 09:50:27 +11:00
weibo.py [weibo] add 'gifs' option (#5183) 2024-02-10 18:17:07 +01:00
wikiart.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
wikifeet.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
wikimedia.py [wikimedia] combine most wikimedia.org sites (#1443) 2024-02-10 03:00:58 +01:00
xhamster.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
xvideos.py [xvideos] fix metadata extraction 2023-11-24 21:27:19 +01:00
ytdl.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
zerochan.py [zerochan] fix skipping every other post 2024-02-15 02:51:01 +01:00
zzup.py [zzup] add 'gallery' extractor 2024-01-04 21:38:59 +05:30