1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-26 04:32:51 +01:00
gallery-dl/gallery_dl/extractor
Mike Fährmann 9e5d65fbf3
[twitter] improve username & password login procedure (#5445)
- handle more subtasks
- support 2FA
- support email verification codes
2024-04-16 01:25:04 +02:00
..
__init__.py remove extractor/test.py (#4504) 2024-02-27 01:37:57 +01:00
2ch.py [2ch] update 2024-01-15 04:09:05 +01:00
2chan.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
2chen.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
3dbooru.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
4archive.py [4archive] update 2023-10-25 23:08:45 +05:30
4chan.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
4chanarchives.py [4chanarchives] disable Referer headers by default (#4686) 2023-10-20 17:39:50 +02:00
8chan.py send Referer headers by default 2023-09-19 00:02:04 +02:00
8muses.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
35photo.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
500px.py send Referer headers by default 2023-09-19 00:02:04 +02:00
adultempire.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
architizer.py [architizer] fix extraction (#4537) 2023-09-17 15:19:19 +02:00
artstation.py [artstation] support video clips (#2566, #3309, #3911) 2024-03-03 18:00:45 +01:00
aryion.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
batoto.py [batoto] fix crash when manga/chapter contains a '-' (#5200) 2024-02-16 00:10:08 +01:00
bbc.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
behance.py [behance] add 'modules' option (#4799) 2023-11-17 22:54:38 +01:00
blogger.py Combine lh*(-**).googleusercontent.com URL regex into one line. 2024-01-20 15:53:11 -06:00
bluesky.py [bluesky] add 'instance' metadata field (#4438) 2024-03-18 17:36:16 +01:00
booru.py [booru] add 'url' option 2023-01-13 16:32:32 +01:00
bunkr.py [bunkr] remove 'description' metadata 2024-03-22 02:14:41 +01:00
catbox.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
chevereto.py [chevereto] remove 'pixl.li' 2024-01-20 02:21:40 +01:00
comicvine.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
common.py [common] add Extractor.input() method 2024-04-16 00:02:48 +02:00
cyberdrop.py [cyberdrop] update to site layout changes 2023-11-26 18:03:13 +01:00
danbooru.py [danbooru] provide 'tags' as list (#4942) 2023-12-21 14:39:38 +01:00
desktopography.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
deviantart.py [docs] update docs/configuration links (#5059, #5369, #5423) 2024-04-13 02:18:44 +02:00
directlink.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
dynastyscans.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
e621.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
erome.py [erome] fix 'count' metadata 2024-01-20 00:26:41 +01:00
exhentai.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
fallenangels.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
fanbox.py [fanbox] add 'home' and 'supporting' extractors (#5138) 2024-02-14 23:25:39 +01:00
fanleaks.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
fantia.py [fantia] simplify 'tags' to a list of strings (#4752) 2023-11-02 15:25:01 +01:00
fapachi.py [fapachi] ignore empty entries 2024-02-16 22:43:37 +01:00
fapello.py fapello.py Fullsize image 2024-03-21 18:08:18 +01:00
flickr.py [flickr] add 'contexts' option (#5324) 2024-03-18 17:36:16 +01:00
foolfuuka.py [foolfuuka] improve 'board' pattern & support pages (#5408) 2024-04-01 22:31:25 +02:00
foolslide.py [foolslide] remove 'powermanga.org' 2023-11-26 23:19:05 +01:00
furaffinity.py fix --range causing crashes (#4557) 2023-09-22 16:28:20 +02:00
fuskator.py [fuskator] make metadata extraction non-fatal (#5039) 2024-01-08 19:18:12 +01:00
gelbooru_v01.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
gelbooru_v02.py [realbooru] fix extraction 2024-01-20 17:56:07 +01:00
gelbooru.py [gelbooru] improve pagination logic for meta tags (#5478) 2024-04-15 23:14:48 +02:00
generic.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
gofile.py [gofile] fix extraction 2024-03-15 20:34:54 +01:00
hatenablog.py [hatenablog] implement additional suggestion 2024-01-13 10:43:25 +11:00
hentai2read.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hentaicosplays.py [hentaicosplays] force 'https://' for download URLs 2023-11-26 02:08:12 +01:00
hentaifoundry.py [hentaifoundry] check for and update expired sessions (#4694) 2023-11-13 00:27:22 +01:00
hentaifox.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hentaihand.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hentaihere.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
hiperdex.py [hiperdex] update URL patterns & fix 'manga' metadata (#5340) 2024-03-18 17:36:16 +01:00
hitomi.py [hitomi] recognize 'imageset' gallery URLs (#4756) 2023-11-02 15:29:44 +01:00
hotleak.py send Referer headers by default 2023-09-19 00:02:04 +02:00
idolcomplex.py [idolcomplex] fix metadata extraction 2024-03-22 01:43:05 +01:00
imagebam.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
imagechest.py [imagechest] add 'user' extractor (#5143) 2024-02-11 18:38:33 +01:00
imagefap.py Fix imagefap extrcator 2024-03-15 23:44:25 +01:00
imagehosts.py [imagetwist] add 'gallery' extractor (#5190) 2024-02-11 18:41:02 +01:00
imgbb.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
imgbox.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
imgth.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
imgur.py [imgur] fail downloads when redirected to 'removed.png' (#5308) 2024-03-09 23:35:23 +01:00
inkbunny.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
instagram.py [instagram] change 'posts are private' exception to a warning (#5322) 2024-03-12 18:58:15 +01:00
issuu.py [issuu] fix extraction 2024-01-20 16:44:48 +01:00
itaku.py send Referer headers by default 2023-09-19 00:02:04 +02:00
itchio.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
jschan.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
kabeuchi.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
keenspot.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
kemonoparty.py [kemonoparty] fix crash on posts with missing datetime info (#5422) 2024-04-05 00:25:23 +02:00
khinsider.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
komikcast.py [komikcast] fix 'manga' extractor (#5027) 2024-01-06 14:19:44 +01:00
lensdump.py [lensdump] support more direct link formats (#5293) 2024-03-09 23:33:58 +01:00
lexica.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
lightroom.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
livedoor.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
lolisafe.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
luscious.py [luscious] fix IndexError for files without thumbnail (#5122) 2024-01-28 01:43:29 +01:00
lynxchan.py [lynxchan] update 'bbw-chan' domain (#4970) 2023-12-25 15:29:05 +01:00
mangadex.py [tests] check extractor category values 2024-01-19 14:21:09 +01:00
mangafox.py send Referer headers by default 2023-09-19 00:02:04 +02:00
mangahere.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
mangakakalot.py [mangakakalot] update domain 2023-09-19 00:18:21 +02:00
manganelo.py [manganelo] fix extraction & recognize '.to' TLDs (#5005) 2024-01-01 22:05:21 +01:00
mangapark.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
mangaread.py [mangaread] fix extraction 2023-11-25 23:53:27 +01:00
mangasee.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
mangoxo.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
mastodon.py [mastodon] fix handling null 'moved' account field 2024-03-12 11:44:25 +11:00
message.py remove 'Message.Metadata' (#866) 2021-01-31 02:12:37 +01:00
misskey.py [misskey] support 'misskey.design' (#4713) 2023-10-25 17:47:03 +02:00
moebooru.py [moebooru] add 'metadata' option (#4646) 2023-10-12 21:34:25 +02:00
myhentaigallery.py [myhentaigallery] recognize '/g/' URLs (#4920) 2023-12-12 20:02:28 +01:00
myportfolio.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
naver.py [naver] unescape post 'title' and 'description' 2024-03-06 00:46:19 +01:00
naverwebtoon.py [naverwebtoon] support '/webtoon/' paths for all comics (#5123) 2024-02-04 21:38:46 +01:00
newgrounds.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
nhentai.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
nijie.py [nijie] increase default delay between requests (#5221) 2024-02-20 18:19:49 +01:00
nitter.py [nitter] ignore invalid Tweets (#5253) 2024-02-29 16:31:37 +01:00
nozomi.py send Referer headers by default 2023-09-19 00:02:04 +02:00
nsfwalbum.py [nsfwalbum] detect '/error.jpg' images (#4598) 2023-10-02 15:38:22 +02:00
oauth.py [oauth] use Extractor.request() for HTTP requests (#5433) 2024-04-04 20:51:54 +02:00
paheal.py [paheal] cleanup 2024-02-27 02:27:20 +01:00
patreon.py [patreon] prevent HttpError for stream.mux.com URLs 2024-01-21 22:50:40 +01:00
philomena.py add 'config_instance' method 2024-01-18 03:20:36 +01:00
photobucket.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
photovogue.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
picarto.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
piczel.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
pillowfort.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
pinterest.py [pinterest] fix section URLs for boards with /?# in name (#5104) 2024-02-05 15:54:06 +01:00
pixeldrain.py use custom HTTPBasicAuth class 2023-12-07 01:40:31 +01:00
pixiv.py [pixiv:novel] add 'covers' option (#5373) 2024-04-11 22:27:49 +02:00
pixnet.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
plurk.py replace static 'sleep-request' defaults with dynamic ones 2023-12-18 22:06:26 +01:00
poipiku.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
poringa.py [poringa] improvements and fixes 2023-12-30 20:37:09 +01:00
pornhub.py [pornhub:gif] extract 'viewkey' and 'timestamp' metadata (#4463) 2024-03-22 18:00:20 +01:00
pornpics.py [pornpics] update 'channel' extraction & add test 2024-02-13 23:48:46 +01:00
postmill.py [postmill] implement suggestions 2023-12-23 13:28:36 +11:00
pururin.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
reactor.py replace static 'sleep-request' defaults with dynamic ones 2023-12-18 22:06:26 +01:00
readcomiconline.py [common] add Extractor.input() method 2024-04-16 00:02:48 +02:00
recursive.py [recursive] simplify 2023-09-13 21:47:20 +02:00
reddit.py [docs] update docs/configuration links (#5059, #5369, #5423) 2024-04-13 02:18:44 +02:00
redgifs.py [redgifs] make 'date' available for directories (#5262) 2024-03-01 23:39:16 +01:00
rule34us.py [rule34us] add fallback for 'video-cdn1' videos (#4985) 2023-12-30 18:33:46 +01:00
sankaku.py [sankaku] add 'id-format' option (#5073) 2024-01-26 17:56:08 +01:00
sankakucomplex.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
seiga.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
senmanga.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
sexcom.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
shimmie2.py [giantessbooru] update domain 2024-01-19 14:21:56 +01:00
shopify.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
simplyhentai.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
skeb.py [skeb] add extractor for followed users (#5290) 2024-03-06 22:43:01 +01:00
slickpic.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
slideshare.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
smugmug.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
soundgasm.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
speakerdeck.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
steamgriddb.py [steamgriddb] raise proper exception for deleted assets 2024-03-22 17:53:06 +01:00
subscribestar.py [subscribestar] fix 'date' metadata 2024-03-22 00:45:09 +01:00
szurubooru.py [szurubooru] support 'snootbooru.com' (#5023) 2024-01-05 17:56:39 +01:00
tapas.py [tapas] add 'creator' extractor (#5306) 2024-04-11 23:41:50 +02:00
tcbscans.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
telegraph.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
tmohentai.py [tmohentai] 'categories' -> 'genres' 2023-11-21 22:11:43 +01:00
toyhouse.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
tsumino.py replace '24*3600' with '86400' 2023-12-18 23:57:22 +01:00
tumblr.py [docs] update docs/configuration links (#5059, #5369, #5423) 2024-04-13 02:18:44 +02:00
tumblrgallery.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
twibooru.py replace static 'sleep-request' defaults with dynamic ones 2023-12-18 22:06:26 +01:00
twitter.py [twitter] improve username & password login procedure (#5445) 2024-04-16 01:25:04 +02:00
unsplash.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
uploadir.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
urlgalleries.py [urlgalleries] simplify + resolve redirects 2023-12-08 22:43:56 +01:00
urlshortener.py add 'config_instance' method 2024-01-18 03:20:36 +01:00
vanillarock.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
vichan.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
vipergirls.py [vipergirls] add 'domain' option (#4166) 2024-03-18 17:36:16 +01:00
vk.py [vk] transform image URLs to non-blurred versions (#5017) 2024-01-07 00:19:10 +01:00
vsco.py [vsco] add 'spaces' extractor (#5202) 2024-02-17 18:20:48 +01:00
wallhaven.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
wallpapercave.py [wallpapercave] fix extraction 2023-11-24 21:54:21 +01:00
warosu.py [warosu] fix 'board_name' metadata 2024-03-06 01:28:47 +01:00
weasyl.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
webmshare.py fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
webtoons.py [webtoons] fix extracting comic and episode name with commas 2024-01-21 09:50:27 +11:00
weibo.py [weibo] rework pagination logic (#4168) 2024-03-14 00:06:25 +01:00
wikiart.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
wikifeet.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
wikimedia.py [wikimedia] support wiki.gg wikis 2024-04-09 19:24:01 +02:00
xhamster.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
xvideos.py [xvideos] fix galleries with more than 500 images (#5244) 2024-02-26 15:36:41 +01:00
ytdl.py remove test results in extractor modules 2023-09-11 16:30:55 +02:00
zerochan.py [zerochan] use API by default (#3669) 2024-02-25 00:36:14 +01:00
zzup.py [zzup] add 'gallery' extractor 2024-01-04 21:38:59 +05:30