1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-24 03:32:33 +01:00
gallery-dl/gallery_dl/extractor
Mike Fährmann 036a40943a
[twitter] don't cache results of 'user_by_screen_name()'
A 'keyarg=1' argument to the memcache decorator would have worked as
well, but keeping the user object in memory isn't useful for the vast
majority of use cases and only wastes space.

(closes #817)
2020-06-10 20:58:42 +02:00
..
__init__.py [webtoons] Add a new extractor for webtoons.com (#761) 2020-05-18 19:04:20 +02:00
2chan.py [2chan] fix metadata extraction 2019-12-03 17:01:11 +01:00
3dbooru.py update extractor test results 2020-02-27 22:15:40 +01:00
4chan.py [4chan] add extractor for entire boards (closes #510) 2019-12-09 20:36:05 +01:00
8kun.py [8kun] adjust URL pattern 2020-02-11 19:00:13 +01:00
8muses.py add tests for specific datetime values 2020-02-23 16:48:30 +01:00
35photo.py [35photo] add 'tag' extractor 2020-03-24 02:49:00 +01:00
500px.py [500px] match 'web.500px.com' subdomains 2020-04-26 22:17:20 +02:00
adultempire.py update extractor class hierarchies 2019-10-16 18:15:29 +02:00
artstation.py [artstation] improve embed extraction (#720) 2020-04-30 21:25:03 +02:00
aryion.py [aryion] support downloading from folders (fixes #694) 2020-04-18 01:25:54 +02:00
bcy.py [bcy] reduce requests to '/item/detail/<id>' (#613) 2020-03-04 01:37:51 +01:00
behance.py [behance] get images from 'media_collection' modules 2019-11-27 01:04:33 +01:00
blogger.py update test results 2020-05-02 21:13:00 +02:00
bobx.py [bobx] set generated session cookie (closes #482) 2019-11-25 20:04:11 +01:00
booru.py [gelbooru] improve post ID extraction for pools 2020-04-22 21:28:18 +02:00
common.py move dump_response() into a separate function (#737) 2020-05-25 22:21:58 +02:00
danbooru.py [danbooru] change default for 'ugoira' to 'false' 2020-05-20 19:57:28 +02:00
deviantart.py [deviantart] don't add journal text to description (#712) 2020-06-05 21:56:12 +02:00
directlink.py [directlink] send Referer headers (closes #536) 2019-12-25 17:17:07 +01:00
dynastyscans.py miscellaneous fixes and adjustments 2019-08-01 22:09:43 +02:00
e621.py [e621] derive from Danbooru extractors (#651) 2020-03-22 21:08:45 +01:00
exhentai.py [exhentai] restrict default directory name length (#545) 2019-12-27 21:29:00 +01:00
fallenangels.py [luscious] fix tag extraction 2019-05-14 17:35:52 +02:00
flickr.py update extractor test results 2020-02-16 21:48:46 +01:00
foolfuuka.py update test results 2020-01-01 16:05:38 +01:00
foolslide.py [sensescans] use https:// 2020-06-05 21:55:19 +02:00
furaffinity.py [furaffinity] add 'following' extractor (#515) 2020-04-17 22:18:39 +02:00
fuskator.py update extractor class hierarchies 2019-10-16 18:15:29 +02:00
gelbooru.py [gelbooru] simplify and fix pool extraction 2020-05-18 19:04:51 +02:00
gfycat.py [gfycat] include title in default filenames (closes #434) 2019-10-02 21:46:01 +02:00
hbrowse.py update test results 2019-11-30 23:59:32 +01:00
hentai2read.py change results of text.nameext_from_url() 2019-02-14 16:07:17 +01:00
hentaicafe.py update extractor class hierarchies 2019-10-16 18:15:29 +02:00
hentaifoundry.py add tests for specific datetime values 2020-02-23 16:48:30 +01:00
hentaifox.py [hentaifox] fix extraction 2019-12-02 22:21:45 +01:00
hentaihand.py [hentaihand] add extractors (closes #605) 2020-02-19 21:55:47 +01:00
hentaihere.py change results of text.nameext_from_url() 2019-02-14 16:07:17 +01:00
hentainexus.py [hentainexus] fix flake8 issues (#787) 2020-05-28 22:45:08 +02:00
hiperdex.py update extractor test results 2020-05-28 02:18:06 +02:00
hitomi.py [hitomi] add extractor for tag searches (closes #697) 2020-04-20 21:55:19 +02:00
hypnohub.py [reddit] fix 'extractor.blacklist()' arguments 2019-09-24 23:01:12 +02:00
idolcomplex.py simplify extractor constants 2019-02-08 13:45:40 +01:00
imagebam.py [imagebam] update URL test results 2019-08-07 21:47:44 +02:00
imagechest.py [imagechest] simplify code (#750) 2020-05-18 19:11:26 +02:00
imagefap.py [imagefap] generalize URL patterns and add tests (#552) 2020-01-02 14:26:18 +01:00
imagehosts.py [imagetwist] replace test image 2019-12-22 22:13:13 +01:00
imgbb.py [imgbb] improve redirect handling 2020-04-20 23:36:57 +02:00
imgbox.py change results of text.nameext_from_url() 2019-02-14 16:07:17 +01:00
imgth.py [imgth] fix image URLs 2019-09-19 14:56:48 +02:00
imgur.py [imgur] treat 't/unmuted' URLs as galleries 2020-05-25 22:21:57 +02:00
instagram.py [instagram] fix and re-enable login with username&password 2020-05-31 00:29:09 +02:00
issuu.py add tests for specific datetime values 2020-02-23 16:48:30 +01:00
kabeuchi.py [kabeuchi] add 'user' extractor (closes #561) 2020-03-13 16:45:42 +01:00
keenspot.py [keenspot] fix extraction for "TwoKinds" 2019-06-17 19:49:39 +02:00
khinsider.py update test results 2020-02-22 03:25:32 +01:00
kissmanga.py improve parameter extraction when solving Cloudflare challenge 2020-04-22 22:08:17 +02:00
komikcast.py [komikcast] ignore banner image 2019-10-03 17:34:06 +02:00
konachan.py simplify extractor constants 2019-02-08 13:45:40 +01:00
lineblog.py [lineblog] add blog and post extractors (closes #404) 2019-09-06 22:16:42 +02:00
livedoor.py update test results 2020-01-12 21:41:06 +01:00
luscious.py update extractor test results 2020-04-11 23:00:42 +02:00
mangadex.py update extractor test results 2020-05-31 17:42:07 +02:00
mangafox.py change results of text.nameext_from_url() 2019-02-14 16:07:17 +01:00
mangahere.py [mangahere] send 'isAdult' cookie (fixes #556) 2020-01-04 21:25:35 +01:00
mangapanda.py change results of text.nameext_from_url() 2019-02-14 16:07:17 +01:00
mangapark.py update test results 2020-04-26 22:14:28 +02:00
mangareader.py update extractor test results 2020-02-16 21:48:46 +01:00
mangastream.py change Chapter and MangaExtractor classes 2019-02-11 18:38:47 +01:00
mangoxo.py [mangoxo] fix login 2020-03-08 23:01:51 +01:00
mastodon.py add global SENTINEL object 2020-05-19 22:32:53 +02:00
message.py Added an additional channel for downloading the metadata of an entire post or gallery. 2019-12-09 00:56:27 -06:00
myportfolio.py [myportfolio] fix extraction of galleries without title 2020-04-08 21:08:05 +02:00
naver.py [naver] adjust directory names and metadata structure 2019-10-31 16:53:48 +01:00
newgrounds.py add 'text.ensure_http_scheme()' 2020-05-19 22:32:53 +02:00
ngomik.py [ngomik] fix extraction 2019-07-28 10:53:46 +02:00
nhentai.py [nhentai] fix extraction (closes #819) 2020-06-09 21:27:07 +02:00
nijie.py [nijie] fix 'date' parsing 2019-11-30 23:08:21 +01:00
nozomi.py [nozomi] move '_unpack()' method to global scope 2020-04-20 21:44:16 +02:00
nsfwalbum.py update extractor class hierarchies 2019-10-16 18:15:29 +02:00
oauth.py update output of 'oauth:…' (#616) 2020-05-31 17:41:40 +02:00
paheal.py update extractor test results 2020-02-27 22:15:40 +01:00
patreon.py add 'text.ensure_http_scheme()' 2020-05-19 22:32:53 +02:00
photobucket.py update test results 2019-11-30 23:59:32 +01:00
piczel.py [piczel] fix extraction for single images 2020-03-31 22:47:23 +02:00
pinterest.py [pinterest] improve detection of invalid pin.it links 2020-01-18 21:06:44 +01:00
pixiv.py [pixiv] implement 'avatar' option (#595, #623) 2020-03-09 21:18:16 +01:00
pixnet.py [pixnet] add extractors (closes #177) 2019-04-11 19:27:02 +02:00
plurk.py [plurk] add delay between comment requests 2019-12-01 01:03:31 +01:00
pornhub.py improve 'deviantart.quality' description 2019-08-30 18:41:18 +02:00
pururin.py add tests for specific datetime values 2020-02-23 16:48:30 +01:00
reactor.py [reactor] fix image URLs 2019-08-16 14:07:22 +02:00
readcomiconline.py [kissmanga][readcomiconline] add 'captcha' option (#279) 2019-05-27 22:24:48 +02:00
realbooru.py update test results 2020-05-02 21:13:00 +02:00
recursive.py reuse connection adapters from parent extractors 2020-05-12 23:52:01 +02:00
reddit.py write OAuth token to cache by default (#616) 2020-05-25 22:35:45 +02:00
redgifs.py update extractor test results 2020-05-31 17:42:07 +02:00
rule34.py update test results 2019-04-12 09:59:48 +02:00
safebooru.py simplify extractor constants 2019-02-08 13:45:40 +01:00
sankaku.py embed error messages in StopExtraction exceptions 2019-10-28 16:39:49 +01:00
sankakucomplex.py miscellaneous fixes and adjustments 2019-08-01 22:09:43 +02:00
seiga.py [seiga] support mobile URLs (closes #401) 2019-08-28 22:56:43 +02:00
senmanga.py update misc test results 2019-11-20 21:45:48 +01:00
sexcom.py [sexcom] replace 404ed test 2020-05-18 19:04:51 +02:00
shopify.py update test results 2020-01-12 21:41:06 +01:00
simplyhentai.py [simplyhentai] ignore certificate errors in video test 2020-03-28 21:07:30 +01:00
slickpic.py allow multiple hashes for content tests 2020-01-18 00:19:35 +01:00
slideshare.py propagate 'match' to base extractor constructor 2019-02-11 13:31:10 +01:00
smugmug.py let extractors opt-out of cookie option usage 2020-01-01 21:12:37 +01:00
speakerdeck.py [speakerdeck] Add a new extractor for speakerdeck.com (#726) 2020-05-01 22:32:22 +02:00
test.py propagate 'match' to base extractor constructor 2019-02-11 13:31:10 +01:00
tsumino.py add tests for specific datetime values 2020-02-23 16:48:30 +01:00
tumblr.py prevent flake8 errors from comments looking like type annotations 2020-05-12 20:08:05 +02:00
twitter.py [twitter] don't cache results of 'user_by_screen_name()' 2020-06-10 20:58:42 +02:00
vanillarock.py [vanillarock] add post and tag extractors (closes #254) 2019-06-23 22:45:36 +02:00
vsco.py [vsco] fix extraction 2020-04-30 21:12:06 +02:00
wallhaven.py add tests for specific datetime values 2020-02-23 16:48:30 +01:00
warosu.py propagate 'match' to base extractor constructor 2019-02-11 13:31:10 +01:00
webtoons.py [webtoons] make archive_fmt unique (#779) 2020-05-25 21:23:54 +02:00
weibo.py [weibo] add 'videos' option 2020-04-30 00:00:30 +02:00
wikiart.py update extractor test results 2020-05-28 02:18:06 +02:00
xhamster.py [xhamster] support xhamster.porncache.net domains (closes #700) 2020-04-22 18:31:05 +02:00
xvideos.py [xvideos] improve 2019-12-13 19:03:56 +01:00
yandere.py simplify extractor constants 2019-02-08 13:45:40 +01:00
yuki.py propagate 'match' to base extractor constructor 2019-02-11 13:31:10 +01:00