1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-23 19:22:32 +01:00
gallery-dl/gallery_dl/extractor
vsyx 3f2b6335d7
[instagram] fix highlights extraction (#2197)
* [instagram] fix highlights extraction

* [instagram] improve highlights extraction

- 'yield' individual reels instead of collecting them in a list
  and returning them all at once
- reduce 'chunk_size' to an even saver value
  (instagram.com also uses 5)
2022-01-24 00:20:12 +01:00
..
__init__.py generic extractor (#735) 2021-12-29 22:39:29 +01:00
2chan.py generic extractor (#735) 2021-12-29 22:39:29 +01:00
3dbooru.py [moebooru] add generalized extractors for moebooru sites 2020-12-01 22:27:18 +01:00
4chan.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
8kun.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
8muses.py update extractor test results 2021-11-01 02:58:53 +01:00
35photo.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
420chan.py [429chan] add 'thread' and 'board' extractors (closes #1773) 2021-08-21 22:46:22 +02:00
500px.py [500px] create directories per photo 2021-12-25 17:16:45 +01:00
adultempire.py
architizer.py update extractor test results 2021-07-20 20:21:33 +02:00
artstation.py [artstation] create directories per asset (closes #2136) 2021-12-25 17:16:45 +01:00
aryion.py [aryion] update/improve pagination (#1849) 2021-09-16 16:27:25 +02:00
bbc.py [bbc] provide fallback URLs (#1706) 2021-07-30 01:14:07 +02:00
bcy.py update extractor test results 2021-11-01 02:58:53 +01:00
behance.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
blogger.py [blogger] support new image domain (fixes #2204) 2022-01-20 23:13:07 +01:00
booru.py [booru] add an option to extract notes (only gelbooru for now) (#1457) 2021-04-13 23:40:24 +02:00
comicvine.py [comicvine] add extractor (closes #1712) 2021-07-23 16:17:06 +02:00
common.py add --source-address command-line option (closes #2206) 2022-01-21 17:07:56 +01:00
cyberdrop.py add album extractor for lolisafe/chibisafe instances 2021-12-21 19:24:17 +01:00
danbooru.py [danbooru] add 'external' option (closes #1747) 2021-08-08 19:18:41 +02:00
desktopography.py [desktopography] simplify (#1740) 2021-09-17 20:09:24 +02:00
deviantart.py [deviantart] adjust API endpoints 2021-12-21 00:18:06 +01:00
directlink.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
dynastyscans.py [dynastyscans] provide 'date' as proper datetime object (#2050) 2021-11-21 22:50:52 +01:00
e621.py [e621] return pool posts in order (closes #1195) 2020-12-26 19:00:29 +01:00
erome.py [erome] send Referer header for file downloads (fixes #1829) 2021-09-08 00:29:16 +02:00
exhentai.py [exhentai] add 'source' option 2021-12-16 23:16:19 +01:00
fallenangels.py [fallenangels] fix extraction of '.5' chapters 2020-10-23 16:56:08 +02:00
fanbox.py [fanbox] support pixiv redirects (closes #2122) 2021-12-25 17:15:39 +01:00
fantia.py use Extractor._check_cookies() for all cookie checks 2021-12-16 02:21:16 +01:00
flickr.py generic extractor (#735) 2021-12-29 22:39:29 +01:00
foolfuuka.py update extractor test results 2021-11-27 19:26:44 +01:00
foolslide.py implement 'page-reverse' option (#1854) 2021-09-23 18:02:19 +02:00
furaffinity.py [furaffinity] warn when no session cookies were found 2021-12-15 16:21:05 +01:00
fuskator.py remove '&' from URL patterns 2020-10-22 23:31:25 +02:00
gelbooru_v01.py [gelbooru_v01] support some more boorus by default 2021-03-14 17:19:56 +01:00
gelbooru_v02.py [rule34] use https://api.rule34.xxx for API requests 2022-01-08 17:14:50 +01:00
gelbooru.py [gelbooru] improve video file detection (fixes #2188) 2022-01-12 21:33:02 +01:00
generic.py generic extractor (#735) 2021-12-29 22:39:29 +01:00
gfycat.py [gfycat] show warning when there are no available formats 2021-10-26 19:26:50 +02:00
hbrowse.py update extractor test results 2020-09-15 18:07:08 +02:00
hentai2read.py remove '&' from URL patterns 2020-10-22 23:31:25 +02:00
hentaicosplays.py [hentaicosplays] add 'slug' metadata field (closes #1483) 2021-04-19 16:28:01 +02:00
hentaifoundry.py [hentaifoundry] use scheme from input URL (fixes #1095) 2020-11-07 22:40:02 +01:00
hentaifox.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
hentaihand.py update extractor test results 2021-11-01 02:58:53 +01:00
hentaihere.py
hiperdex.py [hiperdex] fix extraction 2021-09-30 00:32:34 +02:00
hitomi.py [hitomi] fix 'tag' extraction (fixes #2189) 2022-01-13 16:45:46 +01:00
idolcomplex.py [idolcomplex] improve and fix pagination (#1601) 2021-06-04 20:31:08 +02:00
imagebam.py [imagebam] fix extraction of NSFW images (#1534) 2021-05-22 21:41:44 +02:00
imagechest.py [imagechest] simplify code (#750) 2020-05-18 19:11:26 +02:00
imagefap.py update extractor test results 2021-09-03 19:36:12 +02:00
imagehosts.py [fappic] add 'image' extractor (closes #1898) 2021-09-28 23:35:29 +02:00
imgbb.py generic extractor (#735) 2021-12-29 22:39:29 +01:00
imgbox.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
imgth.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
imgur.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
inkbunny.py [inkbunny] add 'search' extractor (closes #2094) 2021-12-12 03:08:14 +01:00
instagram.py [instagram] fix highlights extraction (#2197) 2022-01-24 00:20:12 +01:00
issuu.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
kabeuchi.py
keenspot.py generic extractor (#735) 2021-12-29 22:39:29 +01:00
kemonoparty.py [kemonoparty] use service as subcategory (closes #2147) 2021-12-29 22:46:17 +01:00
khinsider.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
komikcast.py [komikcast] fix extraction 2021-04-15 17:04:53 +02:00
lineblog.py remove '&' from URL patterns 2020-10-22 23:31:25 +02:00
livedoor.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
lolisafe.py [lolisafe] include file ID in filenames 2021-12-25 17:16:45 +01:00
luscious.py update extractor test results 2021-11-01 02:58:53 +01:00
mangadex.py [mangadex] re-enable warning for external chapters (#2193) 2022-01-16 03:21:50 +01:00
mangafox.py [mangafox] cleanup 2021-07-04 03:21:02 +02:00
mangahere.py remove '&' from URL patterns 2020-10-22 23:31:25 +02:00
mangakakalot.py [mangakakalot] update domain and fix extraction 2021-10-31 02:16:13 +01:00
manganelo.py [manganelo] update domain to 'manganato.com' 2021-05-28 17:59:21 +02:00
mangapark.py update extractor test results 2021-11-01 02:58:53 +01:00
mangasee.py [mangasee] add 'chapter' and 'manga' extractors 2021-06-27 02:03:03 +02:00
mangoxo.py [mangoxo] fix metadata extraction 2021-11-27 18:19:51 +01:00
mastodon.py [mastodon] add 'following' extractor (#1891) 2021-09-26 00:12:34 +02:00
message.py remove 'Message.Metadata' (#866) 2021-01-31 02:12:37 +01:00
moebooru.py [moebooru] fix 'tags' ending with a '+' when logged in (#1702) 2021-07-16 15:42:03 +02:00
myhentaigallery.py [myhentaigallery] update and fix extraction (#1001) 2020-09-17 18:14:23 +02:00
myportfolio.py generic extractor (#735) 2021-12-29 22:39:29 +01:00
naver.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
naverwebtoon.py [naverwebtoon] fix comic extraction 2021-07-18 03:41:54 +02:00
newgrounds.py [newgrounds] set suitabilities filter before starting a search 2022-01-11 23:50:29 +01:00
ngomik.py remove '&' from URL patterns 2020-10-22 23:31:25 +02:00
nhentai.py [nhentai] simplify 2021-10-14 16:45:53 +02:00
nijie.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
nozomi.py [nozomi] preserve case of search tags (fixes #1860) 2021-09-16 16:43:06 +02:00
nsfwalbum.py [nsfwalbum] retry all requests when extracting image URLs 2021-07-30 00:23:04 +02:00
oauth.py [oauth] fix typo 2021-09-08 20:14:39 +02:00
paheal.py update extractor test results 2021-11-01 02:58:53 +01:00
patreon.py fix cookie checks for patreon, fanbox, fantia 2022-01-01 17:55:58 +01:00
philomena.py [philomena] fix search parameter escaping (#2215) 2022-01-23 01:03:37 +01:00
photobucket.py generic extractor (#735) 2021-12-29 22:39:29 +01:00
photovogue.py [photovogue] update (#1253) 2021-01-22 19:38:10 +01:00
picarto.py [picarto] add 'gallery' extractor (closes #1931) 2021-10-13 01:22:10 +02:00
piczel.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
pillowfort.py [pillowfort] implement login with username & password (#846) 2021-05-19 02:59:16 +02:00
pinterest.py [pinterest] add 'search' extractor (#1411) 2021-03-29 01:41:28 +02:00
pixiv.py [pixiv] allow setting a date range for search results (#2133) 2021-12-23 23:03:39 +01:00
pixnet.py generic extractor (#735) 2021-12-29 22:39:29 +01:00
plurk.py remove '&' from URL patterns 2020-10-22 23:31:25 +02:00
pornhub.py generic extractor (#735) 2021-12-29 22:39:29 +01:00
pururin.py [pururin] update domain and fix extraction 2021-07-18 04:11:59 +02:00
reactor.py [reactor] support thatpervert.com (closes #2029) 2021-11-26 18:58:07 +01:00
readcomiconline.py [readcomiconline] change domain to 'readcomiconline.li' 2021-05-01 16:41:16 +02:00
recursive.py remove 'extractor.blacklist' context manager 2020-09-11 13:17:35 +02:00
reddit.py [reddit] allow downloading from quarantined subreddits (#2180) 2022-01-14 21:55:59 +01:00
redgifs.py [redgifs] improve URL extraction 2021-11-05 20:02:43 +01:00
rule34us.py [rule34us] extract tags per category (#1527) 2021-12-16 00:06:52 +01:00
sankaku.py update extractor test results 2021-11-01 02:58:53 +01:00
sankakucomplex.py implement 'util.unique_squence()' 2021-03-02 23:11:08 +01:00
seiga.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
senmanga.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
sexcom.py [sexcom] fix and improve embed extraction (fixes #2145) 2021-12-28 21:59:39 +01:00
shopify.py [shopify] support loungeunderwear.com (closes #2053) 2021-11-26 18:58:06 +01:00
simplyhentai.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
skeb.py [skeb] add 'thumbnails' option (#2047) (#2051) 2021-11-23 21:16:42 +01:00
slickpic.py generic extractor (#735) 2021-12-29 22:39:29 +01:00
slideshare.py update extractor test results 2021-11-01 02:58:53 +01:00
smugmug.py generic extractor (#735) 2021-12-29 22:39:29 +01:00
speakerdeck.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
subscribestar.py [subscribestar] emit metadata for posts without media (#1569) 2021-11-18 23:42:17 +01:00
tapas.py update extractor test results 2021-11-01 02:58:53 +01:00
test.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
tsumino.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
tumblr.py generic extractor (#735) 2021-12-29 22:39:29 +01:00
tumblrgallery.py [tumblrgallery] improve search pagination (fixes #2132) 2021-12-24 03:42:28 +01:00
twitter.py [twitter] fix pinned tweets (#2216) 2022-01-23 22:52:57 +01:00
unsplash.py update extractor test results 2021-09-03 19:36:12 +02:00
vanillarock.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
vk.py [vk] add 'album' extractor (#474, fixes #1952) 2021-10-23 00:46:20 +02:00
vsco.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
wallhaven.py [wallhaven] add 'collections' extractor (#1351) 2021-03-02 01:32:26 +01:00
warosu.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
weasyl.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
webtoons.py [webtoons] Use swebtoon-phinf.pstatic.net instead of webtoon-phinf.pstatic.net (#2005) 2021-11-11 20:03:34 +01:00
weibo.py [weibo] extend 'retweets' option (closes #1542) 2021-05-27 23:09:42 +02:00
wikiart.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
wikieat.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
xhamster.py generic extractor (#735) 2021-12-29 22:39:29 +01:00
xvideos.py update extractor test results 2021-11-27 19:26:44 +01:00
ytdl.py use yt-dlp by default (#1850, #2028) 2021-11-29 18:24:26 +01:00