Mirrors/gallery-dl
1
0
Fork 0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-23 19:22:32 +01:00
Code Issues Releases Wiki Activity
a14b72be21
gallery-dl/gallery_dl/extractor
History
Kyle Anthony Williams a14b72be21
[webtoons] Use swebtoon-phinf.pstatic.net instead of webtoon-phinf.pstatic.net (#2005) 
* [webtoons] Use swebtoon-phinf.pstatic.net instead of webtoon-phinf.pstatic.net

This trick to avoid having to set a Referer header comes from
Webtoon's RSS feeds. The two URLs below are equivalent in content:

https://webtoon-phinf.pstatic.net/20210929_153/1632867980912DmcGK_JPEG/16328679808882705182.jpg?type=q90
https://swebtoon-phinf.pstatic.net/20210929_153/1632867980912DmcGK_JPEG/16328679808882705182.jpg?type=q90

The URL with the domain "webtoon-phinf.pstatic.net" needs a Referer
header, and the domain "swebtoon-phinf.pstatic.net" does not. This
is because of the environment "swebtoon" images live in, one without
explicit network control: RSS feeds on sites such as Feedly. This change should
make it easier for gallery-dl developers to embed Webtoon comics without
worrying about headers.
2021-11-11 20:03:34 +01:00
..
__init__.py [seisoparty] remove module 2021-11-09 22:41:04 +01:00
2chan.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
3dbooru.py [moebooru] add generalized extractors for moebooru sites 2020-12-01 22:27:18 +01:00
4chan.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
8kun.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
8muses.py update extractor test results 2021-11-01 02:58:53 +01:00
35photo.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
420chan.py [429chan] add 'thread' and 'board' extractors (closes #1773) 2021-08-21 22:46:22 +02:00
500px.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
adultempire.py update extractor class hierarchies 2019-10-16 18:15:29 +02:00
architizer.py update extractor test results 2021-07-20 20:21:33 +02:00
artstation.py [artstation] use '/album/all' view for user portfolios (#1826) 2021-09-08 21:46:58 +02:00
aryion.py [aryion] update/improve pagination (#1849) 2021-09-16 16:27:25 +02:00
bbc.py [bbc] provide fallback URLs (#1706) 2021-07-30 01:14:07 +02:00
bcy.py update extractor test results 2021-11-01 02:58:53 +01:00
behance.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
blogger.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
booru.py [booru] add an option to extract notes (only gelbooru for now) (#1457) 2021-04-13 23:40:24 +02:00
comicvine.py [comicvine] add extractor (closes #1712) 2021-07-23 16:17:06 +02:00
common.py fix calculating retry sleep times (fixes #1990) 2021-10-29 23:53:48 +02:00
cyberdrop.py {cyberdrop] restore video extraction (fixes #1993) 2021-10-31 04:34:01 +01:00
danbooru.py [danbooru] add 'external' option (closes #1747) 2021-08-08 19:18:41 +02:00
desktopography.py [desktopography] simplify (#1740) 2021-09-17 20:09:24 +02:00
deviantart.py [deviantart] fix 'index' values for stashed deviations 2021-11-01 01:08:24 +01:00
directlink.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
dynastyscans.py update extractor test results 2021-09-03 19:36:12 +02:00
e621.py [e621] return pool posts in order (closes #1195) 2020-12-26 19:00:29 +01:00
erome.py [erome] send Referer header for file downloads (fixes #1829) 2021-09-08 00:29:16 +02:00
exhentai.py [exhentai] improve image limits check (#1808) 2021-08-29 21:19:55 +02:00
fallenangels.py [fallenangels] fix extraction of '.5' chapters 2020-10-23 16:56:08 +02:00
fanbox.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
fantia.py [desktopography] simplify (#1740) 2021-09-17 20:09:24 +02:00
flickr.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
foolfuuka.py update extractor test results 2021-11-01 02:58:53 +01:00
foolslide.py implement 'page-reverse' option (#1854) 2021-09-23 18:02:19 +02:00
furaffinity.py [furaffinity] unquote search queries (#1958) 2021-10-17 20:48:08 +02:00
fuskator.py remove '&' from URL patterns 2020-10-22 23:31:25 +02:00
gelbooru_v01.py [gelbooru_v01] support some more boorus by default 2021-03-14 17:19:56 +01:00
gelbooru_v02.py [gelbooru_v02] add 'favorite' extractor (closes #1834) 2021-09-10 20:43:59 +02:00
gelbooru.py [gelbooru] add extractor for '/redirect.php' URLs (#1530) 2021-05-07 15:34:53 +02:00
gfycat.py [gfycat] show warning when there are no available formats 2021-10-26 19:26:50 +02:00
hbrowse.py update extractor test results 2020-09-15 18:07:08 +02:00
hentai2read.py remove '&' from URL patterns 2020-10-22 23:31:25 +02:00
hentaicosplays.py [hentaicosplays] add 'slug' metadata field (closes #1483) 2021-04-19 16:28:01 +02:00
hentaifoundry.py [hentaifoundry] use scheme from input URL (fixes #1095) 2020-11-07 22:40:02 +01:00
hentaifox.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
hentaihand.py update extractor test results 2021-11-01 02:58:53 +01:00
hentaihere.py change results of text.nameext_from_url() 2019-02-14 16:07:17 +01:00
hiperdex.py [hiperdex] fix extraction 2021-09-30 00:32:34 +02:00
hitomi.py update extractor test results 2021-11-01 02:58:53 +01:00
idolcomplex.py [idolcomplex] improve and fix pagination (#1601) 2021-06-04 20:31:08 +02:00
imagebam.py [imagebam] fix extraction of NSFW images (#1534) 2021-05-22 21:41:44 +02:00
imagechest.py [imagechest] simplify code (#750) 2020-05-18 19:11:26 +02:00
imagefap.py update extractor test results 2021-09-03 19:36:12 +02:00
imagehosts.py [fappic] add 'image' extractor (closes #1898) 2021-09-28 23:35:29 +02:00
imgbb.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
imgbox.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
imgth.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
imgur.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
inkbunny.py [inkbunny] add 'following' extractor (#515) 2021-10-11 21:10:20 +02:00
instagram.py [instagram] update query hashes 2021-10-27 21:37:31 +02:00
issuu.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
kabeuchi.py [kabeuchi] add 'user' extractor (closes #561) 2020-03-13 16:45:42 +01:00
keenspot.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
kemonoparty.py [kemonoparty] provide 'date' metadata for gumroad (#2007) 2021-11-11 19:38:10 +01:00
khinsider.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
komikcast.py [komikcast] fix extraction 2021-04-15 17:04:53 +02:00
lineblog.py remove '&' from URL patterns 2020-10-22 23:31:25 +02:00
livedoor.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
luscious.py update extractor test results 2021-11-01 02:58:53 +01:00
mangadex.py [mangadex] update parameter handling for API requests 2021-10-05 19:46:48 +02:00
mangafox.py [mangafox] cleanup 2021-07-04 03:21:02 +02:00
mangahere.py remove '&' from URL patterns 2020-10-22 23:31:25 +02:00
mangakakalot.py [mangakakalot] update domain and fix extraction 2021-10-31 02:16:13 +01:00
manganelo.py [manganelo] update domain to 'manganato.com' 2021-05-28 17:59:21 +02:00
mangapark.py update extractor test results 2021-11-01 02:58:53 +01:00
mangasee.py [mangasee] add 'chapter' and 'manga' extractors 2021-06-27 02:03:03 +02:00
mangoxo.py [mangoxo] fix login and extraction 2021-10-31 02:16:13 +01:00
mastodon.py [mastodon] add 'following' extractor (#1891) 2021-09-26 00:12:34 +02:00
message.py remove 'Message.Metadata' (#866) 2021-01-31 02:12:37 +01:00
moebooru.py [moebooru] fix 'tags' ending with a '+' when logged in (#1702) 2021-07-16 15:42:03 +02:00
myhentaigallery.py [myhentaigallery] update and fix extraction (#1001) 2020-09-17 18:14:23 +02:00
myportfolio.py [myportfolio] fix extraction 2021-04-24 01:22:57 +02:00
naver.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
naverwebtoon.py [naverwebtoon] fix comic extraction 2021-07-18 03:41:54 +02:00
newgrounds.py [newgrounds] add 'format' option (closes #1729) 2021-07-29 19:11:20 +02:00
ngomik.py remove '&' from URL patterns 2020-10-22 23:31:25 +02:00
nhentai.py [nhentai] simplify 2021-10-14 16:45:53 +02:00
nijie.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
nozomi.py [nozomi] preserve case of search tags (fixes #1860) 2021-09-16 16:43:06 +02:00
nsfwalbum.py [nsfwalbum] retry all requests when extracting image URLs 2021-07-30 00:23:04 +02:00
oauth.py [oauth] fix typo 2021-09-08 20:14:39 +02:00
paheal.py update extractor test results 2021-11-01 02:58:53 +01:00
patreon.py update extractor test results 2021-11-01 02:58:53 +01:00
philomena.py update extractor test results 2021-11-01 02:58:53 +01:00
photobucket.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
photovogue.py [photovogue] update (#1253) 2021-01-22 19:38:10 +01:00
picarto.py [picarto] add 'gallery' extractor (closes #1931) 2021-10-13 01:22:10 +02:00
piczel.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
pillowfort.py [pillowfort] implement login with username & password (#846) 2021-05-19 02:59:16 +02:00
pinterest.py [pinterest] add 'search' extractor (#1411) 2021-03-29 01:41:28 +02:00
pixiv.py [pixiv] add 'sketch' extractor (#1497) 2021-10-13 00:02:11 +02:00
pixnet.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
plurk.py remove '&' from URL patterns 2020-10-22 23:31:25 +02:00
pornhub.py update extractor test results 2021-09-03 19:36:12 +02:00
pururin.py [pururin] update domain and fix extraction 2021-07-18 04:11:59 +02:00
reactor.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
readcomiconline.py [readcomiconline] change domain to 'readcomiconline.li' 2021-05-01 16:41:16 +02:00
recursive.py remove 'extractor.blacklist' context manager 2020-09-11 13:17:35 +02:00
reddit.py [reddit] prevent crash for galleries with no 'media_metadata' 2021-11-03 17:55:40 +01:00
redgifs.py [redgifs] improve URL extraction 2021-11-05 20:02:43 +01:00
sankaku.py update extractor test results 2021-11-01 02:58:53 +01:00
sankakucomplex.py implement 'util.unique_squence()' 2021-03-02 23:11:08 +01:00
seiga.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
senmanga.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
sexcom.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
shopify.py [shopify] support windsorstore.com (#1793) 2021-08-28 18:34:12 +02:00
simplyhentai.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
skeb.py [skeb] add 'user' and 'post' extractors (#1031) (#1971) 2021-10-26 20:00:41 +02:00
slickpic.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
slideshare.py update extractor test results 2021-11-01 02:58:53 +01:00
smugmug.py update extractor test results 2021-11-01 02:58:53 +01:00
speakerdeck.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
subscribestar.py update extractor test results 2021-07-04 22:00:32 +02:00
tapas.py update extractor test results 2021-11-01 02:58:53 +01:00
test.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
tsumino.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
tumblr.py update extractor test results 2021-03-28 23:06:44 +02:00
tumblrgallery.py [tumblrgallery] simplify 2021-03-03 15:37:56 +01:00
twitter.py [twitter] add 'pinned' option 2021-10-29 22:10:58 +02:00
unsplash.py update extractor test results 2021-09-03 19:36:12 +02:00
vanillarock.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
vk.py [vk] add 'album' extractor (#474, fixes #1952) 2021-10-23 00:46:20 +02:00
vsco.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
wallhaven.py [wallhaven] add 'collections' extractor (#1351) 2021-03-02 01:32:26 +01:00
warosu.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
weasyl.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
webtoons.py [webtoons] Use swebtoon-phinf.pstatic.net instead of webtoon-phinf.pstatic.net (#2005) 2021-11-11 20:03:34 +01:00
weibo.py [weibo] extend 'retweets' option (closes #1542) 2021-05-27 23:09:42 +02:00
wikiart.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
wikieat.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
xhamster.py remove most 'yield Message.Version' statements 2021-08-16 03:10:48 +02:00
xvideos.py update extractor test results 2021-11-01 02:58:53 +01:00
ytdl.py [ytdl] implement parsing ytdl command-line options (#1680) 2021-11-07 02:44:11 +01:00