1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-22 18:53:21 +01:00
Commit Graph

236 Commits

Author SHA1 Message Date
enduser420
c01cad599a
[lolisafe] add support for xbunkr (#3156) 2022-11-04 16:13:52 +01:00
Mike Fährmann
58d97188b4
[mastodon] add 'bookmark' extractor (#3109) 2022-10-26 21:28:50 +02:00
enduser420
ac6111e693
[mangasee] add support for 'mangalife' (#3086) 2022-10-21 16:46:36 +02:00
Mike Fährmann
a7d23f1484
[vichan] add generic extractors for vichan imageboards
includes 8kun.top, smuglo.li, and wikieat.club
2022-10-21 14:40:45 +02:00
thatfuckingbird
062ef238a6
add support for aibooru (using danbooru extractor) (#3075) 2022-10-19 11:53:59 +02:00
enduser420
0163ca86f7
[smugloli] add smugloli extractors (#3060) 2022-10-19 11:25:18 +02:00
Mike Fährmann
cf86f68864
[instagram] add 'avatar' extractor (#929, #1097, #2992) 2022-10-19 10:58:42 +02:00
Mike Fährmann
618c81afdf
[ngomik] remove module
"Access denied"
2022-10-19 10:47:25 +02:00
Mike Fährmann
0714274f1f
[instagram] remove 'channel' extractor 2022-10-15 21:13:58 +02:00
Mike Fährmann
3b369ce3d1
[nijie] add 'followed' extractor (#3048) 2022-10-14 14:59:18 +02:00
Mike Fährmann
c4a62a48ae
[nijie] add 'feed' extractor (#3048) 2022-10-14 12:03:00 +02:00
Mike Fährmann
1696f68a68
[8chan] add 'thread' and 'board' extractors (#2938) 2022-10-11 10:47:19 +02:00
Mike Fährmann
560f7b41d8
[vk] add 'tagged' extractor (#2997) 2022-10-08 15:41:39 +02:00
enduser420
f0321f423d
[2chen] Add 2chen.moe extractor (#2707)
* [2chen] Add 2chen.moe extractor

* change "==" to is

* fix for "test_unique_pattern_matches"

* fix regex pattern and group matching

* fix regex again

* [2chen] add 'reply_no' and 'hash' metadata and change 'filename_fmt'

also made an entry in supportedsites.md

* [2chen] unescape 'title'

* [2chen] partition() -> rpartition()

* [2chen] extract 'date' and 'name' metadata

* [2chen] remove 'offset' argument

* [2chen] do some changes

* [2chen] do some more changes

* [2chen] unescape 'name' and 'filename'
2022-10-04 22:18:13 +02:00
enduser420
f7ba19a1c0
[nana] add 'nana' extractors (#2967) 2022-10-04 09:23:24 +02:00
Mike Fährmann
63e0924927
[pixiv] add 'series' extractor (#2964) 2022-09-27 23:24:03 +02:00
Mike Fährmann
0393e59535
[newgrounds] add 'games' extractor (#2955) 2022-09-24 12:34:37 +02:00
Mike Fährmann
4b2a006871
[skeb] add 'search' extractor (#2945) 2022-09-21 17:57:55 +02:00
Mike Fährmann
eef50c1f28
[blogger] split 'search' extractor (#2930) 2022-09-19 21:01:21 +02:00
enduser420
bd846abba0
[hotleak] add hotleak extractor (#2909) (#2890) 2022-09-18 13:37:16 +02:00
Mike Fährmann
7e385ed63e
[foolfuuka] update domains
- remove nyafuu
- add rozenarcana (https://archive.alice.al/)
- add tokyochronos (https://www.tokyochronos.net)
2022-08-26 17:57:17 +02:00
enduser420
3d87cedc58 [jpgchurch] rework the image extractor
now the image extractor can recognize if an image if from an album
also removed some unnecessary methods
2022-08-26 15:58:19 +05:30
Mike Fährmann
a799fae2df
[catbox] add 'album' extractor (#2410)
adapted from https://github.com/mikf/gallery-dl/pull/2805

- rewrite using GalleryExtractor
- extract more metadata
- match lolisafe names
- add test
2022-08-18 18:00:24 +02:00
Mike Fährmann
3a8addfe45
[zerochan] add 'tag' and 'image' extractors (#1434) 2022-07-27 22:58:23 +02:00
Chew Shee Yang
977d53b640
[Instagram] Add support for user's saved collection (#2769)
* [Instagram] Add support for user's saved collection

* [Instagram] Run formatter

* [Instagram] Simplify collection_id retrieval and add metadata

* [Instagram] Fix bug when params is not passed to _pagination_api
2022-07-27 10:49:45 +02:00
Mike Fährmann
46f11a3118
[bunkr] fix extraction (#2732)
move bunkr.is code to its own module
2022-07-15 13:00:57 +02:00
Mike Fährmann
fe2b3d57d4
[komikcast] update domain 2022-07-12 23:07:58 +02:00
Mike Fährmann
2dc57637cf
[foolfuuka] remove archive.wakarimasen.moe 2022-07-10 23:13:49 +02:00
Mike Fährmann
241e82e18d
[horne] add support for horne.red (#2700) 2022-06-25 16:52:16 +02:00
Mike Fährmann
27e8078fb7
[poipiku] add 'user' and 'post' extractors (#1602) 2022-06-20 11:32:02 +02:00
Mike Fährmann
fa902cd54d
[itaku] add 'gallery' and 'image' extractors (#1842) 2022-06-20 11:31:44 +02:00
Mike Fährmann
57508d3bb7
[weibo] support all different 'tabtype' listings (#686, #2601) 2022-06-03 16:36:22 +02:00
Mike Fährmann
8a42d859bf
[bunkr] change domain to 'app.bunkr.is' (#2634) 2022-06-01 11:30:27 +02:00
Mike Fährmann
ff5e10a86d
[hypnohub] move to gelbooru_v02 instances (#2631) 2022-05-28 21:10:05 +02:00
Mike Fährmann
d6e744bf0f
[gfycat] add 'collection' extractor (#2629) 2022-05-28 16:53:27 +02:00
Mike Fährmann
d4e9d51760
[reddit] add 'home' extractor (#2614) 2022-05-26 15:28:33 +02:00
Mike Fährmann
feb470d19a
[shopifx] natively support a few more sites (closes #2089)
- chelseacrew.com
- michaels.com.au
- modcloth.com
- pinupgirlclothing.com
- raidlondon.com (loveraid.com)
- unique-vintage.com
2022-05-10 15:49:36 +02:00
Mike Fährmann
60f4d59b1e
[gelbooru_v01] remove 'tlb.booru.org' from supported domains
403 Forbidden
nginx

it is also no longer listed on https://booru.org/top
2022-05-10 12:23:05 +02:00
Mike Fährmann
52b47c3cf9
[gelbooru_v01] add 'favorite' extractor (#2546) 2022-05-02 11:33:28 +02:00
Mike Fährmann
84756982e9
[pixiv] implement 'include' option
- split 'user' extractor and its 'avatar' and 'background' options into
  separate extractors ('artworks', 'avatar', 'background')
- avatars can now be downloaded with
  https://www.pixiv.net/en/users/ID/avatar
  as URL and will use a proper archive key; similar for backgrounds
- options for the 'user' subcategory must be moved to 'artworks' to have
  the same effect as before
2022-05-02 09:03:35 +02:00
Mike Fährmann
d11e2191ae
[nijie] support /history_nuita.php listings (closes #2541) 2022-05-02 09:03:34 +02:00
Federico Ravasio
0381752575
[photovogue] switch to .com, update api endpoint (#2494) 2022-04-27 22:37:53 +02:00
Mike Fährmann
ffa1dd1d91
add 'coomer.party' to supported sites (closes #2462) 2022-04-06 21:27:31 +02:00
Mike Fährmann
9c5d2d7af3
[pinterest] add extractor for created pins (#2452) 2022-04-01 16:59:58 +02:00
loragja
7e545a3ae9
[gofile] add gofile.io extractor (#2364)
* Add gofile extractor

* add gofile extractor to module list

* add support for tiny monitors and ancient python versions

* seriously, f-strings are not *that* new...

* i love flake8 :)

* add 'api-token' and 'recursive' options
* add tests
2022-03-29 17:31:57 +02:00
Layerex
625f4d4cc4
[telegraph] Add telegra.ph extractor (#2312) 2022-03-28 19:18:13 +02:00
lingegrino
b3d8b40690
Rename meme.museum (#2393) 2022-03-14 08:00:35 +01:00
Mike Fährmann
fc277fa45f
[seiga] require authentication with 'user_session' cookie (#2372)
Login with username & password would now require entering a 2FA token.

see also 7b009cc893
2022-03-11 02:10:15 +01:00
Mike Fährmann
5a50569360
[toyhouse] support 'art' listings (#1546, #2331) 2022-02-27 16:22:50 +01:00
Mike Fährmann
fdfdc1b614
[kissgoddess] add 'gallery' and 'model' extractors
(closes #1052, #2304)
2022-02-20 04:45:37 +01:00
Mike Fährmann
79a461a2c1
[mememuseum] add 'tag' and 'post' extractors (closes #2264) 2022-02-20 02:15:38 +01:00
Mike Fährmann
254a5b26e0
[twibooru] add extractors for searches, galleries, and posts
(#2219)
2022-02-18 23:43:57 +01:00
David Hoppenbrouwers
b17e2dcf93
[wallpapercave] add extractor for images (#2205) 2022-02-11 23:44:51 +01:00
Thomas Jost
a7de819aca
[lightroom] add Lightroom gallery extractor (#2263) 2022-02-11 21:30:59 +01:00
Mike Fährmann
563bd0ecf4
[danbooru] inherit from BaseExtractor
- merge danbooru and e621 code
- support booru.allthefallen.moe (closes #2283)
- remove support for old e621 tag search URLs
2022-02-11 21:01:51 +01:00
Mike Fährmann
4e4cb40663
do not sort BaseExtractor instances by name 2022-02-10 01:44:16 +01:00
Mike Fährmann
f351746483
release version 1.20.4 2022-02-06 22:02:36 +01:00
Mike Fährmann
cc7dce5755
[sexcom] add 'pins' extractor (closes #2265) 2022-02-04 20:55:00 +01:00
Mike Fährmann
02e18f56be
[e621] add 'favorite' extractor (closes #2250) 2022-02-04 20:54:48 +01:00
Mike Fährmann
9a221494c3
[twitter] add 'event' extractor (closes #2109) 2022-01-22 20:55:50 +01:00
Mike Fährmann
37beb1298e
[newgrounds] add 'search' extractor (closes #2161) 2022-01-06 19:32:39 +01:00
Mike Fährmann
89bebe1bef
[500px] add 'favorite' extractor (closes #1927) 2021-12-25 17:16:45 +01:00
Mike Fährmann
882c614281
add album extractor for lolisafe/chibisafe instances
- support bunkr.is (closes #2038)
- support zz.ht    (closes #2105)
2021-12-21 19:24:17 +01:00
Mike Fährmann
299bd2f1f5
[rule34us] add 'tag' and 'post' extractors (#1527) 2021-12-14 00:27:46 +01:00
Mike Fährmann
3cf1075d86
[inkbunny] add 'search' extractor (closes #2094) 2021-12-12 03:08:14 +01:00
Mike Fährmann
addb72e1bb
[reactor] support thatpervert.com (closes #2029) 2021-11-26 18:58:07 +01:00
Mike Fährmann
d8d9502e1e
[reactor] inherit from BaseExtractor 2021-11-26 18:58:07 +01:00
Mike Fährmann
f4ea216c95
[shopify] support loungeunderwear.com (closes #2053) 2021-11-26 18:58:06 +01:00
Mike Fährmann
3a7a19c7b9
[dynastyscans] add 'manga' extractor (closes #2035) 2021-11-19 22:51:26 +01:00
Mike Fährmann
cfa4876848
[philomena] support furbooru.org (closes #1995) 2021-11-15 20:57:51 +01:00
Mike Fährmann
37c9dedee1
[seisoparty] remove module 2021-11-09 22:41:04 +01:00
Mike Fährmann
4c49174579
[mangakakalot] update domain and fix extraction 2021-10-31 02:16:13 +01:00
Alice
bfd7401b1e
[skeb] add 'user' and 'post' extractors (#1031) (#1971)
* Create skeb.py

* Update __init__.py

* Update supportedsites.py

* Update supportedsites.md

* Update supportedsites.py

* Update skeb.py
2021-10-26 20:00:41 +02:00
Mike Fährmann
c19e762fdf
[vk] add 'album' extractor (#474, fixes #1952)
todo: better metadata for albums
2021-10-23 00:46:20 +02:00
Mike Fährmann
50098762e3
[nhentai] add 'tag' extractor (closes #1950) 2021-10-14 16:23:47 +02:00
Mike Fährmann
fe6ce5495a
[kemonoparty] add 'discord' extractor (#1827, #1940) 2021-10-13 20:33:05 +02:00
Mike Fährmann
918fc9974d
[picarto] add 'gallery' extractor (closes #1931) 2021-10-13 01:22:10 +02:00
Mike Fährmann
e33125ad39
[pixiv] add 'sketch' extractor (#1497) 2021-10-13 00:02:11 +02:00
Mike Fährmann
b93915c113
[inkbunny] add 'pool' extractor (#1937) 2021-10-09 22:07:07 +02:00
Mike Fährmann
373d3e1c57
[seisoparty] implement login with username & password (#1906) 2021-10-08 22:44:31 +02:00
Mike Fährmann
7c5f62b453
[seisoparty] add 'favorite' extractor (#1906) 2021-10-08 22:26:34 +02:00
Mike Fährmann
e0bdacd932
[fappic] add 'image' extractor (closes #1898) 2021-09-28 23:35:29 +02:00
Mike Fährmann
e4684c5cb9
[desktopography] simplify (#1740) 2021-09-17 20:09:24 +02:00
Mike Fährmann
7b05600056
[pinterest] only mention cookies for authentication (#1856)
regular login is broken due to CAPTCHA
2021-09-16 16:43:05 +02:00
Mike Fährmann
266ed9b62e
[aryion] add 'tag' extractor (closes #1849) 2021-09-14 23:33:33 +02:00
Mike Fährmann
7bbb1f92d7
[gelbooru_v02] add 'favorite' extractor (closes #1834) 2021-09-10 20:43:59 +02:00
Mike Fährmann
4ec11af6a4
[kemonoparty] implement login with username & password (#1824) 2021-09-09 01:06:25 +02:00
Mike Fährmann
83bbb628d8
[kemonoparty] add 'favorite' extractor (#1824) 2021-09-08 00:32:49 +02:00
Mike Fährmann
3e36543c98
[nhentai] add 'favorite' extractor (#1814) 2021-09-02 18:26:22 +02:00
Mike Fährmann
6ce16c6d31
[deviantart] add 'tag' extractor (closes #1803) 2021-08-28 23:42:10 +02:00
Mike Fährmann
4e9f8fe395
[shopify] support windsorstore.com (#1793) 2021-08-28 18:34:12 +02:00
Mike Fährmann
c04f7ab139
[foolfuuka] add 'gallery' extractor (#1785) 2021-08-21 22:46:23 +02:00
Mike Fährmann
20ee091289
[429chan] add 'thread' and 'board' extractors (closes #1773) 2021-08-21 22:46:22 +02:00
Mike Fährmann
51eb50749f
[foolslide] remove entry for kobato.hologfx.com 2021-08-21 22:46:22 +02:00
Mike Fährmann
ed4b3c48cb
fix flake8 and other tests 2021-08-12 16:05:26 +02:00
Mike Fährmann
da7297c0b9
[comicvine] add extractor (closes #1712) 2021-07-23 16:17:06 +02:00
Mike Fährmann
e4788fa663
[bbc] add 'gallery' and 'programme' extractors (closes #1706) 2021-07-22 20:37:05 +02:00
Mike Fährmann
3868ec02d1
[pururin] update domain and fix extraction 2021-07-18 04:11:59 +02:00
Mike Fährmann
8ecca3af58
[pixiv] add extractor for 'pixivision' articles (#1672) 2021-07-07 16:27:16 +02:00
Mike Fährmann
7f591c78cb
[mangafox] cleanup 2021-07-04 03:21:02 +02:00
Mike Fährmann
267bbf5996
[mangasee] add 'chapter' and 'manga' extractors 2021-06-27 02:03:03 +02:00
Mike Fährmann
f74cf52e2b
[seisoparty] add 'user' and 'post' extractors (#1635) 2021-06-25 18:40:11 +02:00
Mike Fährmann
1197ee2c20
[mangadex] add extractor for a user's followed feed (#1535) 2021-06-08 02:45:36 +02:00
Mike Fährmann
07c8adbd8b
[mangadex] implement login with username & password (#1535) 2021-06-08 02:12:57 +02:00
Mike Fährmann
407627ec86
[foolfuuka] support 'archive.wakarimasen.moe' (closes #1595) 2021-06-02 15:45:43 +02:00
Mike Fährmann
52052a0e1a
[manganelo] update domain to 'manganato.com' 2021-05-28 17:59:21 +02:00
Mike Fährmann
1eabfa5c7a
[pillowfort] implement login with username & password (#846) 2021-05-19 02:59:16 +02:00
Mike Fährmann
3e4ffb0821
[gelbooru] add extractor for '/redirect.php' URLs (#1530) 2021-05-07 15:34:53 +02:00
Mike Fährmann
15b0241bbc
[imagebam] fix extraction 2021-05-06 16:47:36 +02:00
Mike Fährmann
38ae61edd4
[inkbunny] add 'favorite' extractor (#1521) 2021-05-04 19:28:48 +02:00
Mike Fährmann
2133f1d77f
[readcomiconline] change domain to 'readcomiconline.li'
(closes #1517)
2021-05-01 16:41:16 +02:00
Mike Fährmann
c6c4a73f87
update fanbox entry in supportedsites.md 2021-04-25 19:44:19 +02:00
thatfuckingbird
e47952ac14
add extractors for fantia and fanbox (#1459)
* add extractors for fantia and fanbox

* appease linter

* make docstrings unique

* [fantia] refactor post extraction

* [fantia] capitalize

* [fantia] improve regex pattern

* code style

* capitalize

* [fanbox] use BASE_PATTERN for url regexes

* [fanbox] refactor metadata and post extraction

* [fanbox] improve url base pattern

* [fanbox] accept creator page links ending with /posts

* [fanbox] more tests

* [fantia] improved pagination

* [fanbox] misc. code logic improvements

* [fantia] finish restructuring pagination code

* [fanbox] avoid making a request for each individual post when processing a creator page

* [fanbox] support embedded videos

* [fanbox] fix errors

* [fanbox] document extractor.fanbox.videos

* [fanbox] handle "article" and "entry" post types, all embeds

* [fanbox] fix downloading of embedded fanbox posts
2021-04-25 19:39:13 +02:00
Mike Fährmann
77a9cc6fd6
update supportedsites.md entry for Instagram 2021-04-23 23:21:01 +02:00
Hans Christian Gunawan
334d690687
[hentaicosplays] Add extractor (#1473) 2021-04-18 20:28:00 +02:00
Mike Fährmann
086925e685
[shopify] support omgmiamiswimwear.com (closes #1280) 2021-04-13 23:54:03 +02:00
Mike Fährmann
78d7ee3ef4
[yuki] remove module for yuki.la 2021-04-12 21:42:32 +02:00
FollieHiyuki
e3b9f88540
Add manganelo extractor (#1415) 2021-04-02 21:01:31 +02:00
Mike Fährmann
105f3c9666
[twitter] add extractor for direct image links (closes #1417) 2021-04-02 02:45:23 +02:00
Mike Fährmann
ec3d5d58a8
[vk] improve extractor (#474)
- fetch all photos
- add 'metadata' option
- fix extracting photos without '?' in URL
2021-04-01 14:35:56 +02:00
Mike Fährmann
d5aad999dc
[tapas] implement login with username & password (#692) 2021-03-30 01:45:28 +02:00
Mike Fährmann
36291176bc
[pinterest] add 'search' extractor (#1411) 2021-03-29 01:41:28 +02:00
Mike Fährmann
5aa30c3669
[tapas] add 'series' and 'episode' extractors (#692) 2021-03-27 18:28:16 +01:00
Mike Fährmann
62cfee4d28
[vk] initial support for albums (#474) 2021-03-23 19:02:16 +01:00
Mike Fährmann
58b93635ee
[architizer] add 'firm' extractor (#1369) 2021-03-19 01:31:34 +01:00
Mike Fährmann
204523611c
[imgclick] use 'http://' for image URLs
The TLS certificate for main.imgclick.net is invalid.
2021-03-19 01:30:49 +01:00
Mike Fährmann
69ca4e29f1
[deviantart] add 'watch' extractor (#794) 2021-03-17 22:50:02 +01:00
Mike Fährmann
fcdda6128c
[mangastream] remove module 2021-03-16 23:52:36 +01:00
Mike Fährmann
c677ea19dd
[mangareader] remove module 2021-03-16 23:48:55 +01:00
Mike Fährmann
71523aaab6
[architizer] add 'project' extractor (#1369) 2021-03-16 03:24:29 +01:00
Mike Fährmann
466966bf83
[hentaicafe] remove module 2021-03-14 17:19:57 +01:00
Mike Fährmann
97641cd151
[hentainexus] remove module 2021-03-14 17:19:57 +01:00
Mike Fährmann
c485d0a956
[philomena] add generalized extractors for philomena sites
(closes #1379)
2021-03-14 17:19:57 +01:00
Mike Fährmann
72fe9ac0f3
[gelbooru_v01] support some more boorus by default
- https://drawfriends.booru.org/
- https://vidyart.booru.org/
- https://tlb.booru.org/
2021-03-14 17:19:56 +01:00
Mike Fährmann
ec98b2c56f
categorize sites in supportedsites.md by basecategory 2021-03-12 16:53:36 +01:00
Mike Fährmann
a67e002f40
update docs/supportedsites
- use Markdown with inline HTML instead of reStructuredText
- move file from docs/supportedsites.rst to docs/supportedsites.md
- update Makefile, README, etc
2021-03-12 03:03:48 +01:00