Mike Fährmann
f4e3cee6ac
use yt-dlp by default ( #1850 , #2028 )
2021-11-29 18:24:26 +01:00
Mike Fährmann
addb72e1bb
[reactor] support thatpervert.com ( closes #2029 )
2021-11-26 18:58:07 +01:00
Mike Fährmann
d8d9502e1e
[reactor] inherit from BaseExtractor
2021-11-26 18:58:07 +01:00
Mike Fährmann
bcbf9bcf36
[kemonoparty] split 'discord' extractor ( #1940 )
...
in 'server' and 'channel'
2021-10-18 04:04:58 +02:00
Mike Fährmann
fe6ce5495a
[kemonoparty] add 'discord' extractor ( #1827 , #1940 )
2021-10-13 20:33:05 +02:00
Mike Fährmann
f2d6b3e6b4
run tests without using 'nose'
...
run_tests.sh -> run_tests.py
2021-10-13 04:07:41 +02:00
Mike Fährmann
e33125ad39
[pixiv] add 'sketch' extractor ( #1497 )
2021-10-13 00:02:11 +02:00
Mike Fährmann
373d3e1c57
[seisoparty] implement login with username & password ( #1906 )
2021-10-08 22:44:31 +02:00
Mike Fährmann
74145467dd
move 'util.Formatter' into its own 'formatter' module
2021-09-27 02:37:04 +02:00
Mike Fährmann
e4684c5cb9
[desktopography] simplify ( #1740 )
2021-09-17 20:09:24 +02:00
Mike Fährmann
7b05600056
[pinterest] only mention cookies for authentication ( #1856 )
...
regular login is broken due to CAPTCHA
2021-09-16 16:43:05 +02:00
Mike Fährmann
bd845303ad
implement a way to shorten filenames with east-asian characters
...
(#1377 )
Setting 'output.shorten' to "eaw" (East-Asian Width) uses a slower
algorithm that also considers characters with a width > 1.
2021-09-13 21:38:33 +02:00
Mike Fährmann
0fd959a2a7
[twitter] support '/with_replies' URLs ( closes #1833 )
2021-09-10 20:44:26 +02:00
Mike Fährmann
4ec11af6a4
[kemonoparty] implement login with username & password ( #1824 )
2021-09-09 01:06:25 +02:00
Mike Fährmann
51eb50749f
[foolslide] remove entry for kobato.hologfx.com
2021-08-21 22:46:22 +02:00
Mike Fährmann
da7297c0b9
[comicvine] add extractor ( closes #1712 )
2021-07-23 16:17:06 +02:00
Mike Fährmann
e4788fa663
[bbc] add 'gallery' and 'programme' extractors ( closes #1706 )
2021-07-22 20:37:05 +02:00
Mike Fährmann
74b457b2b5
remove unused entries
2021-07-20 20:21:32 +02:00
Mike Fährmann
36ac2197db
[ytdl] add extractor for sites supported by youtube-dl
...
(#1680 , #878 )
Can be used by prefixing any URL with 'ytdl:',
or by setting 'extractor,ytdl.enabled' to 'true'.
2021-07-10 20:55:47 +02:00
Mike Fährmann
8ecca3af58
[pixiv] add extractor for 'pixivision' articles ( #1672 )
2021-07-07 16:27:16 +02:00
Mike Fährmann
267bbf5996
[mangasee] add 'chapter' and 'manga' extractors
2021-06-27 02:03:03 +02:00
Mike Fährmann
f74cf52e2b
[seisoparty] add 'user' and 'post' extractors ( #1635 )
2021-06-25 18:40:11 +02:00
Mike Fährmann
1197ee2c20
[mangadex] add extractor for a user's followed feed ( #1535 )
2021-06-08 02:45:36 +02:00
Mike Fährmann
07c8adbd8b
[mangadex] implement login with username & password ( #1535 )
2021-06-08 02:12:57 +02:00
Mike Fährmann
407627ec86
[foolfuuka] support 'archive.wakarimasen.moe' ( closes #1595 )
2021-06-02 15:45:43 +02:00
Mike Fährmann
52052a0e1a
[manganelo] update domain to 'manganato.com'
2021-05-28 17:59:21 +02:00
Mike Fährmann
1eabfa5c7a
[pillowfort] implement login with username & password ( #846 )
2021-05-19 02:59:16 +02:00
Mike Fährmann
559462789d
add some tests for job.py
2021-05-14 19:44:16 +02:00
Mike Fährmann
c6c4a73f87
update fanbox entry in supportedsites.md
2021-04-25 19:44:19 +02:00
thatfuckingbird
e47952ac14
add extractors for fantia and fanbox ( #1459 )
...
* add extractors for fantia and fanbox
* appease linter
* make docstrings unique
* [fantia] refactor post extraction
* [fantia] capitalize
* [fantia] improve regex pattern
* code style
* capitalize
* [fanbox] use BASE_PATTERN for url regexes
* [fanbox] refactor metadata and post extraction
* [fanbox] improve url base pattern
* [fanbox] accept creator page links ending with /posts
* [fanbox] more tests
* [fantia] improved pagination
* [fanbox] misc. code logic improvements
* [fantia] finish restructuring pagination code
* [fanbox] avoid making a request for each individual post when processing a creator page
* [fanbox] support embedded videos
* [fanbox] fix errors
* [fanbox] document extractor.fanbox.videos
* [fanbox] handle "article" and "entry" post types, all embeds
* [fanbox] fix downloading of embedded fanbox posts
2021-04-25 19:39:13 +02:00
Mike Fährmann
77a9cc6fd6
update supportedsites.md entry for Instagram
2021-04-23 23:21:01 +02:00
Hans Christian Gunawan
334d690687
[hentaicosplays] Add extractor ( #1473 )
2021-04-18 20:28:00 +02:00
Mike Fährmann
086925e685
[shopify] support omgmiamiswimwear.com ( closes #1280 )
2021-04-13 23:54:03 +02:00
Mike Fährmann
78d7ee3ef4
[yuki] remove module for yuki.la
2021-04-12 21:42:32 +02:00
Mike Fährmann
d5aad999dc
[tapas] implement login with username & password ( #692 )
2021-03-30 01:45:28 +02:00
Mike Fährmann
62cfee4d28
[vk] initial support for albums ( #474 )
2021-03-23 19:02:16 +01:00
Mike Fährmann
91c2e15da9
[deviantart] add support for posts from watched users ( #794 )
2021-03-22 19:25:04 +01:00
Mike Fährmann
69ca4e29f1
[deviantart] add 'watch' extractor ( #794 )
2021-03-17 22:50:02 +01:00
Mike Fährmann
c485d0a956
[philomena] add generalized extractors for philomena sites
...
(closes #1379 )
2021-03-14 17:19:57 +01:00
Mike Fährmann
72fe9ac0f3
[gelbooru_v01] support some more boorus by default
...
- https://drawfriends.booru.org/
- https://vidyart.booru.org/
- https://tlb.booru.org/
2021-03-14 17:19:56 +01:00
Mike Fährmann
ec98b2c56f
categorize sites in supportedsites.md by basecategory
2021-03-12 16:53:36 +01:00
Mike Fährmann
a67e002f40
update docs/supportedsites
...
- use Markdown with inline HTML instead of reStructuredText
- move file from docs/supportedsites.rst to docs/supportedsites.md
- update Makefile, README, etc
2021-03-12 03:03:48 +01:00
Mike Fährmann
4be27ff0fe
[nozomi] support '/index-N.html' URLs ( closes #1365 )
...
and '/index-Popular-N.html'
2021-03-11 01:06:47 +01:00
Seonghyeon Cho
665499924d
Support naver webtoon ( #1331 )
...
* Support naver webtoon (WIP)
* Apply patch
* Change filename format
* Fill test results
* Fill test result
2021-03-03 15:21:13 +01:00
topozorra
a9119da4d4
support tumblrgallery.xyz
( #1298 )
...
* support `tumblrgallery.xyz`
* fix format issues
* Refactor and add post and search page support
* Fix warnings
* Few improvments
* Better file names
* Fix linting errors
* move id closer to the begining of the file name
Co-authored-by: topozorra <none>
2021-03-03 15:20:47 +01:00
Mike Fährmann
e165e6c265
[wallhaven] add 'collections' extractor ( #1351 )
2021-03-02 01:32:26 +01:00
Mike Fährmann
1a38fae785
add option to use different youtube-dl modules ( fixes #1330 )
...
by setting the 'downloader.ytdl.module' value. For example
{
"downloader": {
"ytdl": {
"module": "yt_dlp"
}
}
}
or '-o module=yt_dlp'
2021-03-01 03:10:42 +01:00
Mike Fährmann
e39aea42cd
fix supportedsites.py for modules without docstring
...
(fixes #1332 )
2021-02-21 22:57:37 +01:00
Mike Fährmann
03b219db9d
fix supportedsites.py
2021-02-20 22:31:21 +01:00
Mike Fährmann
8974f0361c
[pixiv] update ( #1304 )
...
- remove login with username & password
- require a refresh token
- add 'oauth:pixiv' functionality
See also:
- https://github.com/upbit/pixivpy/issues/158
- https://gist.github.com/ZipFile/c9ebedb224406f4f11845ab700124362
2021-02-12 18:07:16 +01:00