Mike Fährmann
486474800f
[kemonoparty] skip duplicated patreon files ( closes #1689 )
...
this behavior can be disabled with the 'patreon-skip-file' option
2021-07-23 16:38:57 +02:00
Mike Fährmann
da7297c0b9
[comicvine] add extractor ( closes #1712 )
2021-07-23 16:17:06 +02:00
Mike Fährmann
e4788fa663
[bbc] add 'gallery' and 'programme' extractors ( closes #1706 )
2021-07-22 20:37:05 +02:00
Mike Fährmann
13d4045a8a
add 'archive-prefix' option ( #1711 )
2021-07-20 20:21:33 +02:00
Mike Fährmann
c3b5c88b04
update extractor test results
2021-07-20 20:21:33 +02:00
Mike Fährmann
9e42cd58ea
replace ChainPredicate class with 'functools.partial'
2021-07-20 20:21:32 +02:00
Mike Fährmann
1b2f9050fb
rename all instances of 'kwds' to 'kwdict'
2021-07-20 20:21:19 +02:00
Mike Fährmann
3868ec02d1
[pururin] update domain and fix extraction
2021-07-18 04:11:59 +02:00
Mike Fährmann
b89a44090f
[naverwebtoon] fix comic extraction
2021-07-18 03:41:54 +02:00
Mike Fährmann
4048eabeab
allow 'extractor.modules' to be a string
...
with comma-separated module names
2021-07-18 00:34:04 +02:00
Mike Fährmann
c8e678a5b4
[instagram] fix extraction of '/explore/tags/' posts
...
(closes #1666 )
2021-07-18 00:21:18 +02:00
Mike Fährmann
a6a51f207d
[moebooru] fix 'tags' ending with a '+' when logged in ( #1702 )
2021-07-16 15:42:03 +02:00
Mike Fährmann
f5b097165e
[ytdl] transfer YoutubeDL objects to downloader ( #1680 )
...
allows specifying downloader-specific options per subcategory
but overwrites all downloader.ytdl settings
2021-07-16 15:40:54 +02:00
Mike Fährmann
06e69ea79a
[ytdl] actually set options for YoutubeDL objects ( #1680 )
...
I somehow managed to remove the options parameter for
the YoutubeDL constructor in 9a849cdf
2021-07-16 15:05:55 +02:00
Mike Fährmann
fc19010808
[downloader:ytdl] fix 'outtmpl' setting for yt_dlp ( #1680 )
...
yt_dlp supports multiple outtmpl settings for different file types and
uses its 'outtmpl_dict' for that.
2021-07-16 15:05:16 +02:00
Mike Fährmann
dfe1f490e9
[mangadex] use custom User-Agent header ( #1535 )
2021-07-15 16:39:32 +02:00
Mike Fährmann
36a2aff363
[vk] improve metadata extraction and URL pattern ( fixes #1691 )
...
- always fetch all user metadata
- use 'user[name]' for directory names if available
2021-07-15 00:43:42 +02:00
Mike Fährmann
b9783403d9
add 'url-metadata' option ( #1659 , #1073 )
2021-07-14 03:08:49 +02:00
Mike Fährmann
e622e004f0
[ytdl] improve module imports ( #1680 )
...
Apply 'extractor.ytdl.module' for every URL, not just the first.
2021-07-14 03:08:00 +02:00
Mike Fährmann
e95f99882f
extend 'parent-metadata' functionality ( #1687 , #1651 , #1364 )
2021-07-14 02:53:41 +02:00
Mike Fährmann
193401ce3b
[ytdl] "fix" cookie transfer between session and ytdl ( #1680 )
...
requests' CookieJar class is not quite compatible with the standard
http.cookiejar.CookieJar used by youtube_dl
2021-07-12 18:50:25 +02:00
Mike Fährmann
9a849cdf61
[ytdl] allow setting 'module' for subcategories ( #1680 )
2021-07-12 18:47:12 +02:00
Mike Fährmann
dff0da60f9
[ytdl] add 'generic' option ( #1680 )
2021-07-11 23:48:18 +02:00
Mike Fährmann
d3da96142a
[ytdl] support cookies + username&password ( #1680 )
2021-07-11 22:51:57 +02:00
Mike Fährmann
36ac2197db
[ytdl] add extractor for sites supported by youtube-dl
...
(#1680 , #878 )
Can be used by prefixing any URL with 'ytdl:',
or by setting 'extractor,ytdl.enabled' to 'true'.
2021-07-10 20:55:47 +02:00
Mike Fährmann
64240c8d42
[imagevenue] fix extraction
...
(closes #1677 )
2021-07-09 20:13:18 +02:00
Mike Fährmann
d287d2eb88
[kemonoparty] parse 'o' query parameters ( #1674 )
2021-07-09 18:29:50 +02:00
Mike Fährmann
8b036778e3
[kemonoparty] add 'max-posts' option ( #1674 )
2021-07-09 18:19:02 +02:00
Mike Fährmann
5612ca31c2
[hitomi] fix image URLs ( closes #1679 )
2021-07-09 18:01:49 +02:00
Mike Fährmann
8ecca3af58
[pixiv] add extractor for 'pixivision' articles ( #1672 )
2021-07-07 16:27:16 +02:00
Mike Fährmann
312a28e78a
[mastodon] add 'replies' option ( #1669 )
2021-07-07 00:59:02 +02:00
Mike Fährmann
513c491cea
[mastodon] reset 'params' after first pagination iteration
...
otherwise query parameters in 'params' get specified twice the second
time around - once from the 'links["next"]' URL and once from 'params'
itself.
2021-07-07 00:07:18 +02:00
Mike Fährmann
a1f5b78039
[mastodon] add 'reblogs' option ( #1669 )
2021-07-06 23:27:32 +02:00
Mike Fährmann
317ecc8180
use HTML tables in docs/formatting.md
2021-07-05 23:29:03 +02:00
Mike Fährmann
5f1b13d1a5
release version 1.18.1
2021-07-04 22:37:19 +02:00
Mike Fährmann
21c2da454f
update extractor test results
2021-07-04 22:00:32 +02:00
Mike Fährmann
7f591c78cb
[mangafox] cleanup
2021-07-04 03:21:02 +02:00
FollieHiyuki
4763bc1e4e
Add MangaExtractor for mangafox ( #1633 )
2021-07-03 22:53:21 +02:00
Mike Fährmann
b519bf567c
[hiperdex] use domain from input URL
2021-07-02 23:23:42 +02:00
Mike Fährmann
93d356712c
[mastodon] implement 'text-posts' option ( #1569 )
...
similar to Twitter's 'text-tweets'
2021-07-02 22:12:41 +02:00
Mike Fährmann
414bdc95a3
[twitter] set 'retweet_id' for original retweets ( #1481 )
2021-07-02 21:50:37 +02:00
Mike Fährmann
5323c1c73a
[twitter] ensure guest tokens are returned as string ( #1665 )
2021-07-01 14:35:53 +02:00
Mike Fährmann
9ee45f3617
[kemonoparty] warn about missing DDoS-GUARD cookies
2021-06-28 23:34:58 +02:00
Mike Fährmann
344aab3fb7
[seisoparty] warn about missing DDoS-GUARD cookies
2021-06-28 23:33:21 +02:00
Mike Fährmann
035562bd11
[twitter] remove old-style URLs from image fallback lists
2021-06-28 16:25:24 +02:00
Mike Fährmann
daf821b8b6
[seisoparty] use user names instead of IDs by default ( #1635 )
2021-06-27 22:57:20 +02:00
Mike Fährmann
e4db1bad14
[seisoparty] also extract files hosted on 'cdn-2' servers ( #1635 )
2021-06-27 22:55:09 +02:00
Mike Fährmann
267bbf5996
[mangasee] add 'chapter' and 'manga' extractors
2021-06-27 02:03:03 +02:00
Mike Fährmann
fad4918208
[deviantart] use UUIDs in internal folder/collection URLs
2021-06-26 00:56:57 +02:00
Mike Fährmann
64986f9435
fix depth counter in UrlJob
...
regression from adf4d661
2021-06-26 00:30:03 +02:00
