Mike Fährmann
87202b8d74
[inkbunny] add 'user' and 'post' extractors ( #283 )
2020-07-22 22:21:30 +02:00
Mike Fährmann
b62ea72533
release version 1.14.3
2020-07-18 18:34:36 +02:00
Mike Fährmann
2ecf1efb16
update extractor test results
...
- tumblr: remove deleted post
- jaiminisbox: replace removed manga/chapters
- smugmug: one inconsequential field got removed
2020-07-18 15:12:28 +02:00
Mike Fährmann
d5fcffcced
[subscribestar] add login capabilities ( #852 )
2020-07-17 22:18:01 +02:00
Mike Fährmann
ecaecc4064
[exhentai] add 'domain' option ( #897 )
2020-07-17 22:17:46 +02:00
Mike Fährmann
45c32213dc
[gfycat] retry 404'ed videos on redgifs ( closes #874 )
2020-07-16 15:00:32 +02:00
Mike Fährmann
cf44571fe0
[gfycat] add 'user' and 'search' extractors
2020-07-16 15:00:32 +02:00
Mike Fährmann
11b744d971
[mangakakalot] improve/fix chapter extraction
2020-07-16 15:00:31 +02:00
Mike Fährmann
2da71cb561
[twitter] raise proper exception if user doesn't exist ( #891 )
2020-07-16 15:00:31 +02:00
Mike Fährmann
df7217c36d
update supportedsites.py ( #889 , #893 )
...
- mention optional auth access for more sites
- link to OAuth and Cookies sections in README
2020-07-16 15:00:31 +02:00
Zanny
9339ac0c7b
Document Extractor Prefixing ( #892 )
2020-07-15 21:28:20 +02:00
HRXN
51b49a361d
mention optional auth access for furaffinity ( #893 )
2020-07-14 15:12:26 +02:00
Leonardo Taccari
86e5a05e29
[twitter] add support for nitter.net URLs in pattern ( #890 )
...
Please note that URLs are only "translated", all requests are still
done always via the Twitter API.
2020-07-13 23:48:42 +02:00
Mike Fährmann
e17d4f44f6
[newgrounds] fix favorites extraction
2020-07-13 23:08:45 +02:00
Mike Fährmann
c51fbd72ba
update extractor test results
2020-07-13 22:57:48 +02:00
Mike Fährmann
9cd1bc6907
[mangakakalot] update URL patterns, fix flake8 errors ( #876 )
2020-07-13 22:47:24 +02:00
jakem72360
7dfdcc3fbf
[mangakakalot] Added extractors for MangaKakalot ( #876 )
2020-07-13 21:20:09 +02:00
Mike Fährmann
cb0132e441
[khinsider] add 'format' option ( closes #840 )
2020-07-13 17:17:58 +02:00
Mike Fährmann
d594977ca1
[artstation] add 'following' extractor ( closes #888 )
2020-07-12 23:03:05 +02:00
Mike Fährmann
3855d0dd3c
[twitter] add debug messages for all skipped Tweets ( #867 )
2020-07-11 00:41:50 +02:00
Mike Fährmann
27d163afb3
[imgur] support all '/t/...' URLs ( closes #880 )
...
… instead of just '/t/unmuted/'
2020-07-09 22:17:01 +02:00
Mike Fährmann
f5c9f1d066
[subscribestar] use current date instead of hard-coded '2020' ( #852 )
2020-07-09 22:12:39 +02:00
Mike Fährmann
5a6e750704
[reddit] fix AttributeError when using 'recursion' ( fixes #879 )
2020-07-09 19:19:05 +02:00
Mike Fährmann
94a08f0bcb
[reddit] limit title length in default filenames ( #873 )
2020-07-09 18:19:33 +02:00
Mike Fährmann
3424fb96c3
[redgifs] support gifsdeliverynetwork.com URLs ( #874 )
2020-07-09 18:04:30 +02:00
Mike Fährmann
f1344fe552
[patreon] yield images and attachments before postfiles ( #871 )
...
The reported filename of the 'postfile' entry of each post may differ
from the corresponding entry in the list of images or attachments,
and be outright "wrong".
2020-07-09 00:10:26 +02:00
Mike Fährmann
dbf841ebd1
prevent unhandled exception on Cloudflare challenges ( #868 )
...
The relatively new v2 challenges aren't supported (*), but retrying
often enough may yield a v1 challenge which can be solved.
(*) and probably never will. They are far too complicated to do without
a real browser.
2020-07-08 23:22:33 +02:00
Mike Fährmann
6e2af9a8d8
[twitter] improve error message formatting
2020-07-06 23:13:05 +02:00
Mike Fährmann
74494b43d3
let zsh completion immediately suggest cmdline options
...
instead of expecting an URL and trying to complete it.
2020-07-05 22:36:00 +02:00
Mike Fährmann
c28db7a6ea
[8muses] support 'comics.8muses.com' URLs
2020-07-05 19:43:45 +02:00
Mike Fährmann
4d8b3e4f70
defer directory creation ( fixes #722 )
...
Only call os.makedirs() before a file is getting downloaded,
and not immediately for every Directory message.
2020-07-04 22:15:23 +02:00
Mike Fährmann
d5bfb0b38c
set pseudo extension for Metadata messages ( #865 )
...
This prevents pathfmt.filename from potentially being empty.
2020-07-04 22:14:39 +02:00
Mike Fährmann
d0cd86e0d5
add zsh completion script ( #150 )
2020-07-04 18:05:31 +02:00
Mike Fährmann
821524e4ee
[subscribestar] add 'user' and 'post' extractors ( #852 )
2020-07-03 21:08:47 +02:00
Mike Fährmann
4f16fd37fe
release version 1.14.2
2020-06-27 20:46:01 +02:00
Mike Fährmann
e62ebb4643
update CHANGELOG before building sdist and wheel packages
2020-06-27 19:45:09 +02:00
Mike Fährmann
f1ddbff0b5
[aryion] add 'recursive' option ( fixes #832 )
...
This is enabled by default and will recursively go through all
(sub)folders in an artist's gallery.
The old method of using "Latest Updates" lists can be restored by
disabling this option.
2020-06-26 23:36:50 +02:00
Mike Fährmann
699062b91f
Revert "[kissmanga] workaround for CAPTCHAs ( #818 )"
...
This reverts commit 4cf3d54718
2020-06-25 19:35:03 +02:00
Mike Fährmann
0cac14c3bd
update extractor test results
2020-06-25 19:11:47 +02:00
Mike Fährmann
5e5be67c26
[tumblr] prevent KeyErrors when using reblogs=same-blog
...
(fixes #851 )
2020-06-25 19:00:12 +02:00
Mike Fährmann
9da2bc67f8
[twitter] add option to filter media from quoted tweets ( #854 )
2020-06-25 18:59:25 +02:00
Mike Fährmann
56ab5fb8f4
[twitter] improve handling of quoted tweets ( #854 )
...
Split each "quote" into two parts:
- the original tweet
- the tweet that quoted the original
2020-06-24 21:14:18 +02:00
Mike Fährmann
bd0e1ca1a5
[imgur] build directory path for each file ( closes #842 )
2020-06-21 19:25:52 +02:00
Mike Fährmann
a8c2d997e8
[twitter] treat quoted tweets like retweets ( #833 )
...
- filter them when 'retweets' is disabled
- set 'author' to the creator of the quoted tweet
like it was before the rewrite
2020-06-21 19:14:12 +02:00
Mike Fährmann
aed1c63e51
[twitter] improve search results ( fixes #847 )
...
Adding 'tweet_search_mode=live' to the query parameters
is the most important part here.
2020-06-21 15:53:20 +02:00
Mike Fährmann
0e714b9a0e
[pinterest] add 'section' extractor ( #835 )
2020-06-21 00:08:14 +02:00
Mike Fährmann
53cc498d9c
improve config lookup when there are multiple possible locations
...
This specifically applies to all Mastodon extractors and all
extractors with a 'basecategory', i.e. 'booru', 'foolslide', etc.
Values inside those general config locations wouldn't be recognized
when a value with the same was set on the 'extractor' level.
For example 'extractor.mastodon.directory' should be used over
'extractor.directory' when both are set, but this was impossible
with the previous implementation.
(fixes #843 )
2020-06-21 00:07:10 +02:00
Mike Fährmann
1b3870a4be
flush after writing JSON in DataJob() ( #727 )
...
… and remove the dead handle_finalize() method,
which is never called since DataJob() overrides run().
2020-06-19 23:05:44 +02:00
Mike Fährmann
d81a8e6544
[twitter] update tests
2020-06-19 23:01:02 +02:00
Mike Fährmann
d39eedd9bb
[twitter] improve handling of deleted tweets ( fixes #838 )
2020-06-19 18:11:37 +02:00
