Mike Fährmann
8cd7759682
[reddit] cleanup ReddeitAPI.__init__ ( #1813 )
...
- remove warning about 'client-id'/'user-agent' mismatch
- only use 'user-agent' from config for custom 'client-id'
2021-08-31 17:08:02 +02:00
Mike Fährmann
0a94fe5774
[reddit] delay RedditAPI initialization ( #1813 )
...
Move it outside the constructor so that eventual exceptions can get
caught in the expected places.
2021-08-30 22:39:40 +02:00
Mike Fährmann
57854624a1
[exhentai] improve image limits check ( #1808 )
...
Check for a 'text/html' Content-Type instead of the very specific
137 bytes Content-Length, which might change depending on compression
or other factors.
2021-08-29 21:19:55 +02:00
Mike Fährmann
96fec14ef7
[deviantart] rename 'watch' option to 'auto-watch'
...
(#1466 , #1757 )
Similar reason as in e05a96db
.
'watch' is already used by the WatchExtractor class.
2021-08-29 21:10:53 +02:00
Mike Fährmann
e75f2de9da
[deviantart] add 'comments' option ( #1800 )
2021-08-29 20:56:34 +02:00
Mike Fährmann
6ce16c6d31
[deviantart] add 'tag' extractor ( closes #1803 )
2021-08-28 23:42:10 +02:00
Mike Fährmann
4e9f8fe395
[shopify] support windsorstore.com ( #1793 )
2021-08-28 18:34:12 +02:00
Mike Fährmann
95157e0f4b
[shopify] use API for product listings ( #1793 )
2021-08-28 18:23:22 +02:00
Mike Fährmann
292fffc83c
add 'j' format string conversion
...
to convert to a JSON formatted string
2021-08-28 01:19:36 +02:00
Mike Fährmann
6651da27e9
[twitter] fix 'url' extraction for users without 'expanded_url'
...
(#1532 , #1787 )
2021-08-27 18:41:16 +02:00
Mike Fährmann
ecc8da4704
[deviantart] implement a 'watch' option ( #1466 , #1757 )
2021-08-27 18:39:43 +02:00
Mike Fährmann
a4f249c22e
[deviantart] prevent exception on empty videos ( fixes #1796 )
2021-08-25 20:14:50 +02:00
Mike Fährmann
ae78d95a5f
[twitter] fix issue when filtering quote tweets ( #1792 )
...
When a user quotes his own Tweet and that Tweet gets filtered by
'"quoted": false', it could also get filtered when it appeared later
as regular Tweet.
2021-08-25 20:04:22 +02:00
Mike Fährmann
d3eab417ed
implement a 'path-strip' option
2021-08-24 23:23:12 +02:00
Mike Fährmann
72c0cd30c7
do not return with a nonzero exit status when no results found
...
also change loglevel from 'warning' to 'info'
(#1789 )
2021-08-24 18:49:13 +02:00
Mike Fährmann
6b229ac829
[furaffinity] expand URL pattern for searches ( closes #1780 )
2021-08-23 23:38:52 +02:00
Mike Fährmann
0817f468ef
[twitter] expand t.co links in user descriptions ( #1532 , #1787 )
2021-08-23 23:34:59 +02:00
Mike Fährmann
7c0ae88185
[twitter] add 'url' to user objects ( #1532 , #1787 )
2021-08-23 22:51:35 +02:00
Mike Fährmann
5919dc5b5a
[twitter] slightly improve '_transform_user()'
2021-08-23 22:28:09 +02:00
Mike Fährmann
c04f7ab139
[foolfuuka] add 'gallery' extractor ( #1785 )
2021-08-21 22:46:23 +02:00
Mike Fährmann
ddd175de77
[mangadex] prevent KeyError for manga without English title
2021-08-21 22:46:23 +02:00
Mike Fährmann
20ee091289
[429chan] add 'thread' and 'board' extractors ( closes #1773 )
2021-08-21 22:46:22 +02:00
Mike Fährmann
6b56b3ebe1
[twitter] report API errors as generic StopExtraction exceptions
...
prevents duplicate logging messages for nonexistent users
(#1759 )
2021-08-21 22:46:22 +02:00
Mike Fährmann
51eb50749f
[foolslide] remove entry for kobato.hologfx.com
2021-08-21 22:46:22 +02:00
Mike Fährmann
4718f9c5dd
[oauth] use defaults when config values are set to None/null
...
(fixes #1778 )
2021-08-21 22:46:01 +02:00
James C. Wise
1f02878351
[Deviantart] [ #1776 ] Remove the "you need session cookies to download mature scraps" warning ( #1777 )
2021-08-16 22:50:53 +02:00
Mike Fährmann
bb6a130942
automatically set required DDoS-GUARD cookies ( #1779 )
...
for kemono.party and seiso.party
2021-08-16 17:40:29 +02:00
Mike Fährmann
bd08ee2859
remove most 'yield Message.Version' statements
...
only leave them in oauth.py as noop results
2021-08-16 03:10:48 +02:00
Mike Fährmann
bdfdabf498
show warning if extractor doesn't yield any results ( #1759 )
2021-08-16 02:49:36 +02:00
Mike Fährmann
d320ee6251
implement a 'fallback' option ( closes #1770 )
2021-08-16 01:47:59 +02:00
Mike Fährmann
c866fcba48
[twitter] fix 'logout' ( #1719 )
...
delete 'auth_token' cookie and cookies.txt path
2021-08-16 01:36:34 +02:00
Mike Fährmann
9cb5ea5eda
update default User-Agent headers
2021-08-14 04:01:41 +02:00
Mike Fährmann
1e0f59d902
release version 1.18.3
2021-08-13 21:20:36 +02:00
Mike Fährmann
52984f7e22
[twitter] add option to log out when blocked ( #1719 )
2021-08-12 19:11:41 +02:00
Mike Fährmann
ed4b3c48cb
fix flake8 and other tests
2021-08-12 16:05:26 +02:00
enormous-muscles
975e1ac6e2
Add Wikieat extractor ( #1699 )
...
* Add Wikieat extractor
* Add Wikieat extractor to extractor list
2021-08-12 15:13:20 +02:00
Nyasume
fa6af46756
Added ability to download GIFs instead of mp4 from Luscious and Reactor ( #1701 )
2021-08-12 15:12:42 +02:00
Ryu JuHeon
9429eaa0a3
[hitomi]: fix image URLs ( #1765 )
2021-08-12 14:39:10 +02:00
Mike Fährmann
c34dbc86bb
[kemonoparty] update file server domain ( #1764 )
2021-08-10 22:24:08 +02:00
Mike Fährmann
e5a93e113f
[twitter] extend 'replies' option ( #1254 )
...
Allow setting 'replies to '"self"' to only download from self-replies.
2021-08-10 22:14:00 +02:00
Mike Fährmann
f9096584ab
[behance] fix 'collection' extraction
2021-08-10 00:48:31 +02:00
Mike Fährmann
229498b8aa
[twitter] warn about suspended accounts etc ( closes #1759 )
2021-08-09 02:58:27 +02:00
Mike Fährmann
a5de2244d4
[furaffinity] fix using 'category-tranfer' ( #1274 )
2021-08-08 23:50:32 +02:00
Mike Fährmann
cadfad4eea
[danbooru] add 'external' option ( closes #1747 )
2021-08-08 19:18:41 +02:00
Mike Fährmann
5b1c62bfa9
[furaffinity] add 'external' option ( closes #1492 )
2021-08-08 19:16:02 +02:00
Mike Fährmann
b5b1cf22b7
[downloader:http] reorder HTTP header sources
...
so that any header can be overwritten by a user, except Range
2021-08-05 23:01:54 +02:00
Mike Fährmann
5d5ab669fa
[instagram] use custom User-Agent header for video downloads
...
(#1682 , #1623 , #1580 )
2021-08-05 22:26:47 +02:00
Mike Fährmann
7b029dfe85
[instagram] increase default delay between HTTP requests to 8s
...
(closes #1732 )
2021-08-05 22:08:35 +02:00
Mike Fährmann
5eca3781be
[kemonoparty] fix username extraction ( #1750 )
2021-08-04 16:09:22 +02:00
Mike Fährmann
fe970fc87f
[vk] prevent exception for empty/private profiles (fixes 1742)
2021-08-02 15:38:51 +02:00