1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-23 11:12:40 +01:00
Commit Graph

2399 Commits

Author SHA1 Message Date
Mike Fährmann
6bbeaac029
[mangadex] fix extraction (fixes #1852) 2021-09-14 17:48:41 +02:00
Mike Fährmann
e9bf8d2591
[instagram] update default delay to 6-12 seconds (#1835) 2021-09-14 17:47:11 +02:00
Mike Fährmann
c9e6693530
allow specifying a minimum/maximum for 'sleep-*' options (#1835)
for example '"sleep-request": [5.0, 10.0]' to wait between 5 and 10
seconds between each HTTP request
2021-09-14 17:40:05 +02:00
Mike Fährmann
2ff2974353
[common] update default argument handling in Extractor.request()
more lines of code, but slightly less execution time
2021-09-11 01:26:11 +02:00
Mike Fährmann
0fd959a2a7
[twitter] support '/with_replies' URLs (closes #1833) 2021-09-10 20:44:26 +02:00
Mike Fährmann
e93360e45d
[reddit] extend subcategory depending on input URL (closes #1836)
- https://www.reddit.com/r/lavaporn/
  -> 'subreddit'

- https://www.reddit.com/r/lavaporn/new/
  -> 'subreddit-new'

- https://www.reddit.com/user/username/
  -> 'user'

- https://www.reddit.com/user/username/gilded/
  -> 'user-gilded'
2021-09-10 20:44:17 +02:00
Mike Fährmann
7bbb1f92d7
[gelbooru_v02] add 'favorite' extractor (closes #1834) 2021-09-10 20:43:59 +02:00
Mike Fährmann
4ec11af6a4
[kemonoparty] implement login with username & password (#1824) 2021-09-09 01:06:25 +02:00
Mike Fährmann
0e33746fe0
[artstation] use '/album/all' view for user portfolios (#1826) 2021-09-08 21:46:58 +02:00
Mike Fährmann
4f5f9ed1e5
[oauth] fix typo
this has been here since February ...
(8974f036)
2021-09-08 20:14:39 +02:00
Mike Fährmann
83bbb628d8
[kemonoparty] add 'favorite' extractor (#1824) 2021-09-08 00:32:49 +02:00
Mike Fährmann
35d75a4071
[erome] send Referer header for file downloads (fixes #1829) 2021-09-08 00:29:16 +02:00
Mike Fährmann
44f572c27f
[deviantart] implement a 'auto-unwatch' option (#1466, #1757) 2021-09-08 00:27:28 +02:00
Mike Fährmann
d79bcb6236
allow extractors to register a 'finalize()' method 2021-09-07 21:15:30 +02:00
Mike Fährmann
47a780942c
update extractor test results 2021-09-03 19:36:12 +02:00
Mike Fährmann
eed6ef3de0
[pixiv] fix pixivision title extraction 2021-09-02 22:34:59 +02:00
Mike Fährmann
7645cdfb88
[inkbunny] fix extraction (closes #1816)
'digitalsales', 'forsale', and 'printsales'
are no longer included in the data returned from the API.
2021-09-02 18:41:08 +02:00
Mike Fährmann
3e36543c98
[nhentai] add 'favorite' extractor (#1814) 2021-09-02 18:26:22 +02:00
Mike Fährmann
656358ea92
[nhentai] use API endpoint for gallery data 2021-09-02 17:40:41 +02:00
Mike Fährmann
8cd7759682
[reddit] cleanup ReddeitAPI.__init__ (#1813)
- remove warning about 'client-id'/'user-agent' mismatch
- only use 'user-agent' from config for custom 'client-id'
2021-08-31 17:08:02 +02:00
Mike Fährmann
0a94fe5774
[reddit] delay RedditAPI initialization (#1813)
Move it outside the constructor so that eventual exceptions can get
caught in the expected places.
2021-08-30 22:39:40 +02:00
Mike Fährmann
57854624a1
[exhentai] improve image limits check (#1808)
Check for a 'text/html' Content-Type instead of the very specific
137 bytes Content-Length, which might change depending on compression
or other factors.
2021-08-29 21:19:55 +02:00
Mike Fährmann
96fec14ef7
[deviantart] rename 'watch' option to 'auto-watch'
(#1466, #1757)

Similar reason as in e05a96db.
'watch' is already used by the WatchExtractor class.
2021-08-29 21:10:53 +02:00
Mike Fährmann
e75f2de9da
[deviantart] add 'comments' option (#1800) 2021-08-29 20:56:34 +02:00
Mike Fährmann
6ce16c6d31
[deviantart] add 'tag' extractor (closes #1803) 2021-08-28 23:42:10 +02:00
Mike Fährmann
4e9f8fe395
[shopify] support windsorstore.com (#1793) 2021-08-28 18:34:12 +02:00
Mike Fährmann
95157e0f4b
[shopify] use API for product listings (#1793) 2021-08-28 18:23:22 +02:00
Mike Fährmann
6651da27e9
[twitter] fix 'url' extraction for users without 'expanded_url'
(#1532, #1787)
2021-08-27 18:41:16 +02:00
Mike Fährmann
ecc8da4704
[deviantart] implement a 'watch' option (#1466, #1757) 2021-08-27 18:39:43 +02:00
Mike Fährmann
a4f249c22e
[deviantart] prevent exception on empty videos (fixes #1796) 2021-08-25 20:14:50 +02:00
Mike Fährmann
ae78d95a5f
[twitter] fix issue when filtering quote tweets (#1792)
When a user quotes his own Tweet and that Tweet gets filtered by
'"quoted": false', it could also get filtered when it appeared later
as regular Tweet.
2021-08-25 20:04:22 +02:00
Mike Fährmann
6b229ac829
[furaffinity] expand URL pattern for searches (closes #1780) 2021-08-23 23:38:52 +02:00
Mike Fährmann
0817f468ef
[twitter] expand t.co links in user descriptions (#1532, #1787) 2021-08-23 23:34:59 +02:00
Mike Fährmann
7c0ae88185
[twitter] add 'url' to user objects (#1532, #1787) 2021-08-23 22:51:35 +02:00
Mike Fährmann
5919dc5b5a
[twitter] slightly improve '_transform_user()' 2021-08-23 22:28:09 +02:00
Mike Fährmann
c04f7ab139
[foolfuuka] add 'gallery' extractor (#1785) 2021-08-21 22:46:23 +02:00
Mike Fährmann
ddd175de77
[mangadex] prevent KeyError for manga without English title 2021-08-21 22:46:23 +02:00
Mike Fährmann
20ee091289
[429chan] add 'thread' and 'board' extractors (closes #1773) 2021-08-21 22:46:22 +02:00
Mike Fährmann
6b56b3ebe1
[twitter] report API errors as generic StopExtraction exceptions
prevents duplicate logging messages for nonexistent users
(#1759)
2021-08-21 22:46:22 +02:00
Mike Fährmann
51eb50749f
[foolslide] remove entry for kobato.hologfx.com 2021-08-21 22:46:22 +02:00
Mike Fährmann
4718f9c5dd
[oauth] use defaults when config values are set to None/null
(fixes #1778)
2021-08-21 22:46:01 +02:00
James C. Wise
1f02878351
[Deviantart] [#1776] Remove the "you need session cookies to download mature scraps" warning (#1777) 2021-08-16 22:50:53 +02:00
Mike Fährmann
bb6a130942
automatically set required DDoS-GUARD cookies (#1779)
for kemono.party and seiso.party
2021-08-16 17:40:29 +02:00
Mike Fährmann
bd08ee2859
remove most 'yield Message.Version' statements
only leave them in oauth.py as noop results
2021-08-16 03:10:48 +02:00
Mike Fährmann
c866fcba48
[twitter] fix 'logout' (#1719)
delete 'auth_token' cookie and cookies.txt path
2021-08-16 01:36:34 +02:00
Mike Fährmann
9cb5ea5eda
update default User-Agent headers 2021-08-14 04:01:41 +02:00
Mike Fährmann
52984f7e22
[twitter] add option to log out when blocked (#1719) 2021-08-12 19:11:41 +02:00
Mike Fährmann
ed4b3c48cb
fix flake8 and other tests 2021-08-12 16:05:26 +02:00
enormous-muscles
975e1ac6e2
Add Wikieat extractor (#1699)
* Add Wikieat extractor

* Add Wikieat extractor to extractor list
2021-08-12 15:13:20 +02:00
Nyasume
fa6af46756
Added ability to download GIFs instead of mp4 from Luscious and Reactor (#1701) 2021-08-12 15:12:42 +02:00