Mike Fährmann
a67e002f40
update docs/supportedsites
...
- use Markdown with inline HTML instead of reStructuredText
- move file from docs/supportedsites.rst to docs/supportedsites.md
- update Makefile, README, etc
2021-03-12 03:03:48 +01:00
Mike Fährmann
df94182e11
implement 'parent-metadata' option ( #1364 )
...
experimental, might not work as expected, etc.
2021-03-11 01:10:34 +01:00
Mike Fährmann
4be27ff0fe
[nozomi] support '/index-N.html' URLs ( closes #1365 )
...
and '/index-Popular-N.html'
2021-03-11 01:06:47 +01:00
Mike Fährmann
780bac4c8a
[gelbooru] update video server ( fixes #1368 )
...
from 'https://img2.gelbooru.com ' to 'https://img3.gelbooru.com '
and provide fallback URLs
2021-03-10 01:48:07 +01:00
Mike Fährmann
f8441e851a
[hentaifox] improve image extraction ( fixes #1366 )
...
build image URLs from embedded JSON data
instead 0f rewriting thumbnail URLs
2021-03-10 01:38:32 +01:00
Mike Fährmann
c7c3fef0bc
[exhentai] support '/tag/' URLs ( closes #1363 )
2021-03-08 22:40:51 +01:00
Mike Fährmann
90830daf85
[exhentai] improve 'favorites' extraction ( closes #1360 )
...
add special cases for when the favorite count is 0 (Never) or 1 (Once)
2021-03-07 22:40:25 +01:00
Mike Fährmann
b6719becf1
ensure '-s/--simulate' always prints filenames ( #1360 )
...
by assuming a potentially wrong filename extension in cases where the
correct one would only get known after a download started
2021-03-07 22:38:20 +01:00
Mike Fährmann
83f465faca
[deviantart] refactor 'extra' ( #1356 )
...
- change its expected type to string
- let users specify a list of sources (stash, posts) or 'all'
2021-03-07 22:23:52 +01:00
Mike Fährmann
5c32a7bf58
[deviantart] allow selecting source for 'extra' ( #1356 )
...
Setting 'extra' to "stash" or "deviations" will only download embedded
sta.sh content or deviations. 'true' still downloads both.
2021-03-06 21:31:28 +01:00
Mike Fährmann
a677123abb
[instagram] recognize 'reels' as option for 'include' ( #1329 )
2021-03-06 18:50:19 +01:00
Mike Fährmann
94faf8c85a
add type check before applying 'browser' option ( fixes #1358 )
2021-03-06 18:15:32 +01:00
Mike Fährmann
5cf593a00a
release version 1.17.0
2021-03-05 18:55:36 +01:00
Mike Fährmann
7440d1f112
[pixiv] add 'translated-tags' option ( closes #1354 )
...
(a lot more straight forward than I thought ...)
2021-03-05 17:18:51 +01:00
Ailothaen
2e8061091a
Adding handling of several input files ( #1353 )
...
* Adding handling of several input files
* Fixed flake8 error due to bad indenting
2021-03-04 21:37:26 +01:00
林博仁(Buo-ren, Lin)
6e94491847
[snap] allow access user's .netrc for site authentication ( #1352 )
...
The personal-files interface request is granted by the Snap Store.
Fixes #759 .
Signed-off-by: 林博仁(Buo-ren Lin) <Buo.Ren.Lin@gmail.com>
2021-03-04 21:36:49 +01:00
Mike Fährmann
106cdc37c0
[instagram] support '/user/reels/' URLs ( closes #1329 )
2021-03-04 21:31:18 +01:00
Mike Fährmann
524ebb133e
[instagram] refactor reel handling
2021-03-04 20:30:28 +01:00
Mike Fährmann
9785c551bc
[500px] skip unavailable photos ( #1335 )
...
instead of crashing with a KeyError exception
2021-03-04 20:26:26 +01:00
Mike Fährmann
6cfc9613fe
update some code in Extractor constructor
...
- combine '_init_headers' and '_emulate_browser' functionality
into new '_init_session'
- add 'headers' and 'ciphers' options
2021-03-03 23:13:29 +01:00
Mike Fährmann
f59e63669b
[hentaicafe] add 'search' and 'tag' extractors ( #1345 )
2021-03-03 23:09:34 +01:00
Mike Fährmann
38e66940c1
[tumblrgallery] simplify
2021-03-03 15:37:56 +01:00
Seonghyeon Cho
665499924d
Support naver webtoon ( #1331 )
...
* Support naver webtoon (WIP)
* Apply patch
* Change filename format
* Fill test results
* Fill test result
2021-03-03 15:21:13 +01:00
topozorra
a9119da4d4
support tumblrgallery.xyz
( #1298 )
...
* support `tumblrgallery.xyz`
* fix format issues
* Refactor and add post and search page support
* Fix warnings
* Few improvments
* Better file names
* Fix linting errors
* move id closer to the begining of the file name
Co-authored-by: topozorra <none>
2021-03-03 15:20:47 +01:00
Mike Fährmann
6a28b7045c
update 'docs/gallery-dl.conf'
2021-03-03 03:11:48 +01:00
Mike Fährmann
c963741860
add '-E/--extractor-info' command-line option ( #875 )
2021-03-02 23:59:56 +01:00
Mike Fährmann
bff71cde80
implement 'util.unique_squence()'
2021-03-02 23:11:08 +01:00
Mike Fährmann
bae874f370
replace 'wait-min/-max' with 'sleep-request'
...
on exhentai, idolcomplex, reactor
2021-03-02 22:55:45 +01:00
Mike Fährmann
e165e6c265
[wallhaven] add 'collections' extractor ( #1351 )
2021-03-02 01:32:26 +01:00
Mike Fährmann
faf561b6ca
[wallhaven] add 'collection' extractor ( #1351 )
2021-03-01 17:12:11 +01:00
Mike Fährmann
5d3d94ba14
[wallhaven] refactor
2021-03-01 17:06:24 +01:00
Mike Fährmann
1a38fae785
add option to use different youtube-dl modules ( fixes #1330 )
...
by setting the 'downloader.ytdl.module' value. For example
{
"downloader": {
"ytdl": {
"module": "yt_dlp"
}
}
}
or '-o module=yt_dlp'
2021-03-01 03:10:42 +01:00
Mike Fährmann
5f1a6ff6fa
remove unneeded 'TRAVIS_SKIP' from test_results.py
2021-03-01 01:38:18 +01:00
Mike Fährmann
8821dceb79
use __import__() to dynamically load modules
2021-03-01 01:27:02 +01:00
Mike Fährmann
69ea781d32
[mangadex] improve caching of manga results
...
'manga_id' being a string or integer are treated as two different keys
2021-02-28 01:34:58 +01:00
Mike Fährmann
e58039358d
[mangadex] use 'api.mangadex.org' as default API server
...
The caching issues seem to be gone.
(#1290 , #1310 )
2021-02-28 01:31:50 +01:00
Mike Fährmann
fc15930266
[readcomiconline] download high quality image versions
...
(fixes #1347 )
2021-02-28 01:11:32 +01:00
Mike Fährmann
f360778e60
[komikcast] fix extraction
2021-02-27 21:02:52 +01:00
Mike Fährmann
3df527ee2c
update extractor test results
2021-02-27 21:01:29 +01:00
Mike Fährmann
1bd3d7cfb0
[postprocessor:metadata] call expand_path() on custom paths
...
(#1299 )
2021-02-27 17:19:29 +01:00
Mike Fährmann
fe2ec9cf68
[patreon] reduce redirects when fetching campaign ID
2021-02-27 16:37:41 +01:00
Mike Fährmann
29ea54dc41
[patreon] use '"browser": "firefox"' by default ( #1117 )
2021-02-27 16:26:42 +01:00
Mike Fährmann
61fbbd2dae
[exhentai] rename metadata fields to match API results ( #1325 )
...
- gallery_id -> gid
- gallery_token -> token
- title_jp -> title_jpn
- visible -> expunged
- gallery_size -> filesize
- count -> filecount
Also changes the function of the 'metadata' option.
It is now boolean and causes extra data fields from the API to be added
instead of completely replacing the data from HTML when activated.
2021-02-26 18:21:04 +01:00
Mike Fährmann
996bfe4d4b
[hentaicafe] fix manga extractor
...
was broken since 993856b8
2021-02-26 14:24:52 +01:00
Mike Fährmann
5d69e437d0
[twitter] add option to download all media from a conversation
...
(fixes #1319 )
2021-02-26 13:50:46 +01:00
Mike Fährmann
cf5fa75d4c
add 'browser' option ( #1117 )
...
- change default user agent to Firefox ESR 78 on Windows 10
- remove 'ciphers' option
2021-02-26 13:41:27 +01:00
Mike Fährmann
92071d02f4
fix crash when 'base-directory' is an empty string ( #1339 )
2021-02-24 14:49:17 +01:00
Mike Fährmann
970fc2b2b5
allow setting 'filename' & '(base-)directory' to default
...
by setting them to 'None'/'null'
2021-02-24 02:24:22 +01:00
Mike Fährmann
e5735361ed
[exhentai] add 'metadata' option ( #1325 )
...
to select between gallery metadata from 'api' or 'html'
2021-02-23 00:23:42 +01:00
Mike Fährmann
8f095a0980
[exhentai] extract more metadata from gallery pages ( #1325 )
2021-02-22 22:58:31 +01:00