1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-23 19:22:32 +01:00
Commit Graph

3145 Commits

Author SHA1 Message Date
Mike Fährmann
b6719becf1
ensure '-s/--simulate' always prints filenames (#1360)
by assuming a potentially wrong filename extension in cases where the
correct one would only get known after a download started
2021-03-07 22:38:20 +01:00
Mike Fährmann
83f465faca
[deviantart] refactor 'extra' (#1356)
- change its expected type to string
- let users specify a list of sources (stash, posts) or 'all'
2021-03-07 22:23:52 +01:00
Mike Fährmann
5c32a7bf58
[deviantart] allow selecting source for 'extra' (#1356)
Setting 'extra' to "stash" or "deviations" will only download embedded
sta.sh content or deviations. 'true' still downloads both.
2021-03-06 21:31:28 +01:00
Mike Fährmann
a677123abb
[instagram] recognize 'reels' as option for 'include' (#1329) 2021-03-06 18:50:19 +01:00
Mike Fährmann
94faf8c85a
add type check before applying 'browser' option (fixes #1358) 2021-03-06 18:15:32 +01:00
Mike Fährmann
5cf593a00a
release version 1.17.0 2021-03-05 18:55:36 +01:00
Mike Fährmann
7440d1f112
[pixiv] add 'translated-tags' option (closes #1354)
(a lot more straight forward than I thought ...)
2021-03-05 17:18:51 +01:00
Ailothaen
2e8061091a
Adding handling of several input files (#1353)
* Adding handling of several input files

* Fixed flake8 error due to bad indenting
2021-03-04 21:37:26 +01:00
林博仁(Buo-ren, Lin)
6e94491847
[snap] allow access user's .netrc for site authentication (#1352)
The personal-files interface request is granted by the Snap Store.

Fixes #759.

Signed-off-by: 林博仁(Buo-ren Lin) <Buo.Ren.Lin@gmail.com>
2021-03-04 21:36:49 +01:00
Mike Fährmann
106cdc37c0
[instagram] support '/user/reels/' URLs (closes #1329) 2021-03-04 21:31:18 +01:00
Mike Fährmann
524ebb133e
[instagram] refactor reel handling 2021-03-04 20:30:28 +01:00
Mike Fährmann
9785c551bc
[500px] skip unavailable photos (#1335)
instead of crashing with a KeyError exception
2021-03-04 20:26:26 +01:00
Mike Fährmann
6cfc9613fe
update some code in Extractor constructor
- combine '_init_headers' and '_emulate_browser' functionality
  into new '_init_session'
- add 'headers' and 'ciphers' options
2021-03-03 23:13:29 +01:00
Mike Fährmann
f59e63669b
[hentaicafe] add 'search' and 'tag' extractors (#1345) 2021-03-03 23:09:34 +01:00
Mike Fährmann
38e66940c1
[tumblrgallery] simplify 2021-03-03 15:37:56 +01:00
Seonghyeon Cho
665499924d
Support naver webtoon (#1331)
* Support naver webtoon (WIP)

* Apply patch

* Change filename format

* Fill test results

* Fill test result
2021-03-03 15:21:13 +01:00
topozorra
a9119da4d4
support tumblrgallery.xyz (#1298)
* support `tumblrgallery.xyz`

* fix format issues

* Refactor and add post and search page support

* Fix warnings

* Few improvments

* Better file names

* Fix linting errors

* move id closer to the begining of the file name

Co-authored-by: topozorra <none>
2021-03-03 15:20:47 +01:00
Mike Fährmann
6a28b7045c
update 'docs/gallery-dl.conf' 2021-03-03 03:11:48 +01:00
Mike Fährmann
c963741860
add '-E/--extractor-info' command-line option (#875) 2021-03-02 23:59:56 +01:00
Mike Fährmann
bff71cde80
implement 'util.unique_squence()' 2021-03-02 23:11:08 +01:00
Mike Fährmann
bae874f370
replace 'wait-min/-max' with 'sleep-request'
on exhentai, idolcomplex, reactor
2021-03-02 22:55:45 +01:00
Mike Fährmann
e165e6c265
[wallhaven] add 'collections' extractor (#1351) 2021-03-02 01:32:26 +01:00
Mike Fährmann
faf561b6ca
[wallhaven] add 'collection' extractor (#1351) 2021-03-01 17:12:11 +01:00
Mike Fährmann
5d3d94ba14
[wallhaven] refactor 2021-03-01 17:06:24 +01:00
Mike Fährmann
1a38fae785
add option to use different youtube-dl modules (fixes #1330)
by setting the 'downloader.ytdl.module' value. For example

{
    "downloader": {
        "ytdl": {
            "module": "yt_dlp"
        }
    }
}

or '-o module=yt_dlp'
2021-03-01 03:10:42 +01:00
Mike Fährmann
5f1a6ff6fa
remove unneeded 'TRAVIS_SKIP' from test_results.py 2021-03-01 01:38:18 +01:00
Mike Fährmann
8821dceb79
use __import__() to dynamically load modules 2021-03-01 01:27:02 +01:00
Mike Fährmann
69ea781d32
[mangadex] improve caching of manga results
'manga_id' being a string or integer are treated as two different keys
2021-02-28 01:34:58 +01:00
Mike Fährmann
e58039358d
[mangadex] use 'api.mangadex.org' as default API server
The caching issues seem to be gone.
(#1290, #1310)
2021-02-28 01:31:50 +01:00
Mike Fährmann
fc15930266
[readcomiconline] download high quality image versions
(fixes #1347)
2021-02-28 01:11:32 +01:00
Mike Fährmann
f360778e60
[komikcast] fix extraction 2021-02-27 21:02:52 +01:00
Mike Fährmann
3df527ee2c
update extractor test results 2021-02-27 21:01:29 +01:00
Mike Fährmann
1bd3d7cfb0
[postprocessor:metadata] call expand_path() on custom paths
(#1299)
2021-02-27 17:19:29 +01:00
Mike Fährmann
fe2ec9cf68
[patreon] reduce redirects when fetching campaign ID 2021-02-27 16:37:41 +01:00
Mike Fährmann
29ea54dc41
[patreon] use '"browser": "firefox"' by default (#1117) 2021-02-27 16:26:42 +01:00
Mike Fährmann
61fbbd2dae
[exhentai] rename metadata fields to match API results (#1325)
- gallery_id    -> gid
- gallery_token -> token
- title_jp      -> title_jpn
- visible       -> expunged
- gallery_size  -> filesize
- count         -> filecount

Also changes the function of the 'metadata' option.
It is now boolean and causes extra data fields from the API to be added
instead of completely replacing the data from HTML when activated.
2021-02-26 18:21:04 +01:00
Mike Fährmann
996bfe4d4b
[hentaicafe] fix manga extractor
was broken since 993856b8
2021-02-26 14:24:52 +01:00
Mike Fährmann
5d69e437d0
[twitter] add option to download all media from a conversation
(fixes #1319)
2021-02-26 13:50:46 +01:00
Mike Fährmann
cf5fa75d4c
add 'browser' option (#1117)
- change default user agent to Firefox ESR 78 on Windows 10
- remove 'ciphers' option
2021-02-26 13:41:27 +01:00
Mike Fährmann
92071d02f4
fix crash when 'base-directory' is an empty string (#1339) 2021-02-24 14:49:17 +01:00
Mike Fährmann
970fc2b2b5
allow setting 'filename' & '(base-)directory' to default
by setting them to 'None'/'null'
2021-02-24 02:24:22 +01:00
Mike Fährmann
e5735361ed
[exhentai] add 'metadata' option (#1325)
to select between gallery metadata from 'api' or 'html'
2021-02-23 00:23:42 +01:00
Mike Fährmann
8f095a0980
[exhentai] extract more metadata from gallery pages (#1325) 2021-02-22 22:58:31 +01:00
Mike Fährmann
511fadf313
update README.rst
- add table of contents
- update "Standalone Executable" section
- mention OAuth for Mastodon instances
2021-02-22 22:57:35 +01:00
Mike Fährmann
ffce8d85e7
[cyberdrop] update
- add test and archive_fmt
- extract more metadata
2021-02-22 19:36:34 +01:00
Mike Fährmann
de0656941b
[twitter] add extractor for followed users (#1337)
https://twitter.com/USER/following or
https://twitter.com/id:USERID/following
2021-02-22 18:22:01 +01:00
Mike Fährmann
e39aea42cd
fix supportedsites.py for modules without docstring
(fixes #1332)
2021-02-21 22:57:37 +01:00
loragja
7b5ee922b7
cyberdrop extractor (#1328)
* create cyberdrop extractor

* add cyberdrop to list of extractors

* fix formatting

* change class name from CyberdropExtractor to CyberdropAlbumExtractor

* add cyberdrop to list of supported sites

* attempt to clean up diff of supportedsites.rst

* replace regex with functions from text library
2021-02-21 20:42:45 +01:00
Mike Fährmann
5ad2b9c82b
[deviantart] extend 'extra' option
also download from embedded DeviantArt posts
2021-02-21 19:27:04 +01:00
Mike Fährmann
560277394e
[downloader:http] add 'headers' option (#1322) 2021-02-21 19:13:39 +01:00