Mirrors/gallery-dl
1
0
Fork 0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-23 11:12:40 +01:00
Code Issues Releases Wiki Activity
2,258 Commits 6 Branches 164 Tags 16 MiB
adcd7cb24a
Commit Graph

2258 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
adcd7cb24a
[downloader:http] add another MIME type for '.rar' files (#628) 2020-03-01 20:42:13 +01:00
Mike Fährmann
ce5e2a58fe
[imgbb] update test results 
Image server domain changed from
https://image.ibb.co/ to https://i.ibb.co/
 2020-03-01 20:38:25 +01:00
Mike Fährmann
f117e32910
[danbooru] restore 'popular' functionality 2020-02-29 23:37:53 +01:00
Mike Fährmann
39b48d665b
[hiperdex] use proper name for 'chapter_minor' 2020-02-29 00:18:54 +01:00
Mike Fährmann
8fbbaa54ff
[bcy] fix partial image URLs (#613) 
Images from new posts can have incomplete/partial URLs (1)
without any filename extension when fetching their data from
'/apiv3/user/selfPosts', so now all data gets taken from
'/item/detail/ID' pages.

It is currently unknown how to get the non-watermarked original version
of these images, or if that is possible at all. (2)
Images with a watermark will have their 'filter' metadata field set to
"watermark". For original images this field is an empty string "".

Enabling the 'noop' option will, in addition to the watermarked version,
yield the the '~noop.image' filter version (3),
where 'filter' is set to "noop".

(1) "https://img-bcy-qn.pstatp.com/banciyuan/3ccdff22479c4060aadc86718209b281"
(2) "https://p1-bcy.byteimg.com/img/banciyuan/3ccdff22479c4060aadc86718209b281~tplv-banciyuan-logo-v3:wqnpnLLlhZLlpKfprZTnjotfCuWNiuasoeWFgyAtIEFDR-eIseWlveiAheekvuWMug==.image"
(3) "https://p1-bcy.byteimg.com/img/banciyuan/3ccdff22479c4060aadc86718209b281~noop.image"
 2020-02-28 22:57:10 +01:00
Mike Fährmann
86c00f9e66
[danbooru] move extractor logic from booru.py 2020-02-28 22:53:45 +01:00
Mike Fährmann
1d4a369ea2
update extractor test results 2020-02-27 22:15:40 +01:00
Mike Fährmann
7625912b31
[piczel] improve and update 
- fix tag names
- fix a bug in _pagination()
- parse datetime in 'created_at' as 'date'
- rewrite main loop
- replace user profile test
 2020-02-27 22:13:12 +01:00
Mike Fährmann
ec85bf90de
use context managers in cache.py & add tests 2020-02-25 23:08:47 +01:00
Mike Fährmann
913b8333cc
write DeviantArt refresh-tokens to cache (#616) 
Writing the token is currently disabled by default and must be
enabled with 'extractor.oauth.cache'.

'extractor.deviantart.refresh-token' must be set to '"cache"'
to use the cached token.
 2020-02-25 22:55:11 +01:00
Mike Fährmann
2a4f227e08
warn about expired cookies 2020-02-25 00:34:42 +01:00
Mike Fährmann
34887ae139
fix bugs in DatabaseCacheDecorator.update()/.invalidate() 
- call db.commit() after changes have been made
- remove 'LIMIT 1' from the DELETE statement in invalidate()
    (only available if SQLite3 was compiled with the right flags
     enabled, syntax error otherwise)
 2020-02-23 21:04:36 +01:00
Mike Fährmann
380b693fad
[downloader:http] add more MIME types for '.bmp' files (#621) 2020-02-23 16:51:04 +01:00
Mike Fährmann
4e361b3008
add tests for specific datetime values 2020-02-23 16:48:30 +01:00
Mike Fährmann
80ecb99089
[hitomi] fix extraction 2020-02-22 22:07:21 +01:00
Mike Fährmann
247c9e1416
[vsco] update gallery URL pattern 2020-02-22 21:39:31 +01:00
Mike Fährmann
19ae6f3fc4
update test results 
- twitter:

    Don't test the whole kwdict, only the actual content, since the
    keyword hash changes whenever that user changes his display name.

- khinsider:

    Download host changed
 2020-02-22 03:25:32 +01:00
Mike Fährmann
cc5079c844
[hiperdex] add chapter and manga extractors (closes #606) 2020-02-22 03:09:29 +01:00
Mike Fährmann
64bdec8430
[deviantart] check availability of intermediary URLs (fixes #609) 2020-02-21 03:10:53 +01:00
Mike Fährmann
5607dd3646
[hitomi] follow multiple redirects 2020-02-20 18:22:13 +01:00
Mike Fährmann
6e759fe2f5
reword note for 'extractor.deviantart.refresh-token' (#612) 2020-02-19 23:39:27 +01:00
Mike Fährmann
765b2a0527
[hentaihand] add extractors (closes #605) 2020-02-19 21:55:47 +01:00
Mike Fährmann
d94215d119
[tumblr] replace '-' with ' ' in tag searches (fixes #611) 
To search for tags with actual minus signs in them
(there shouldn't be too many,) manually replace those
with url-encoded minus characters ('-' -> '%2d')
before inputting them into gallery-dl:

https://s679874.tumblr.com/tagged/tag-with-minus
 ->
https://s679874.tumblr.com/tagged/tag%2dwith%2dminus
 2020-02-17 23:29:13 +01:00
Mike Fährmann
5cdf1b1319
fix --verbose/--quiet 
caused by 383795b
 2020-02-17 22:29:51 +01:00
Mike Fährmann
78e8d33c97
release version 1.13.0 2020-02-16 22:40:36 +01:00
Mike Fährmann
e6cd49e78b
update extractor test results 2020-02-16 21:48:46 +01:00
Mike Fährmann
90e4c645ba
[formatter] allow multiple "special" format specifiers (#595) 
It is now, for example, possible to specify multiple replacement
operations per format replacement field: {name:Ra/b/Rc/d/}
 2020-02-16 21:47:08 +01:00
Mike Fährmann
5d9437b398
[vsco] skip "invalid" entities 2020-02-15 23:49:44 +01:00
Mike Fährmann
650f2b6d58
[furaffinity] accept sfw.furaffinity.net URLs (closes #608) 
Just as an alias for regular URLs with no extra content filtering.
 2020-02-15 22:47:12 +01:00
Mike Fährmann
219c4cc78c
[formatter] allow for numeric list and string indices 2020-02-15 22:46:22 +01:00
Mike Fährmann
7d1da614d9
[formatter] implement field name alternatives (#525) 
The format string '{a|b|c}' will now try to use the value from 'a' and
fall back to 'b' and 'c' if accessing a field raises an exception or
if its value is None.
 2020-02-15 17:58:21 +01:00
Mike Fährmann
67ea80222c
link to post processor example in 'pixiv.ugoira' docs 2020-02-14 01:22:16 +01:00
Mike Fährmann
74e684e828
[twitter] change default value for 'videos' to 'true' 
Every other 'videos' option defaulted to 'true', except Twitter.
 2020-02-14 01:03:42 +01:00
Mike Fährmann
ab13f81fd7
add example to 'cookies' docs 2020-02-13 23:44:38 +01:00
Mike Fährmann
c7cf9dd111
[furaffinity] support classic layout (#284) 2020-02-12 21:39:43 +01:00
Mike Fährmann
138135c190
[furaffinity] add extractors (#284) 2020-02-11 19:51:24 +01:00
Mike Fährmann
b9c574bd1d
[patreon] log skipped files (#590) 2020-02-11 19:01:07 +01:00
Mike Fährmann
80ea9104b8
[8kun] adjust URL pattern 2020-02-11 19:00:13 +01:00
Mike Fährmann
c76c8b765a
[cloudflare] unescape challenge URL 2020-02-09 18:51:29 +01:00
Mike Fährmann
ce26070231
[pixiv] reduce calls to '/user/detail' 2020-02-09 13:54:58 +01:00
Mike Fährmann
da0d5f6092
[oauth] add 'port' option (#604) 2020-02-09 13:45:44 +01:00
Mike Fährmann
719b63d0ca
[bcy] add user and post extractors (#592) 2020-02-09 02:37:14 +01:00
Mike Fährmann
091f9a107d
[docs] add examples of how to filter manga chapters by language 
(closes #599)
 2020-02-07 23:21:44 +01:00
Mike Fährmann
6426e3efc7
[khinsider] fix and improve metadata extraction 2020-02-07 18:20:38 +01:00
Mike Fährmann
4a3d2405de
[postprocessor:ugoira] small optimization 
Use tuples instead of lists when extending the list of
command-line arguments.
 2020-02-07 17:59:28 +01:00
Mike Fährmann
b7eb6cecbb
[pixiv] handle tags at the end of new bookmark URLs 2020-02-06 23:42:13 +01:00
Mike Fährmann
109f6c8685
[patreon] filter duplicate files per post (#590) 2020-02-05 23:38:24 +01:00
Mike Fährmann
b38cf59711
[sexcom] fix image URLs & parse 'date' fields 2020-02-04 22:52:00 +01:00
Mike Fährmann
1f4c9c5f9d
[8kun] add thread and board extractors (closes #582) 2020-02-04 22:50:31 +01:00
Mike Fährmann
facc5daa6d
[twitter] force old login page layout (fixes #584, fixes #598) 2020-02-02 17:24:53 +01:00