Mirrors/gallery-dl
1
0
Fork 0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-22 18:53:21 +01:00
Code Issues Releases Wiki Activity
834 Commits 6 Branches 164 Tags 15 MiB
cebf800a7f
Commit Graph

834 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
eb64fb267c
[nyafuu] add thread extractor (#18) 2017-07-08 17:16:41 +02:00
Mike Fährmann
726c6f01ae
allow 'cookies' config option to be a dictionary 2017-07-07 18:01:46 +02:00
Mike Fährmann
4877ef6314
[deviantart] support '?catpath=/' URLs (#26) 
They previously weren't supported for galleries and journals.

This also increases the 'limit' parameter for API calls to its
respective maximum.
 2017-07-06 20:45:22 +02:00
Mike Fährmann
9edbd6ff01
update configuration.rst 2017-07-04 19:34:34 +02:00
Mike Fährmann
8c16cbe7ea
fix tests 2017-07-04 19:31:32 +02:00
Mike Fährmann
a6f689e01a
[deviantart] add gallery-folder extractor (#26) 
The code for this and the available metadata is probably going
to change again. This extractor is very similar to the favorite-
extractor, so they might be "combined" or something like that.
 2017-07-03 21:57:10 +02:00
Mike Fährmann
474e9c1aec
[4plebs] add thread extractor (#18) 2017-07-03 16:43:04 +02:00
Mike Fährmann
a804a42e23
add '--cookies' command-line option 2017-07-03 15:02:19 +02:00
Mike Fährmann
dcc1d3b2ea
[hentaifoundry] fix infinite loop for multiple of 25 images 2017-07-03 14:16:08 +02:00
Mike Fährmann
ce55ec6490
enable extractor tests without filters 
$ python test_extractors.py all
 2017-07-02 08:20:04 +02:00
Mike Fährmann
34e6e1099e
[batoto] adapt to https chapter URLs 2017-07-02 08:20:04 +02:00
Mike Fährmann
85696d0b3b
[reddit] fix issue with datetime errors 2017-07-02 08:19:45 +02:00
Mike Fährmann
80c2e03aaa
[reddit] allow 'date-min/max' to be human readable dates 
If the date-min/max config value is a string, try parsing it using
datetime.strptime [1] with 'date-format' as format string [2]
(default: "%Y-%m-%dT%H:%M:%S")

Example: get all submissions posted in 2016

$ gallery-dl reddit.com/r/... \
    -o date-format=%Y \
    -o date-min=\"2016\" \
    -o date-max=\"2017\"

[1] https://docs.python.org/3/library/datetime.html#datetime.datetime.strptime
[2] https://docs.python.org/3/library/datetime.html#strftime-strptime-behavior
 2017-07-01 18:46:38 +02:00
Mike Fährmann
58e95a7487
share extractor and downloader sessions 
There was never any "good" reason for the strict separation
between extractors and downloaders. This change allows for
reduced resource usage (probably unnoticeable) and less lines
of code at the "cost" of tighter coupling.
 2017-06-30 19:38:14 +02:00
Mike Fährmann
4414aefe97
small fix for aes_cbc_decrypt_text 2017-06-30 15:21:04 +02:00
Mike Fährmann
21064146c1
fix test 2017-06-29 17:57:53 +02:00
Mike Fährmann
f3d0373120
[reddit] add ability to filter by submission id 
'extractor.reddit.id-min' and '….id-max' specify the lowest and
highest submission-/post-id to consider, similar to 'date-min' and
'date-max'
 2017-06-29 17:39:22 +02:00
Mike Fährmann
06c4cae05b
extend the output of '--list-extractors' 
It now includes category and subcategory values for
each extractor class.
 2017-06-28 18:51:47 +02:00
Mike Fährmann
1dac76fd1c
update extractor docstrings 2017-06-28 17:39:07 +02:00
H R X N
b757687606 Update configuration.rst (#24) 
Fixed minor typo.
 2017-06-28 13:55:39 +02:00
Mike Fährmann
e217e23e29
release version 0.9.0 2017-06-28 09:46:34 +02:00
Mike Fährmann
92a11528d1
smaller changes 2017-06-28 09:42:49 +02:00
Mike Fährmann
598e3a8d88
update configuration.rst 2017-06-27 18:56:24 +02:00
Mike Fährmann
86561d7c8b
update configuration.rst 2017-06-27 17:44:02 +02:00
Mike Fährmann
44d98e562b
[pixiv] support pixiv.me URLs (#23) 2017-06-25 20:21:01 +02:00
Mike Fährmann
b373fe0eea
[pixiv] support shortened URLs and other variants (#23) 2017-06-25 17:49:24 +02:00
Mike Fährmann
c951d6276c
[imagetwist] use https 2017-06-24 16:21:00 +02:00
Mike Fährmann
d3b04076f7
add .netrc support (#22) 
Use the '--netrc' cmdline option or set the 'netrc' config option
to 'true' to enable the use of .netrc authentication data.

The 'machine' names for the .netrc info are the lowercase extractor
names (or categories): batoto, exhentai, nijie, pixiv, seiga.
 2017-06-24 12:17:26 +02:00
Mike Fährmann
fbe8c519e2
update README 
- mention and link to docs/configuration.rst
- add OAuth section
 2017-06-23 16:14:51 +02:00
Mike Fährmann
e1d82af5e0
small fixes 2017-06-22 18:46:42 +02:00
Mike Fährmann
ccb7973b57
update configuration.rst 2017-06-20 16:20:28 +02:00
Mike Fährmann
719d45f89e
[flickr] allow the use of Flickr's specifiers for format selection 
- renamed the 'width-max' option to 'size-max'
- filter by both width and height
 2017-06-20 16:09:25 +02:00
Mike Fährmann
b4c438c9ad
[oauth] add the 'extractor.oauth.browser' option 
enables/disables the use of webbrowser.open() during OAuth authorization
 2017-06-20 16:06:14 +02:00
Mike Fährmann
1a9b4759a2 Merge pull request #21 from Hrxn/patch-1 
Update configuration.rst
 2017-06-19 14:27:31 +02:00
H R X N
b206b831ee Update configuration.rst 
Fix heading.
 2017-06-19 14:12:43 +02:00
Mike Fährmann
2633337833
[kissmanga] update regex (fixes #20) 2017-06-19 09:55:02 +02:00
Mike Fährmann
fac6c02224
[downloader] fix extension from content-type 2017-06-19 09:24:00 +02:00
Mike Fährmann
e68af4febe
[flickr] add 'width-max' option (#16) 
This option allows for simple format selection by
specifying a maximum image width.
 2017-06-18 22:20:15 +02:00
Mike Fährmann
48b444e276
add a list of all configuration options 
(the format might be subject to change; putting everything  in
 one single table is even worse)
 2017-06-18 22:16:26 +02:00
Mike Fährmann
2993206c4b
smaller fixes and "security" measures 
- move the OAuthSession class into util.py
- block special extractors for reddit and recursive
- ignore 'only matching' tests for testresults script
 2017-06-16 21:01:40 +02:00
Mike Fährmann
fb1904dd59
add 'Authentication' column to supportedsites.rst 2017-06-15 21:06:20 +02:00
Mike Fährmann
8d5e92f641
resolve cyclic dependency between oauth and flickr 2017-06-14 16:11:18 +02:00
Mike Fährmann
d60781de7b
[oauth] workaround for ctrl+c on Windows 2017-06-14 15:29:40 +02:00
Mike Fährmann
9759fe8c6b
allow 'only_matching' tests 2017-06-14 08:43:05 +02:00
Mike Fährmann
56bec79e6a
[reddit] add ability to load more comments (#15) 
The 'extractor.reddit.morecomments' option enables the use of
the '/api/morechildren' API endpoint (1) to load even more
comments than the usual submission-request provides.
Possible values are the booleans 'true' and 'false' (default).

Note: this feature comes at the cost of 1 extra API call towards
the rate limit for every 100 extra comments.

(1) https://www.reddit.com/dev/api/#GET_api_morechildren
 2017-06-13 18:49:07 +02:00
Mike Fährmann
05ed95e5b0
[flickr] add search extractor 2017-06-13 08:01:32 +02:00
Mike Fährmann
5f55c854b9
[flickr] replace getPublic... API call with regular ones 2017-06-12 16:37:06 +02:00
Mike Fährmann
9a620784f9
[flickr] add support for user authentication (#16) 
Call '$ gallery-dl oauth:flickr' to get an access_token
and access_token_secret for your account.
 2017-06-12 09:36:14 +02:00
Mike Fährmann
d5a70f2580
add simple progress indicator for multiple URLs (#19) 
The output can be configured via the 'output.progress'
config value.

Possible values:
    - true:     Show the default progress indicator
                "[{current}/{total}] {url}" (default)
    - false:    Never show the progress indicator
    - <string>: Show the progress indicator using this
                as a custom format string(1).
                Possible replacement keys are:
                - current: current URL index
                - total  : total number of URLs
                - url    : current URL

(1) https://docs.python.org/3/library/string.html#formatstrings
 2017-06-09 20:12:15 +02:00
Mike Fährmann
3ee77a0902
[oauth] print URL if webbrowser.open fails 2017-06-08 19:46:24 +02:00