Mike Fährmann
5cc7be2536
[piczel] update and improve
...
- use proper pagination (fixes #396 )
- update API host and endpoints
- "fix" double slash // in image URLs
2019-08-24 20:37:33 +02:00
Mike Fährmann
0c1c7abb4d
release version 1.10.2
2019-08-23 22:10:54 +02:00
Mike Fährmann
64b2935d8e
[pixiv] provide 'filename' and change default filename format
...
to '{filename}.{extension}' (closes #366 )
2019-08-02 22:35:10 +02:00
Mike Fährmann
2f33bac030
release version 1.10.1
2019-08-02 21:23:06 +02:00
Mike Fährmann
fa60109e97
[exhentai] don't use e-hentai.org for exhentai URLs
2019-08-02 21:10:09 +02:00
Mike Fährmann
dfe552421b
release version 1.10.0
2019-08-01 23:22:58 +02:00
Mike Fährmann
a8b60b2bd9
change default cache directory for unix systems
...
Use either $XDG_CACHE_HOME or ~/.cache (if the former isn't set)
and store potentially sensitive cookies and tokens in a user's
home directory and not in the world-readable /tmp.
2019-07-31 22:56:14 +02:00
Mike Fährmann
3fe5ccdfa6
[adultempire] add gallery extractor ( closes #340 )
2019-07-21 22:29:57 +02:00
Mike Fährmann
b3851e01d9
release version 1.9.0
2019-07-19 21:55:25 +02:00
Mike Fährmann
40da44b17f
Merge branch 'v1.9.0'
2019-06-29 15:39:52 +02:00
Mike Fährmann
9a216a6c6c
release version 1.8.7
2019-06-28 21:04:00 +02:00
Mike Fährmann
b171befa87
implement 'parse_unicode_escapes()'
2019-06-16 21:47:24 +02:00
Mike Fährmann
3a36a0fa1e
release version 1.8.6
2019-06-14 21:11:58 +02:00
Mike Fährmann
95b4a53b9c
[keenspot] improve pagination ( #223 )
...
The old code would skip the last comic page for some series.
2019-06-02 22:12:21 +02:00
Mike Fährmann
12c965d547
release version 1.8.5
2019-06-01 20:57:55 +02:00
Mike Fährmann
efa805c5d7
[sankaku] update pagination end condition ( fixes #265 )
...
Pagination over popular listings (`date:...+order:popular") never
terminates, not even on the site itself, and at some point returns the
same results over and over again.
2019-05-20 15:46:06 +02:00
Mike Fährmann
d514d49c72
release version 1.8.4
2019-05-17 23:52:09 +02:00
Mike Fährmann
51e0e92429
[deviantart] fix GIF downloads ( #242 )
...
The "original" download URL for GIF animations is only a preview version
of the original file.
2019-05-08 15:43:43 +02:00
Mike Fährmann
26b516b328
release version 1.8.3
2019-05-04 22:50:00 +02:00
Mike Fährmann
0b2ff406f6
[plurk] add timeline- and post-extractors ( #212 )
2019-04-14 21:48:38 +02:00
Mike Fährmann
dcd1bd3b6f
release version 1.8.2
2019-04-12 10:38:51 +02:00
Mike Fährmann
ec88ff1562
[flickr] relax unit test results
...
Images are now randomly served from the 'live.staticflickr.com' domain
instead of the "old" 'farmN.staticflickr.com' one, making it impossible
to use static 'url' and 'keyword' hashes as results.
Image quality doesn't appear to be effected by which image-server is
used. Files from 'farmN' and 'live' are the same.
2019-03-30 18:31:59 +01:00
Mike Fährmann
bc2020e86c
release version 1.8.1
2019-03-29 17:37:11 +01:00
Mike Fährmann
fb14f80d62
[tumblr] fix avatar URLs for non-OAuth1.0 calls ( closes #193 )
2019-03-17 11:07:22 +01:00
Mike Fährmann
8c20443839
release version 1.8.0
2019-03-15 15:27:11 +01:00
Mike Fährmann
bc0951d974
allow for simplified test data structures
...
Instead of a strict list of (URL, RESULTS)-tuples, extractor result
tests can now be a single (URL, RESULTS)-tuple, if it's just one test,
and "only matching" tests can now be a simple string.
2019-02-06 17:24:44 +01:00
Mike Fährmann
b49c3c9991
release version 1.7.0
2019-02-05 16:31:39 +01:00
Mike Fährmann
b8fed34548
add generalized extractors for Mastodon instances ( #144 )
...
Extractors for Mastodon instances can now be dynamically generated,
based on the instance names in the 'extractor.mastodon.*' config path.
Example:
{
"extractor": {
"mastodon": {
"pawoo.net": { ... },
"mastodon.xyz": { ... },
"tabletop.social": { ... },
...
}
}
}
Each entry requires an 'access-token' value, which can be generated with
'gallery-dl oauth:mastodon:<instance URL>'.
An 'access-token' (as well as a 'client-id' and 'client-secret') for
pawoo.net is always available, but can be overwritten as necessary.
2019-01-19 14:28:59 +01:00
Mike Fährmann
4b441c162e
release version 1.6.3
2019-01-18 12:31:04 +01:00
Mike Fährmann
0afa913de4
[tumblr] add tests for hidden and private blogs ( #145 )
...
Hidden / dashboard-only blogs are pretty straightforward and "only"
require a valid 'access-token' and 'access-token-secret' for the given
'api-key' and 'api-secret', so that signed OAuth1.0 requests are possible.
Private / password protected blogs on the other hand are a bit
cumbersome. In addition to a valid 'access-token' and
'access-token-secret', they also require the account belonging to those
tokens to be a member of the blog itself. Knowing the password and
entering it in the website isn't enough to access a blog through the
API. Following a private blog is also impossible, so that option can't
work either.
2019-01-03 16:12:24 +01:00
Mike Fährmann
67cc0ac873
release version 1.6.2
2019-01-01 16:26:58 +01:00
Mike Fährmann
770200888e
[gfycat] use public API endpoint
2018-12-02 18:56:53 +01:00
Mike Fährmann
b1e22e8354
release version 1.6.1
2018-11-28 15:34:01 +01:00
Mike Fährmann
c2e59b9a7d
update CHANGELOG.md
...
[ci skip]
2018-11-18 22:33:35 +01:00
Mike Fährmann
d4b2b73bef
release version 1.6.0
2018-11-17 18:28:02 +01:00
Mike Fährmann
a36259d8f1
update setup.py
...
- add Python version check
- add classifiers
- simplify sys.exit() usage
2018-10-24 14:43:37 +02:00
Mike Fährmann
529aa21dd9
move FileAdapter definition into recursive.py
2018-09-16 20:59:22 +02:00
Mike Fährmann
31a5c7c2c0
release version 1.5.3
2018-09-14 18:18:43 +02:00
Mike Fährmann
0bc8ef51c8
[smugmug] Handle albums with no explicit owner ( #100 )
2018-09-01 12:55:02 +02:00
Mike Fährmann
ff83ee22b0
release version 1.5.2
2018-08-31 20:27:09 +02:00
Mike Fährmann
10365394d7
[twitter] add support for user-timelines ( closes #96 )
...
also adds a 'retweets' option to filter retweeted content
2018-08-17 20:04:11 +02:00
Mike Fährmann
e3055d356c
release version 1.5.1
2018-08-17 13:21:36 +02:00
Mike Fährmann
a86f2bfc80
[pinterest] update not-found redirects
2018-08-07 12:13:19 +02:00
Mike Fährmann
7442d2940c
release version 1.5.0
2018-08-03 17:50:27 +02:00
Mike Fährmann
6996f5c118
[mangahere] fix and improve chapter extraction
2018-07-09 20:07:40 +02:00
Mike Fährmann
764331823b
release version 1.4.2
2018-07-06 16:02:40 +02:00
Mike Fährmann
b8c97d2295
use 'extractor.request()' for more HTTP requests
2018-06-25 23:40:59 +02:00
Mike Fährmann
cc15c6105c
release version 1.4.1
2018-06-22 16:35:21 +02:00
Mike Fährmann
2d1a104739
[mangadex] unescape manga names and chapter titles
...
pretty sure I previously tested if unescaping strings from the
embedded JSON object was necessary ... maybe they changed it
2018-06-11 17:53:21 +02:00
Mike Fährmann
3bcce77f6d
release version 1.4.0
2018-06-08 22:21:35 +02:00
Mike Fährmann
69a5e6ddb3
Merge branch 'master' into 1.4-dev
2018-05-04 10:19:02 +02:00
Mike Fährmann
82c50fa609
release version 1.3.5
2018-05-04 10:03:20 +02:00
Mike Fährmann
e54b43be08
[mangadex] add title info for chapter extractors
2018-04-22 16:20:04 +02:00
Mike Fährmann
a2020c736e
release version 1.3.4
2018-04-20 18:42:09 +02:00
Mike Fährmann
6b72be8ee6
[tumblr] add 'hash' keyword
...
'hash' is the middle part of the filename in a tumblr image URL.
For example an image with '.../tumblr_p6tgemp1NZ1wgha4yo1_250.png' as
its URL would have 'p6tgemp1NZ1wgha4yo1' as hash.
2018-04-07 15:54:30 +02:00
Mike Fährmann
ffc0c67701
release version 1.3.3
2018-04-06 15:45:45 +02:00
Mike Fährmann
dd314279fb
[test] add unit tests for extractor module functions
2018-03-25 11:49:42 +02:00
Mike Fährmann
a993d0ea90
release version 1.3.2
2018-03-23 15:27:56 +01:00
Mike Fährmann
7121eeae8b
check supportedsites.rst in release script
2018-03-17 15:35:38 +01:00
Mike Fährmann
c59f9b71f1
release version 1.3.1
2018-03-16 12:29:02 +01:00
Mike Fährmann
749fbbfa6c
[mangadex] add chapter- and manga-extractor
2018-03-05 18:37:21 +01:00
Mike Fährmann
b58449fd88
release version 1.3.0
2018-03-02 18:47:17 +01:00
Mike Fährmann
5008e105ee
update archive IDs
...
... to behave in a more straightforward way when dealing with
bookmarks/favourites/etc.
specific IDs are now grouped by their owner, album-id, ... to
allow for duplicates when it would be expected.
2018-03-01 18:20:50 +01:00
Mike Fährmann
d122203be1
[mangastream] fix extraction
2018-02-17 22:40:16 +01:00
Mike Fährmann
8809b32aed
release version 1.2.0
2018-02-16 22:29:57 +01:00
Mike Fährmann
6174a5c4ef
[download] adjust filename extension on filetype mismatch
...
(closes #63 )
2018-01-17 18:37:06 +01:00
Mike Fährmann
b6797032e3
release version 1.1.2
2018-01-12 15:09:18 +01:00
Mike Fährmann
28cd78aae0
[kissmanga] extend chapter-string regex ( closes #58 )
2017-12-24 22:53:10 +01:00
Mike Fährmann
0ba618dd1a
release version 1.1.1
2017-12-22 17:01:04 +01:00
Mike Fährmann
595593a35e
[sankaku] rewrite
...
- better code structure and extensibility
- better metadata
2017-12-12 18:09:45 +01:00
Mike Fährmann
e96e1fea5d
release version 1.1.0
2017-12-08 17:15:26 +01:00
Mike Fährmann
55c64cad4b
[khinsider] fix filename extension and test-pattern
2017-11-28 19:35:47 +01:00
Mike Fährmann
c0bcf8e343
release version 1.0.2
2017-11-24 17:24:39 +01:00
Mike Fährmann
79bcaa8726
improve downloader retry behavior
...
- only retry download on 5xx and 429 status codes
- immediately fail on 4xx status codes
2017-11-10 21:46:18 +01:00
Mike Fährmann
5ee8ca0319
release version 1.0.1
2017-11-10 08:54:33 +01:00
Mike Fährmann
3a8a0c1f35
[imgbox] rewrite / fix extraction ( closes #47 )
2017-11-01 13:01:59 +01:00
Mike Fährmann
f97207a8e6
release version 1.0.0
2017-10-27 16:22:51 +02:00
Mike Fährmann
493bd235cf
workaround for missing 'assert_called_once' method
...
this method was introduced in Python 3.6, but calling it still
works (i.e. it doesn't cause the test to fail) on Python 3.3/3.4
2017-07-26 10:33:15 +02:00
Mike Fährmann
de68cf84a8
release version 0.9.1
2017-07-24 11:36:21 +02:00
Mike Fährmann
1dac76fd1c
update extractor docstrings
2017-06-28 17:39:07 +02:00
Mike Fährmann
e217e23e29
release version 0.9.0
2017-06-28 09:46:34 +02:00
Mike Fährmann
398506da45
update release script
2017-05-22 08:47:58 +02:00
Mike Fährmann
8db3a2fea8
release version 0.8.4
2017-05-21 10:52:35 +02:00
Mike Fährmann
fc9223c072
add '--abort-on-skip' option and ability to control skip behavior
...
the 'skip' config option controls skipping behavior:
true - skip download if file already exist (default)
false - download and overwrite files even if it exists
"abort" - abort extractor run if a download would be skipped
(same as '--abort-on-skip')
2017-05-03 15:26:04 +02:00
Mike Fährmann
7c8f61a116
release version 0.8.3
2017-05-01 13:30:09 +02:00
Mike Fährmann
0456efaa5a
[hentaifoundry] update unit tests
2017-04-10 10:50:34 +02:00
Mike Fährmann
af82467627
release version 0.8.2
2017-04-10 08:23:03 +02:00
Mike Fährmann
fd3f84d913
[kissmanga] get AES key from site itself
2017-04-09 17:15:38 +02:00
Mike Fährmann
fa1cb6f74c
release version 0.8.1
2017-04-09 11:51:52 +02:00
Mike Fährmann
e9b445a0f8
update release script
2017-03-31 17:04:44 +02:00
Mike Fährmann
43d8b66e70
release version 0.8.0
2017-03-28 15:00:24 +02:00
Mike Fährmann
8816dab549
add 'dev' suffix for non-release versions
...
(#9 )
2017-03-14 09:07:52 +01:00
Mike Fährmann
0b214eeb9d
bump version to 0.7.0
2017-03-06 19:30:59 +01:00
Mike Fährmann
4cb49cfd76
bump version to 0.6.4
2017-02-13 00:55:01 +01:00
Mike Fährmann
138e39686b
bump version to 0.6.3
2017-01-25 02:31:36 +01:00
Mike Fährmann
041c70a3e1
bump version to 0.6.2
2017-01-05 01:15:11 +01:00
Mike Fährmann
02b6f8b165
bump version to 0.6.1
2016-11-30 20:02:55 +01:00
Mike Fährmann
691f3d1a02
bump version
2016-10-08 12:40:00 +02:00
Mike Fährmann
f434a0711b
put centralized version string in 'version.py'
2016-10-08 11:37:47 +02:00
