Mike Fährmann
506242740f
fix capitalization issues
2015-11-02 14:58:26 +01:00
Mike Fährmann
cc5e37aeae
[powermanga] adjust regex
2015-11-02 00:21:17 +01:00
Mike Fährmann
ec6c1fd18e
[redhawkscans] use langcode to -name mapping
2015-11-02 00:20:40 +01:00
Mike Fährmann
b24bb1da7d
new module for simple language code to name mapping
2015-11-02 00:18:26 +01:00
Mike Fährmann
6dcfed16fc
[powermanga] just inherit from redhawkscans
2015-11-01 01:47:58 +01:00
Mike Fährmann
d6325865e8
[redhawkscans] generalize to allow subclassing
2015-11-01 01:46:00 +01:00
Mike Fährmann
b47f3b9d78
[exhentai] reenable extractor
2015-10-31 16:50:20 +01:00
Mike Fährmann
db479f881d
implement text.shorten_path/filename methods
2015-10-31 00:21:02 +01:00
Mike Fährmann
882b1f31b1
update setup.py and bump version
2015-10-30 16:26:08 +01:00
Mike Fährmann
2472d0722a
[hitomi] more metadata
2015-10-29 17:53:29 +01:00
Mike Fährmann
9cfe2c78a5
add extractor 'imgth'
2015-10-28 23:26:47 +01:00
Mike Fährmann
25f48101e5
add extractor 'hitomi'
2015-10-28 16:24:35 +01:00
Mike Fährmann
6ce181bcfe
add extractor 'nhentai'
2015-10-28 12:08:27 +01:00
Mike Fährmann
cf8f4cd179
[imgur] add to list of extractors
2015-10-12 22:34:45 +02:00
Mike Fährmann
c47bb4d570
add extractor 'imgur'
2015-10-11 16:22:38 +02:00
Mike Fährmann
89f938ee55
handle non string-like arguemnts for clean_path
2015-10-11 16:21:55 +02:00
Mike Fährmann
4cb419b5d9
[chan] unescape html entities in title
2015-10-10 19:58:30 +02:00
Mike Fährmann
7b83f88c64
replace illegal characters in paths
2015-10-09 02:24:41 +02:00
Mike Fährmann
c14b9895ad
add extractor 'powermanga'
2015-10-08 20:43:52 +02:00
Mike Fährmann
f5d5684119
[pixiv] reuse api-tokens
2015-10-07 01:09:11 +02:00
Mike Fährmann
bea33ae9cb
implement config.setdefault
2015-10-07 00:58:43 +02:00
Mike Fährmann
c8e0efe1ff
[pixiv] refresh access-token every 50 minutes
2015-10-06 17:29:08 +02:00
Mike Fährmann
e37846e1c1
bump version number
2015-10-05 20:35:17 +02:00
Mike Fährmann
b8b48ef795
[deviantart] add to extractor list
2015-10-05 20:29:48 +02:00
Mike Fährmann
76f32addf9
[booru] skip images without 'file-url' attribute
2015-10-05 20:27:27 +02:00
Mike Fährmann
0e5ef06ac0
Merge branch 'loader'
2015-10-05 18:10:35 +02:00
Mike Fährmann
733ae601da
enable user-specified patterns
2015-10-05 18:10:18 +02:00
Mike Fährmann
49e91bcb73
adjust loader to new config-interface
2015-10-05 17:52:50 +02:00
Mike Fährmann
e23aaa4298
Merge branch 'config' into loader
2015-10-05 17:46:04 +02:00
Mike Fährmann
539faa0322
remove SequentialExtractor class
2015-10-05 17:15:31 +02:00
Mike Fährmann
7d7c1afe20
[deviantart] adjust constructor paramters
2015-10-05 17:06:58 +02:00
Mike Fährmann
88442ad26d
Merge branch 'config'
2015-10-05 17:04:43 +02:00
Mike Fährmann
3c13548f29
rewrite extractors to use config-module
2015-10-05 15:51:08 +02:00
Mike Fährmann
608d3193a9
use new config-module in downloader
2015-10-05 14:46:42 +02:00
Mike Fährmann
2026223ed1
change argument format for config-calls
2015-10-05 12:42:42 +02:00
Mike Fährmann
ae535ba0c1
add extractor 'deviantart'
2015-10-04 04:13:50 +02:00
Mike Fährmann
9986a5ffb5
json-based config module
2015-10-03 20:23:55 +02:00
Mike Fährmann
42b8e81a68
rewrite extractors to use text-module
2015-10-03 15:43:02 +02:00
Mike Fährmann
c5801c9770
combine text related functions in new module
2015-10-03 12:53:45 +02:00
Mike Fährmann
d7e0d81bdd
[8chan] use api
2015-09-07 17:16:50 +02:00
Mike Fährmann
d8ef128e74
[4chan] update default filename and directory
2015-09-07 16:24:16 +02:00
Mike Fährmann
1998ec9b13
[pixiv] update user-agent to newest version
2015-09-07 13:48:16 +02:00
Mike Fährmann
c9ef181b3c
[4chan] use api
2015-06-29 23:14:35 +02:00
Mike Fährmann
c8e5b2e89e
base class for futaba-chan boards with api
2015-06-29 23:11:09 +02:00
Mike Fährmann
26bb9d62de
move and rework extractor-loading code
2015-06-28 22:57:17 +02:00
Mike Fährmann
4348694629
sanatize output
2015-06-28 12:45:52 +02:00
Mike Fährmann
63992363a6
[pixiv] handle timestamps at the end of urls
2015-06-28 12:36:30 +02:00
Mike Fährmann
13ebca2a48
[mangareader] supply correct width and height
2015-06-28 01:23:09 +02:00
Mike Fährmann
2afe15b217
[redhawkscans] let requests handle content decoding
2015-06-27 15:07:22 +02:00
Mike Fährmann
675937c77c
[mangareader] add extractor
2015-06-26 22:07:36 +02:00
Mike Fährmann
58dfd1a38f
[redhawkscans] fix chapter parsing
2015-06-25 19:24:30 +02:00
Mike Fährmann
a9e68c2745
[redhawkscans] fix json extraction
2015-06-25 17:59:20 +02:00
Mike Fährmann
b3f656ffd5
[redhawkscans] add extractor
2015-06-25 17:21:07 +02:00
Mike Fährmann
d9d88f1448
[pixiv] fix ugoira parsing
2015-05-20 11:06:35 +02:00
Mike Fährmann
68c4306040
[pixiv] transition to pixiv public api
2015-05-14 19:08:20 +02:00
Mike Fährmann
c0530a635c
[batoto] a few fixes
...
- removed 'volume' fields from default format strings
- fixed parsing by making volumes optional
- removed debug output
- updated docstring
- added a few unescape calls
2015-05-10 15:47:44 +02:00
Mike Fährmann
a145a73d05
add extractor 'nijie'
2015-05-07 01:39:30 +02:00
Mike Fährmann
9c25c15438
[3dbooru] fix default regex
2015-05-04 18:22:07 +02:00
Mike Fährmann
5993177ae3
[4chan] more metadata entries (size, width, height)
2015-05-04 14:57:47 +02:00
Mike Fährmann
a2cfbe445f
add extractor '3dbooru'
2015-04-15 22:24:27 +02:00
Mike Fährmann
762ad7426a
add extractor 'yandere'
2015-04-15 17:35:30 +02:00
Mike Fährmann
07f23dc2fa
add extractor '4chan'
2015-04-14 15:04:07 +02:00
Mike Fährmann
fae1b28c48
[pixiv] fix parsing of illust_ids
2015-04-12 18:05:49 +02:00
Mike Fährmann
ffec41f352
[imgchili] update to new extractor interface
2015-04-12 15:59:52 +02:00
Mike Fährmann
f3e208c0ab
[batoto] update to new extractor interface
2015-04-11 23:49:36 +02:00
Mike Fährmann
3c6161eea7
small whitespace fixes
2015-04-11 16:22:15 +02:00
Mike Fährmann
593a29b677
[imgbox] update to new extractor interface
2015-04-11 16:12:28 +02:00
Mike Fährmann
e41768d969
[imagebam] update to new extractor interface
2015-04-11 14:15:01 +02:00
Mike Fährmann
758fe00441
[e621] update to new extractor interface
2015-04-11 00:39:26 +02:00
Mike Fährmann
5cb46a2cb3
[gelbooru] update to new extractor interface
2015-04-11 00:17:43 +02:00
Mike Fährmann
1f4866fcd6
[danbooru] update to new extractor interface
2015-04-11 00:17:06 +02:00
Mike Fährmann
8c7da93d19
move and update BooruExtractor classes
2015-04-11 00:16:17 +02:00
Mike Fährmann
28fa7c53b4
docstrings and other small fixes for downloaders
2015-04-10 21:45:41 +02:00
Mike Fährmann
5545624da1
use seperate session in http downloader
2015-04-10 19:19:12 +02:00
Mike Fährmann
8f24329e30
[pixiv] fix http headers and cookies
2015-04-10 17:32:36 +02:00
Mike Fährmann
5806e02f97
better support for KeyboardInterrupt exceptions
2015-04-10 17:31:49 +02:00
Mike Fährmann
1cd25b5369
[pixiv] update to new extractor interface
2015-04-10 15:29:09 +02:00
Mike Fährmann
7c8d787077
add a few docstrings
2015-04-10 01:21:35 +02:00
Mike Fährmann
30b9db43a0
[8chan] combine patterns
2015-04-09 17:28:14 +02:00
Mike Fährmann
3872ccb435
pylint fixes
2015-04-09 16:46:57 +02:00
Mike Fährmann
ce2fab9c7e
allow user-specified formats for filenames
2015-04-09 16:40:54 +02:00
Mike Fährmann
652d60a5cd
implement new extractor-module selection
2015-04-09 16:13:00 +02:00
Mike Fährmann
cd4a699dd2
add 'Headers' and 'Cookies' message
2015-04-08 19:06:50 +02:00
Mike Fährmann
7b9fcea6bb
small fixes
2015-04-08 02:30:10 +02:00
Mike Fährmann
f31c05f522
[8chan] update to new extractor interface
2015-04-08 02:26:13 +02:00
Mike Fährmann
0abbee3710
update download-infrastructure
2015-04-08 01:51:48 +02:00
Mike Fährmann
513808d156
move code from util.py
2015-04-08 01:46:04 +02:00
Mike Fährmann
41f00809ff
update extractor base classes
2015-04-08 01:43:25 +02:00
Mike Fährmann
63bf0d1725
update __init__.py
2015-04-05 17:15:27 +02:00
Mike Fährmann
7c12ba1c31
move DownloadManager and ExtractorFinder
2015-04-05 16:23:20 +02:00
Mike Fährmann
d13608e909
[pixiv] fix parsing of illust-ids
2015-03-27 18:09:30 +01:00
Mike Fährmann
a66a5099f8
added extractor 'imgchili'
2015-02-03 00:23:22 +01:00
Mike Fährmann
ac002cc4b3
[8chan] fix image urls
2015-02-03 00:22:39 +01:00
Mike Fährmann
54d40b85fb
[pixiv] load balancing for image servers
2015-01-27 21:51:48 +01:00
Mike Fährmann
0f6cc964cc
[8chan] use new domainname for thread-urls
2015-01-18 23:45:40 +01:00
Mike Fährmann
34d13bc906
added extractor 'danbooru' + split BooruExtractor to handle XML and JSON
2014-12-30 21:34:55 +01:00
Mike Fährmann
2a7dbd8868
[booru] unquote tags to fix multiple tags in urls
2014-12-22 16:45:58 +01:00
Mike Fährmann
099fe7515e
added extractor 'e621'
2014-12-22 16:23:41 +01:00
Mike Fährmann
1244c933a1
[8chan] fix image urls
2014-11-26 17:38:50 +01:00
Mike Fährmann
729d2d8b20
[imagebam] fixed issue with destination direcotry name
2014-11-20 21:45:59 +01:00
Mike Fährmann
98dd5f9a90
added extractor 'imagebam'
2014-11-20 21:27:57 +01:00
Mike Fährmann
ff53b7f6fa
added extractor 'imgbox'
2014-11-20 20:08:55 +01:00
Mike Fährmann
4950cb0ab9
use 'safe_request' to handle connection errors
2014-10-31 23:39:59 +01:00
Mike Fährmann
b630753e5e
add 'method' parameter
2014-10-31 23:38:21 +01:00
Mike Fährmann
7588974306
fixed various bugs
...
- forgot "self." before "name_fmt"
- image keys where off by one
2014-10-15 16:17:59 +02:00
Mike Fährmann
deef91eddc
initial commit
2014-10-12 21:56:44 +02:00