Mirrors/gallery-dl
1
0
Fork 0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-26 04:32:51 +01:00
Code Issues Releases Wiki Activity
5,983 Commits 6 Branches 164 Tags 15 MiB
c243a7b060
Commit Graph

5474 Commits

Author SHA1 Message Date
Mike Fährmann
bb8f2a3e9d
[gelbooru] update to new format 2015-11-21 02:40:30 +01:00
Mike Fährmann
63a38edd05
[konachan] update to new format 2015-11-21 02:09:02 +01:00
Mike Fährmann
23208a49b8
[e621] update to new format 2015-11-21 01:56:49 +01:00
Mike Fährmann
1bce63124b
[3dbooru] update to new format 2015-11-21 01:48:44 +01:00
Mike Fährmann
70a6599904
[yandere] update to new format 2015-11-21 00:58:45 +01:00
Mike Fährmann
15dec86e6a
[danbooru] update to new format 2015-11-21 00:55:25 +01:00
Mike Fährmann
74199422a8
[booru] add base classes for tag/pool/post extractors 2015-11-21 00:54:29 +01:00
Mike Fährmann
900577b013
restructure info-parameters 2015-11-21 00:30:31 +01:00
Mike Fährmann
205ef3ca02
[danbooru] add single image/post extractor 2015-11-20 20:25:31 +01:00
Mike Fährmann
ee1ba22d05
[danbooru] add pool extractor 2015-11-20 20:24:58 +01:00
Mike Fährmann
80917f5392
[danbooru] rewrite to use multiple extractors 2015-11-20 20:24:15 +01:00
Mike Fährmann
8c3783706d
allow multiple extractors per module 2015-11-20 19:54:07 +01:00
Mike Fährmann
e9547ebdf3
[exhentai] configurable wait-times 2015-11-19 17:04:54 +01:00
Mike Fährmann
9c63027d2c
[exhentai] fix 'imgkey' handling 2015-11-18 14:10:42 +01:00
Mike Fährmann
4440b40234
[exhentai] better language keywords 2015-11-17 20:51:06 +01:00
Mike Fährmann
1c9296140c
[hitomi] provide proper language keywords 2015-11-16 17:50:54 +01:00
Mike Fährmann
7fd284a705
always provide lowercase fileextensions 2015-11-16 17:40:05 +01:00
Mike Fährmann
7547d8be3f
[spectrumnexus] add additional regex 2015-11-16 17:38:59 +01:00
Mike Fährmann
c2f0720184
code cleanup to use nameext_from_url 2015-11-16 17:32:26 +01:00
Mike Fährmann
ca523b9f64
add helper method to text module 2015-11-16 03:46:43 +01:00
Mike Fährmann
41f5971e73
[mangashare] add extractor 2015-11-15 03:40:17 +01:00
Mike Fährmann
3f2fbd874d
[hbrowse] add extractor 2015-11-15 01:30:26 +01:00
Mike Fährmann
5db2aa29cf
Merge branch 'options' 2015-11-14 17:23:24 +01:00
Mike Fährmann
b55870909c
properly implement -c,--config option 2015-11-14 17:22:56 +01:00
Mike Fährmann
b683427d42
properly implement -d,--dest options 2015-11-14 16:07:10 +01:00
Mike Fährmann
b041906c2c make URL argument not necessary for some switches 2015-11-14 15:31:07 +01:00
Mike Fährmann
fdcc434b3d
implement --list-modules cmd-line option 2015-11-14 15:11:44 +01:00
Mike Fährmann
783e62b621
[hentaifoundry] code cleanup 2015-11-14 14:21:55 +01:00
Mike Fährmann
eb4a87b620
[hentaifoundry] add extractor 2015-11-14 03:19:44 +01:00
Mike Fährmann
247c5fcf8f
Merge branch 'options' 2015-11-13 01:20:55 +01:00
Mike Fährmann
90247977c9
implement --list-keywords cmd-line option 2015-11-13 01:19:01 +01:00
Mike Fährmann
edf3f7b69f
add KeywordJob class 2015-11-13 01:02:49 +01:00
Mike Fährmann
dd796e91c0
[spectrumnexus] add extractor 2015-11-13 00:21:50 +01:00
Mike Fährmann
db113bd87d
rename download.py 2015-11-12 03:28:01 +01:00
Mike Fährmann
47f016a016
remove DownloadManager class 2015-11-12 02:35:30 +01:00
Mike Fährmann
352950eebe
new method to import downloaders 2015-11-12 02:29:59 +01:00
Mike Fährmann
21a6416737
bugfixes 2015-11-12 02:28:47 +01:00
Mike Fährmann
73eeed3e72
[imgur] rewrite 2015-11-12 00:18:56 +01:00
Mike Fährmann
4427734b70
[imgur] fix parsing 2015-11-11 21:44:00 +01:00
Mike Fährmann
129ca282e4
[chan] unescape title 2015-11-11 00:51:07 +01:00
Mike Fährmann
20845d86f8
bump version 2015-11-10 21:17:31 +01:00
Mike Fährmann
3eaae19345
cmd line switch to set options 2015-11-10 01:56:31 +01:00
Mike Fährmann
3510faaed5
[sankaku] always use correct file-url 2015-11-10 00:55:01 +01:00
Mike Fährmann
3560935318
[exhentai] fix module dicstring 2015-11-09 02:33:22 +01:00
Mike Fährmann
60833abcc6
[sankaku] re-enable extractor 2015-11-09 02:29:33 +01:00
Mike Fährmann
36b376b5ba
[mangastream] add extractor 2015-11-08 00:03:14 +01:00
Mike Fährmann
009761fcd5
[mangapanda] add extractor 2015-11-08 00:02:37 +01:00
Mike Fährmann
5abe32a32c
[kissmanga] fix internal regex 2015-11-07 13:28:07 +01:00
Mike Fährmann
079330785a
document and fix smaller bugs 2015-11-07 13:06:23 +01:00
Mike Fährmann
1302f5a0f6
[kissmanga] add extractor 2015-11-07 02:32:59 +01:00
Mike Fährmann
822527a2ce
module to bypass cloudflare protection 2015-11-07 02:30:08 +01:00
Mike Fährmann
3b0fe8f544
unify booru filename-patterns 2015-11-06 16:48:33 +01:00
Mike Fährmann
c05dbd15b5
[gelbooru] support authentication to enable api access 2015-11-06 14:14:29 +01:00
Mike Fährmann
8469b3ae4f
[safebooru] add extractor 2015-11-06 13:54:06 +01:00
Mike Fährmann
6772b54bc4
[konachan] add extractor 2015-11-06 13:24:43 +01:00
Mike Fährmann
8e9bd1d793
sensible output if no extractor found 2015-11-06 13:21:53 +01:00
Mike Fährmann
6e67935b59
add more languages to iso639-1 dict 2015-11-06 00:24:50 +01:00
Mike Fährmann
6ed26864ea
[batoto] rewrite and fix 2015-11-05 23:46:19 +01:00
Mike Fährmann
686a4ddd3e
[8chan] fix file-urls 2015-11-05 00:18:36 +01:00
Mike Fährmann
950bebfd57
update setup.py and bump version 2015-11-04 00:07:03 +01:00
Mike Fährmann
c0efea339e
[imagebam] rewrite/fix 2015-11-04 00:03:48 +01:00
Mike Fährmann
e3e754eed7
[imgbox] use text.extract_all 2015-11-03 00:19:04 +01:00
Mike Fährmann
1352187758
[imgth] use text.extract_all 2015-11-03 00:11:08 +01:00
Mike Fährmann
353ac1e00b
[exhentai] use text.extract_all 2015-11-03 00:10:30 +01:00
Mike Fährmann
1fa6a99f18
[mangareader] rewrite 2015-11-03 00:08:25 +01:00
Mike Fährmann
d0bebd9ce3
allow adding values to existing dict 2015-11-03 00:05:18 +01:00
Mike Fährmann
629133a27a
document text.extract 2015-11-02 15:52:26 +01:00
Mike Fährmann
692d0c95cc
reimplement text.extract_all 2015-11-02 15:51:32 +01:00
Mike Fährmann
506242740f
fix capitalization issues 2015-11-02 14:58:26 +01:00
Mike Fährmann
cc5e37aeae
[powermanga] adjust regex 2015-11-02 00:21:17 +01:00
Mike Fährmann
ec6c1fd18e
[redhawkscans] use langcode to -name mapping 2015-11-02 00:20:40 +01:00
Mike Fährmann
b24bb1da7d
new module for simple language code to name mapping 2015-11-02 00:18:26 +01:00
Mike Fährmann
6dcfed16fc
[powermanga] just inherit from redhawkscans 2015-11-01 01:47:58 +01:00
Mike Fährmann
d6325865e8
[redhawkscans] generalize to allow subclassing 2015-11-01 01:46:00 +01:00
Mike Fährmann
b47f3b9d78 [exhentai] reenable extractor 2015-10-31 16:50:20 +01:00
Mike Fährmann
db479f881d implement text.shorten_path/filename methods 2015-10-31 00:21:02 +01:00
Mike Fährmann
882b1f31b1 update setup.py and bump version 2015-10-30 16:26:08 +01:00
Mike Fährmann
2472d0722a [hitomi] more metadata 2015-10-29 17:53:29 +01:00
Mike Fährmann
9cfe2c78a5 add extractor 'imgth' 2015-10-28 23:26:47 +01:00
Mike Fährmann
25f48101e5 add extractor 'hitomi' 2015-10-28 16:24:35 +01:00
Mike Fährmann
6ce181bcfe add extractor 'nhentai' 2015-10-28 12:08:27 +01:00
Mike Fährmann
cf8f4cd179 [imgur] add to list of extractors 2015-10-12 22:34:45 +02:00
Mike Fährmann
c47bb4d570 add extractor 'imgur' 2015-10-11 16:22:38 +02:00
Mike Fährmann
89f938ee55 handle non string-like arguemnts for clean_path 2015-10-11 16:21:55 +02:00
Mike Fährmann
4cb419b5d9 [chan] unescape html entities in title 2015-10-10 19:58:30 +02:00
Mike Fährmann
7b83f88c64 replace illegal characters in paths 2015-10-09 02:24:41 +02:00
Mike Fährmann
c14b9895ad add extractor 'powermanga' 2015-10-08 20:43:52 +02:00
Mike Fährmann
f5d5684119 [pixiv] reuse api-tokens 2015-10-07 01:09:11 +02:00
Mike Fährmann
bea33ae9cb implement config.setdefault 2015-10-07 00:58:43 +02:00
Mike Fährmann
c8e0efe1ff [pixiv] refresh access-token every 50 minutes 2015-10-06 17:29:08 +02:00
Mike Fährmann
e37846e1c1 bump version number 2015-10-05 20:35:17 +02:00
Mike Fährmann
b8b48ef795 [deviantart] add to extractor list 2015-10-05 20:29:48 +02:00
Mike Fährmann
76f32addf9 [booru] skip images without 'file-url' attribute 2015-10-05 20:27:27 +02:00
Mike Fährmann
0e5ef06ac0 Merge branch 'loader' 2015-10-05 18:10:35 +02:00
Mike Fährmann
733ae601da enable user-specified patterns 2015-10-05 18:10:18 +02:00
Mike Fährmann
49e91bcb73 adjust loader to new config-interface 2015-10-05 17:52:50 +02:00
Mike Fährmann
e23aaa4298 Merge branch 'config' into loader 2015-10-05 17:46:04 +02:00
Mike Fährmann
539faa0322 remove SequentialExtractor class 2015-10-05 17:15:31 +02:00
Mike Fährmann
7d7c1afe20 [deviantart] adjust constructor paramters 2015-10-05 17:06:58 +02:00
Mike Fährmann
88442ad26d Merge branch 'config' 2015-10-05 17:04:43 +02:00
Mike Fährmann
3c13548f29 rewrite extractors to use config-module 2015-10-05 15:51:08 +02:00
Mike Fährmann
608d3193a9 use new config-module in downloader 2015-10-05 14:46:42 +02:00
Mike Fährmann
2026223ed1 change argument format for config-calls 2015-10-05 12:42:42 +02:00
Mike Fährmann
ae535ba0c1 add extractor 'deviantart' 2015-10-04 04:13:50 +02:00
Mike Fährmann
9986a5ffb5 json-based config module 2015-10-03 20:23:55 +02:00
Mike Fährmann
42b8e81a68 rewrite extractors to use text-module 2015-10-03 15:43:02 +02:00
Mike Fährmann
c5801c9770 combine text related functions in new module 2015-10-03 12:53:45 +02:00
Mike Fährmann
d7e0d81bdd [8chan] use api 2015-09-07 17:16:50 +02:00
Mike Fährmann
d8ef128e74 [4chan] update default filename and directory 2015-09-07 16:24:16 +02:00
Mike Fährmann
1998ec9b13 [pixiv] update user-agent to newest version 2015-09-07 13:48:16 +02:00
Mike Fährmann
c9ef181b3c [4chan] use api 2015-06-29 23:14:35 +02:00
Mike Fährmann
c8e5b2e89e base class for futaba-chan boards with api 2015-06-29 23:11:09 +02:00
Mike Fährmann
26bb9d62de move and rework extractor-loading code 2015-06-28 22:57:17 +02:00
Mike Fährmann
4348694629 sanatize output 2015-06-28 12:45:52 +02:00
Mike Fährmann
63992363a6 [pixiv] handle timestamps at the end of urls 2015-06-28 12:36:30 +02:00
Mike Fährmann
13ebca2a48 [mangareader] supply correct width and height 2015-06-28 01:23:09 +02:00
Mike Fährmann
2afe15b217 [redhawkscans] let requests handle content decoding 2015-06-27 15:07:22 +02:00
Mike Fährmann
675937c77c [mangareader] add extractor 2015-06-26 22:07:36 +02:00
Mike Fährmann
58dfd1a38f [redhawkscans] fix chapter parsing 2015-06-25 19:24:30 +02:00
Mike Fährmann
a9e68c2745 [redhawkscans] fix json extraction 2015-06-25 17:59:20 +02:00
Mike Fährmann
b3f656ffd5 [redhawkscans] add extractor 2015-06-25 17:21:07 +02:00
Mike Fährmann
d9d88f1448 [pixiv] fix ugoira parsing 2015-05-20 11:06:35 +02:00
Mike Fährmann
68c4306040 [pixiv] transition to pixiv public api 2015-05-14 19:08:20 +02:00
Mike Fährmann
c0530a635c [batoto] a few fixes 
- removed 'volume' fields from default format strings
- fixed parsing  by making volumes optional
- removed debug output
- updated docstring
- added a few unescape calls
 2015-05-10 15:47:44 +02:00
Mike Fährmann
a145a73d05 add extractor 'nijie' 2015-05-07 01:39:30 +02:00
Mike Fährmann
9c25c15438 [3dbooru] fix default regex 2015-05-04 18:22:07 +02:00
Mike Fährmann
5993177ae3 [4chan] more metadata entries (size, width, height) 2015-05-04 14:57:47 +02:00
Mike Fährmann
a2cfbe445f add extractor '3dbooru' 2015-04-15 22:24:27 +02:00
Mike Fährmann
762ad7426a add extractor 'yandere' 2015-04-15 17:35:30 +02:00
Mike Fährmann
07f23dc2fa add extractor '4chan' 2015-04-14 15:04:07 +02:00
Mike Fährmann
fae1b28c48 [pixiv] fix parsing of illust_ids 2015-04-12 18:05:49 +02:00
Mike Fährmann
ffec41f352 [imgchili] update to new extractor interface 2015-04-12 15:59:52 +02:00
Mike Fährmann
f3e208c0ab [batoto] update to new extractor interface 2015-04-11 23:49:36 +02:00
Mike Fährmann
3c6161eea7 small whitespace fixes 2015-04-11 16:22:15 +02:00
Mike Fährmann
593a29b677 [imgbox] update to new extractor interface 2015-04-11 16:12:28 +02:00
Mike Fährmann
e41768d969 [imagebam] update to new extractor interface 2015-04-11 14:15:01 +02:00
Mike Fährmann
758fe00441 [e621] update to new extractor interface 2015-04-11 00:39:26 +02:00
Mike Fährmann
5cb46a2cb3 [gelbooru] update to new extractor interface 2015-04-11 00:17:43 +02:00
Mike Fährmann
1f4866fcd6 [danbooru] update to new extractor interface 2015-04-11 00:17:06 +02:00
Mike Fährmann
8c7da93d19 move and update BooruExtractor classes 2015-04-11 00:16:17 +02:00
Mike Fährmann
28fa7c53b4 docstrings and other small fixes for downloaders 2015-04-10 21:45:41 +02:00
Mike Fährmann
5545624da1 use seperate session in http downloader 2015-04-10 19:19:12 +02:00
Mike Fährmann
8f24329e30 [pixiv] fix http headers and cookies 2015-04-10 17:32:36 +02:00
Mike Fährmann
5806e02f97 better support for KeyboardInterrupt exceptions 2015-04-10 17:31:49 +02:00
Mike Fährmann
1cd25b5369 [pixiv] update to new extractor interface 2015-04-10 15:29:09 +02:00
Mike Fährmann
7c8d787077 add a few docstrings 2015-04-10 01:21:35 +02:00
Mike Fährmann
30b9db43a0 [8chan] combine patterns 2015-04-09 17:28:14 +02:00
Mike Fährmann
3872ccb435 pylint fixes 2015-04-09 16:46:57 +02:00
Mike Fährmann
ce2fab9c7e allow user-specified formats for filenames 2015-04-09 16:40:54 +02:00
Mike Fährmann
652d60a5cd implement new extractor-module selection 2015-04-09 16:13:00 +02:00
Mike Fährmann
cd4a699dd2 add 'Headers' and 'Cookies' message 2015-04-08 19:06:50 +02:00
Mike Fährmann
7b9fcea6bb small fixes 2015-04-08 02:30:10 +02:00
Mike Fährmann
f31c05f522 [8chan] update to new extractor interface 2015-04-08 02:26:13 +02:00
Mike Fährmann
0abbee3710 update download-infrastructure 2015-04-08 01:51:48 +02:00
Mike Fährmann
513808d156 move code from util.py 2015-04-08 01:46:04 +02:00
Mike Fährmann
41f00809ff update extractor base classes 2015-04-08 01:43:25 +02:00
Mike Fährmann
63bf0d1725 update __init__.py 2015-04-05 17:15:27 +02:00
Mike Fährmann
7c12ba1c31 move DownloadManager and ExtractorFinder 2015-04-05 16:23:20 +02:00
Mike Fährmann
d13608e909 [pixiv] fix parsing of illust-ids 2015-03-27 18:09:30 +01:00
Mike Fährmann
a66a5099f8 added extractor 'imgchili' 2015-02-03 00:23:22 +01:00
Mike Fährmann
ac002cc4b3 [8chan] fix image urls 2015-02-03 00:22:39 +01:00
Mike Fährmann
54d40b85fb [pixiv] load balancing for image servers 2015-01-27 21:51:48 +01:00
Mike Fährmann
0f6cc964cc [8chan] use new domainname for thread-urls 2015-01-18 23:45:40 +01:00
Mike Fährmann
34d13bc906 added extractor 'danbooru' + split BooruExtractor to handle XML and JSON 2014-12-30 21:34:55 +01:00
Mike Fährmann
2a7dbd8868 [booru] unquote tags to fix multiple tags in urls 2014-12-22 16:45:58 +01:00
Mike Fährmann
099fe7515e added extractor 'e621' 2014-12-22 16:23:41 +01:00
Mike Fährmann
1244c933a1 [8chan] fix image urls 2014-11-26 17:38:50 +01:00
Mike Fährmann
729d2d8b20 [imagebam] fixed issue with destination direcotry name 2014-11-20 21:45:59 +01:00
Mike Fährmann
98dd5f9a90 added extractor 'imagebam' 2014-11-20 21:27:57 +01:00
Mike Fährmann
ff53b7f6fa added extractor 'imgbox' 2014-11-20 20:08:55 +01:00
Mike Fährmann
4950cb0ab9 use 'safe_request' to handle connection errors 2014-10-31 23:39:59 +01:00
Mike Fährmann
b630753e5e add 'method' parameter 2014-10-31 23:38:21 +01:00
Mike Fährmann
7588974306 fixed various bugs 
- forgot "self." before "name_fmt"
- image keys where off by one
 2014-10-15 16:17:59 +02:00
Mike Fährmann
deef91eddc initial commit 2014-10-12 21:56:44 +02:00