1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-23 03:02:50 +01:00
Commit Graph

5454 Commits

Author SHA1 Message Date
Mike Fährmann
8a49a28d13
replace deprecated 'unescape' method 2016-02-18 15:54:58 +01:00
Mike Fährmann
9b46322e70
fix indentation 2016-02-18 15:52:36 +01:00
Mike Fährmann
616e0aedd6
update booru testdata 2015-12-22 03:10:52 +01:00
Mike Fährmann
565ea042c9
update HashJob to generate hashes for downloaded content 2015-12-21 22:49:04 +01:00
Mike Fährmann
ecc6542fc8
change required parameter type to file-like objects 2015-12-21 22:46:49 +01:00
Mike Fährmann
5a8541afa5
remove 'unstable' tests 2015-12-15 23:45:40 +01:00
Mike Fährmann
ba99506c72
more extractor test-cases 2015-12-14 03:00:58 +01:00
Mike Fährmann
a99fdb0d1e
[mangapark] fix regexes 2015-12-14 01:56:49 +01:00
Mike Fährmann
2449532132
add more extractor test-cases 2015-12-13 04:36:44 +01:00
Mike Fährmann
f0e9e8e0dc
ensure extractors() returns each extractor only once 2015-12-13 04:34:15 +01:00
Mike Fährmann
9c9b1e112a
[imgur] fix 'date' and 'count' keywords 2015-12-13 03:35:55 +01:00
Mike Fährmann
5589bc2ed7
[deviantart] fix non-terminating loop 2015-12-13 03:16:08 +01:00
Mike Fährmann
c8fdfbec42
[danbooru] add test cases 2015-12-12 15:59:26 +01:00
Mike Fährmann
5304e5beef
testing environment for extractor results 2015-12-12 15:58:07 +01:00
Mike Fährmann
9ca4426b72
add HashJob for automated testing 2015-12-12 03:06:00 +01:00
Mike Fährmann
059b1ee5e8
add base class for job types 2015-12-12 00:11:05 +01:00
Mike Fährmann
75ff08f73c
[nijie] proper login and other issues fixed 2015-12-11 00:07:21 +01:00
Mike Fährmann
2dfed4d40a
implement -g,--get-urls option 2015-12-10 02:14:28 +01:00
Mike Fährmann
50ec170b00
[mangapark] add manga extractor 2015-12-09 00:07:18 +01:00
Mike Fährmann
0ff437ca88
[mangapark] add chapter extractor 2015-12-08 22:29:34 +01:00
Mike Fährmann
995d8578bf
[deviantart] fix dates in image-extractor 2015-12-07 00:34:41 +01:00
Mike Fährmann
7d965a2897
[deviantart] add single image extractor 2015-12-06 21:13:57 +01:00
Mike Fährmann
e4a661fd6b
[deviantart] fix issue with small images 2015-12-06 14:24:27 +01:00
Mike Fährmann
3ebd126b35
[imgbox] add single image extractor 2015-12-05 19:30:27 +01:00
Mike Fährmann
a71805bacf
[chronos] add extractor 2015-12-04 20:33:04 +01:00
Mike Fährmann
30e47848cc
update setup.py and bump version 2015-12-03 02:31:23 +01:00
Mike Fährmann
cb53b29391
[imagetwist] adjust pattern and other fixes 2015-12-03 01:07:59 +01:00
Mike Fährmann
65c8566326
add provisional generic extractor 2015-12-03 00:50:34 +01:00
Mike Fährmann
e7512f626d
[turboimagehost] add extractor 2015-12-03 00:25:15 +01:00
Mike Fährmann
56876b76f1
[imagetwist] add extractor 2015-12-03 00:16:36 +01:00
Mike Fährmann
810aa4e146
add a space after status indicators 2015-12-02 18:49:49 +01:00
Mike Fährmann
b2401542eb
implement output.mode and .shorten options 2015-12-02 18:47:42 +01:00
Mike Fährmann
8d257510d0
rework output module 2015-12-02 16:48:23 +01:00
Mike Fährmann
bd87b5186d
[spectrumnexus] recognize volumes 2015-12-02 02:16:22 +01:00
Mike Fährmann
2ced575c4a
[spectrumnexus] add manga-extractor 2015-12-02 02:03:24 +01:00
Mike Fährmann
a8c0b4531d
fix issue with Ctrl+c on windows 2015-12-02 01:01:33 +01:00
Mike Fährmann
140f0475a6
allow lists to specify base-dir segments 2015-12-02 01:00:51 +01:00
Mike Fährmann
d26eec8470
workarounds for windows console 2015-12-01 23:54:57 +01:00
Mike Fährmann
4b377ccc09
use output-module during downloads 2015-12-01 21:22:58 +01:00
Mike Fährmann
c786843a6f
add output-module 2015-12-01 21:21:39 +01:00
Mike Fährmann
f7c47a6018
add subcategories to extractors 2015-11-30 01:11:13 +01:00
Mike Fährmann
81dcfbec90
initial support for extractor-subcategories 2015-11-30 00:30:02 +01:00
Mike Fährmann
1146ed95dc
improved get_base_directory 2015-11-30 00:11:57 +01:00
Mike Fährmann
1497da07de
remove unused format-strings 2015-11-29 23:41:43 +01:00
Mike Fährmann
c23eaccf46
[hentaifoundry] add single image extractor 2015-11-29 00:01:49 +01:00
Mike Fährmann
34210edf9a
[mangashare] add manga-extractor 2015-11-29 00:00:40 +01:00
Mike Fährmann
f48712c9c9
docstrings 2015-11-28 22:21:35 +01:00
Mike Fährmann
9cb184d409
[powermanga] support another url-pattern 2015-11-28 20:31:37 +01:00
Mike Fährmann
1eaf0a55a6
[mangamint] add manga-extractor 2015-11-28 20:30:00 +01:00
Mike Fährmann
914062d172
use text.extract_iter where applicable 2015-11-28 02:06:29 +01:00
Mike Fährmann
99b4fbb081
implement text.extract_iter 2015-11-28 01:46:34 +01:00
Mike Fährmann
332d9e393b
[mangahere] support sub-chapters (e.g. ch4.5) 2015-11-28 00:31:04 +01:00
Mike Fährmann
88739a3564
[mangahere] add manga-extractor 2015-11-28 00:11:28 +01:00
Mike Fährmann
e78937a580
cache cookies from cloudflare-bypass 2015-11-27 21:32:07 +01:00
Mike Fährmann
2b93fdba7c
[kissmanga] unify extractor metadata in base class 2015-11-27 21:31:17 +01:00
Mike Fährmann
763792f207
[kissmanga] add manga-extractor 2015-11-27 16:19:21 +01:00
Mike Fährmann
a1c09ff04d
[mangapanda] fix regex 2015-11-27 01:58:42 +01:00
Mike Fährmann
a7243b5ac5
bugfix: add patterns to cache before returning them 2015-11-27 01:42:40 +01:00
Mike Fährmann
d8f692f711
[mangapanda] add manga-extractor 2015-11-27 00:14:09 +01:00
Mike Fährmann
63d693866c
[mangareader] remove leading spaces from manga names 2015-11-26 23:33:32 +01:00
Mike Fährmann
20efe49f83
[mangareader] unify extractor metadata in base class 2015-11-26 23:32:16 +01:00
Mike Fährmann
d5349c8cb5
[mangareader] add manga-extractor (all chapters) 2015-11-26 23:07:12 +01:00
Mike Fährmann
3a93faa372
add and implement Queue message 2015-11-26 22:55:45 +01:00
Mike Fährmann
d96f4f8299
bump version 2015-11-26 18:10:58 +01:00
Mike Fährmann
d1673d912a
[mangahere] add chapter-extractor 2015-11-26 03:06:08 +01:00
Mike Fährmann
8b6f02a615
[mangamint] add chapter extractor 2015-11-25 22:05:26 +01:00
Mike Fährmann
3fb5a8b834
delay 'requests'-import 2015-11-24 19:47:51 +01:00
Mike Fährmann
a4c880f4c5
[pixiv] add bookmark extractor 2015-11-23 03:25:08 +01:00
Mike Fährmann
daf5fcd416
[pixiv] add user-favorite extractor 2015-11-23 00:23:05 +01:00
Mike Fährmann
20a4782173
[pixiv] get rid of an unnecessry api-call 2015-11-22 03:58:31 +01:00
Mike Fährmann
2a97296e69
[pixiv] add single work/illust extractor 2015-11-22 02:21:02 +01:00
Mike Fährmann
9251ea5771
[powermanga] update to new format 2015-11-21 04:32:32 +01:00
Mike Fährmann
68e7f7427d
Merge branch 'multi-extractor' 2015-11-21 04:29:38 +01:00
Mike Fährmann
c0aaf230d5
remove comments 2015-11-21 04:29:08 +01:00
Mike Fährmann
4d56b76aa8
update all other extractors 2015-11-21 04:26:30 +01:00
Mike Fährmann
ad12180027
[redhawkscans] remove module 2015-11-21 04:22:02 +01:00
Mike Fährmann
bcb23e44ce
[powermanga] transfer code from redhawkscans 2015-11-21 04:20:09 +01:00
Mike Fährmann
2dfe97dd00
[chan] update to new format 2015-11-21 03:13:06 +01:00
Mike Fährmann
2d498b19a1
remove 'info' parameter 2015-11-21 03:12:36 +01:00
Mike Fährmann
78234f0572
[safebooru] update to new format 2015-11-21 02:52:04 +01:00
Mike Fährmann
bb8f2a3e9d
[gelbooru] update to new format 2015-11-21 02:40:30 +01:00
Mike Fährmann
63a38edd05
[konachan] update to new format 2015-11-21 02:09:02 +01:00
Mike Fährmann
23208a49b8
[e621] update to new format 2015-11-21 01:56:49 +01:00
Mike Fährmann
1bce63124b
[3dbooru] update to new format 2015-11-21 01:48:44 +01:00
Mike Fährmann
70a6599904
[yandere] update to new format 2015-11-21 00:58:45 +01:00
Mike Fährmann
15dec86e6a
[danbooru] update to new format 2015-11-21 00:55:25 +01:00
Mike Fährmann
74199422a8
[booru] add base classes for tag/pool/post extractors 2015-11-21 00:54:29 +01:00
Mike Fährmann
900577b013
restructure info-parameters 2015-11-21 00:30:31 +01:00
Mike Fährmann
205ef3ca02
[danbooru] add single image/post extractor 2015-11-20 20:25:31 +01:00
Mike Fährmann
ee1ba22d05
[danbooru] add pool extractor 2015-11-20 20:24:58 +01:00
Mike Fährmann
80917f5392
[danbooru] rewrite to use multiple extractors 2015-11-20 20:24:15 +01:00
Mike Fährmann
8c3783706d
allow multiple extractors per module 2015-11-20 19:54:07 +01:00
Mike Fährmann
e9547ebdf3
[exhentai] configurable wait-times 2015-11-19 17:04:54 +01:00
Mike Fährmann
9c63027d2c
[exhentai] fix 'imgkey' handling 2015-11-18 14:10:42 +01:00
Mike Fährmann
4440b40234
[exhentai] better language keywords 2015-11-17 20:51:06 +01:00
Mike Fährmann
1c9296140c
[hitomi] provide proper language keywords 2015-11-16 17:50:54 +01:00
Mike Fährmann
7fd284a705
always provide lowercase fileextensions 2015-11-16 17:40:05 +01:00
Mike Fährmann
7547d8be3f
[spectrumnexus] add additional regex 2015-11-16 17:38:59 +01:00
Mike Fährmann
c2f0720184
code cleanup to use nameext_from_url 2015-11-16 17:32:26 +01:00
Mike Fährmann
ca523b9f64
add helper method to text module 2015-11-16 03:46:43 +01:00
Mike Fährmann
41f5971e73
[mangashare] add extractor 2015-11-15 03:40:17 +01:00
Mike Fährmann
3f2fbd874d
[hbrowse] add extractor 2015-11-15 01:30:26 +01:00
Mike Fährmann
5db2aa29cf
Merge branch 'options' 2015-11-14 17:23:24 +01:00
Mike Fährmann
b55870909c
properly implement -c,--config option 2015-11-14 17:22:56 +01:00
Mike Fährmann
b683427d42
properly implement -d,--dest options 2015-11-14 16:07:10 +01:00
Mike Fährmann
b041906c2c make URL argument not necessary for some switches 2015-11-14 15:31:07 +01:00
Mike Fährmann
fdcc434b3d
implement --list-modules cmd-line option 2015-11-14 15:11:44 +01:00
Mike Fährmann
783e62b621
[hentaifoundry] code cleanup 2015-11-14 14:21:55 +01:00
Mike Fährmann
eb4a87b620
[hentaifoundry] add extractor 2015-11-14 03:19:44 +01:00
Mike Fährmann
247c5fcf8f
Merge branch 'options' 2015-11-13 01:20:55 +01:00
Mike Fährmann
90247977c9
implement --list-keywords cmd-line option 2015-11-13 01:19:01 +01:00
Mike Fährmann
edf3f7b69f
add KeywordJob class 2015-11-13 01:02:49 +01:00
Mike Fährmann
dd796e91c0
[spectrumnexus] add extractor 2015-11-13 00:21:50 +01:00
Mike Fährmann
db113bd87d
rename download.py 2015-11-12 03:28:01 +01:00
Mike Fährmann
47f016a016
remove DownloadManager class 2015-11-12 02:35:30 +01:00
Mike Fährmann
352950eebe
new method to import downloaders 2015-11-12 02:29:59 +01:00
Mike Fährmann
21a6416737
bugfixes 2015-11-12 02:28:47 +01:00
Mike Fährmann
73eeed3e72
[imgur] rewrite 2015-11-12 00:18:56 +01:00
Mike Fährmann
4427734b70
[imgur] fix parsing 2015-11-11 21:44:00 +01:00
Mike Fährmann
129ca282e4
[chan] unescape title 2015-11-11 00:51:07 +01:00
Mike Fährmann
20845d86f8
bump version 2015-11-10 21:17:31 +01:00
Mike Fährmann
3eaae19345
cmd line switch to set options 2015-11-10 01:56:31 +01:00
Mike Fährmann
3510faaed5
[sankaku] always use correct file-url 2015-11-10 00:55:01 +01:00
Mike Fährmann
3560935318
[exhentai] fix module dicstring 2015-11-09 02:33:22 +01:00
Mike Fährmann
60833abcc6
[sankaku] re-enable extractor 2015-11-09 02:29:33 +01:00
Mike Fährmann
36b376b5ba
[mangastream] add extractor 2015-11-08 00:03:14 +01:00
Mike Fährmann
009761fcd5
[mangapanda] add extractor 2015-11-08 00:02:37 +01:00
Mike Fährmann
5abe32a32c
[kissmanga] fix internal regex 2015-11-07 13:28:07 +01:00
Mike Fährmann
079330785a
document and fix smaller bugs 2015-11-07 13:06:23 +01:00
Mike Fährmann
1302f5a0f6
[kissmanga] add extractor 2015-11-07 02:32:59 +01:00
Mike Fährmann
822527a2ce
module to bypass cloudflare protection 2015-11-07 02:30:08 +01:00
Mike Fährmann
3b0fe8f544
unify booru filename-patterns 2015-11-06 16:48:33 +01:00
Mike Fährmann
c05dbd15b5
[gelbooru] support authentication to enable api access 2015-11-06 14:14:29 +01:00
Mike Fährmann
8469b3ae4f
[safebooru] add extractor 2015-11-06 13:54:06 +01:00
Mike Fährmann
6772b54bc4
[konachan] add extractor 2015-11-06 13:24:43 +01:00
Mike Fährmann
8e9bd1d793
sensible output if no extractor found 2015-11-06 13:21:53 +01:00
Mike Fährmann
6e67935b59
add more languages to iso639-1 dict 2015-11-06 00:24:50 +01:00
Mike Fährmann
6ed26864ea
[batoto] rewrite and fix 2015-11-05 23:46:19 +01:00
Mike Fährmann
686a4ddd3e
[8chan] fix file-urls 2015-11-05 00:18:36 +01:00
Mike Fährmann
950bebfd57
update setup.py and bump version 2015-11-04 00:07:03 +01:00
Mike Fährmann
c0efea339e
[imagebam] rewrite/fix 2015-11-04 00:03:48 +01:00
Mike Fährmann
e3e754eed7
[imgbox] use text.extract_all 2015-11-03 00:19:04 +01:00
Mike Fährmann
1352187758
[imgth] use text.extract_all 2015-11-03 00:11:08 +01:00
Mike Fährmann
353ac1e00b
[exhentai] use text.extract_all 2015-11-03 00:10:30 +01:00
Mike Fährmann
1fa6a99f18
[mangareader] rewrite 2015-11-03 00:08:25 +01:00
Mike Fährmann
d0bebd9ce3
allow adding values to existing dict 2015-11-03 00:05:18 +01:00
Mike Fährmann
629133a27a
document text.extract 2015-11-02 15:52:26 +01:00
Mike Fährmann
692d0c95cc
reimplement text.extract_all 2015-11-02 15:51:32 +01:00
Mike Fährmann
506242740f
fix capitalization issues 2015-11-02 14:58:26 +01:00
Mike Fährmann
cc5e37aeae
[powermanga] adjust regex 2015-11-02 00:21:17 +01:00
Mike Fährmann
ec6c1fd18e
[redhawkscans] use langcode to -name mapping 2015-11-02 00:20:40 +01:00
Mike Fährmann
b24bb1da7d
new module for simple language code to name mapping 2015-11-02 00:18:26 +01:00
Mike Fährmann
6dcfed16fc
[powermanga] just inherit from redhawkscans 2015-11-01 01:47:58 +01:00
Mike Fährmann
d6325865e8
[redhawkscans] generalize to allow subclassing 2015-11-01 01:46:00 +01:00
Mike Fährmann
b47f3b9d78 [exhentai] reenable extractor 2015-10-31 16:50:20 +01:00
Mike Fährmann
db479f881d implement text.shorten_path/filename methods 2015-10-31 00:21:02 +01:00
Mike Fährmann
882b1f31b1 update setup.py and bump version 2015-10-30 16:26:08 +01:00
Mike Fährmann
2472d0722a [hitomi] more metadata 2015-10-29 17:53:29 +01:00
Mike Fährmann
9cfe2c78a5 add extractor 'imgth' 2015-10-28 23:26:47 +01:00
Mike Fährmann
25f48101e5 add extractor 'hitomi' 2015-10-28 16:24:35 +01:00
Mike Fährmann
6ce181bcfe add extractor 'nhentai' 2015-10-28 12:08:27 +01:00
Mike Fährmann
cf8f4cd179 [imgur] add to list of extractors 2015-10-12 22:34:45 +02:00
Mike Fährmann
c47bb4d570 add extractor 'imgur' 2015-10-11 16:22:38 +02:00
Mike Fährmann
89f938ee55 handle non string-like arguemnts for clean_path 2015-10-11 16:21:55 +02:00
Mike Fährmann
4cb419b5d9 [chan] unescape html entities in title 2015-10-10 19:58:30 +02:00
Mike Fährmann
7b83f88c64 replace illegal characters in paths 2015-10-09 02:24:41 +02:00
Mike Fährmann
c14b9895ad add extractor 'powermanga' 2015-10-08 20:43:52 +02:00
Mike Fährmann
f5d5684119 [pixiv] reuse api-tokens 2015-10-07 01:09:11 +02:00
Mike Fährmann
bea33ae9cb implement config.setdefault 2015-10-07 00:58:43 +02:00
Mike Fährmann
c8e0efe1ff [pixiv] refresh access-token every 50 minutes 2015-10-06 17:29:08 +02:00
Mike Fährmann
e37846e1c1 bump version number 2015-10-05 20:35:17 +02:00
Mike Fährmann
b8b48ef795 [deviantart] add to extractor list 2015-10-05 20:29:48 +02:00
Mike Fährmann
76f32addf9 [booru] skip images without 'file-url' attribute 2015-10-05 20:27:27 +02:00
Mike Fährmann
0e5ef06ac0 Merge branch 'loader' 2015-10-05 18:10:35 +02:00
Mike Fährmann
733ae601da enable user-specified patterns 2015-10-05 18:10:18 +02:00
Mike Fährmann
49e91bcb73 adjust loader to new config-interface 2015-10-05 17:52:50 +02:00
Mike Fährmann
e23aaa4298 Merge branch 'config' into loader 2015-10-05 17:46:04 +02:00
Mike Fährmann
539faa0322 remove SequentialExtractor class 2015-10-05 17:15:31 +02:00
Mike Fährmann
7d7c1afe20 [deviantart] adjust constructor paramters 2015-10-05 17:06:58 +02:00
Mike Fährmann
88442ad26d Merge branch 'config' 2015-10-05 17:04:43 +02:00
Mike Fährmann
3c13548f29 rewrite extractors to use config-module 2015-10-05 15:51:08 +02:00
Mike Fährmann
608d3193a9 use new config-module in downloader 2015-10-05 14:46:42 +02:00
Mike Fährmann
2026223ed1 change argument format for config-calls 2015-10-05 12:42:42 +02:00
Mike Fährmann
ae535ba0c1 add extractor 'deviantart' 2015-10-04 04:13:50 +02:00
Mike Fährmann
9986a5ffb5 json-based config module 2015-10-03 20:23:55 +02:00
Mike Fährmann
42b8e81a68 rewrite extractors to use text-module 2015-10-03 15:43:02 +02:00
Mike Fährmann
c5801c9770 combine text related functions in new module 2015-10-03 12:53:45 +02:00
Mike Fährmann
d7e0d81bdd [8chan] use api 2015-09-07 17:16:50 +02:00
Mike Fährmann
d8ef128e74 [4chan] update default filename and directory 2015-09-07 16:24:16 +02:00
Mike Fährmann
1998ec9b13 [pixiv] update user-agent to newest version 2015-09-07 13:48:16 +02:00
Mike Fährmann
c9ef181b3c [4chan] use api 2015-06-29 23:14:35 +02:00
Mike Fährmann
c8e5b2e89e base class for futaba-chan boards with api 2015-06-29 23:11:09 +02:00
Mike Fährmann
26bb9d62de move and rework extractor-loading code 2015-06-28 22:57:17 +02:00
Mike Fährmann
4348694629 sanatize output 2015-06-28 12:45:52 +02:00
Mike Fährmann
63992363a6 [pixiv] handle timestamps at the end of urls 2015-06-28 12:36:30 +02:00
Mike Fährmann
13ebca2a48 [mangareader] supply correct width and height 2015-06-28 01:23:09 +02:00
Mike Fährmann
2afe15b217 [redhawkscans] let requests handle content decoding 2015-06-27 15:07:22 +02:00
Mike Fährmann
675937c77c [mangareader] add extractor 2015-06-26 22:07:36 +02:00
Mike Fährmann
58dfd1a38f [redhawkscans] fix chapter parsing 2015-06-25 19:24:30 +02:00
Mike Fährmann
a9e68c2745 [redhawkscans] fix json extraction 2015-06-25 17:59:20 +02:00
Mike Fährmann
b3f656ffd5 [redhawkscans] add extractor 2015-06-25 17:21:07 +02:00
Mike Fährmann
d9d88f1448 [pixiv] fix ugoira parsing 2015-05-20 11:06:35 +02:00
Mike Fährmann
68c4306040 [pixiv] transition to pixiv public api 2015-05-14 19:08:20 +02:00
Mike Fährmann
c0530a635c [batoto] a few fixes
- removed 'volume' fields from default format strings
- fixed parsing  by making volumes optional
- removed debug output
- updated docstring
- added a few unescape calls
2015-05-10 15:47:44 +02:00
Mike Fährmann
a145a73d05 add extractor 'nijie' 2015-05-07 01:39:30 +02:00
Mike Fährmann
9c25c15438 [3dbooru] fix default regex 2015-05-04 18:22:07 +02:00
Mike Fährmann
5993177ae3 [4chan] more metadata entries (size, width, height) 2015-05-04 14:57:47 +02:00
Mike Fährmann
a2cfbe445f add extractor '3dbooru' 2015-04-15 22:24:27 +02:00
Mike Fährmann
762ad7426a add extractor 'yandere' 2015-04-15 17:35:30 +02:00
Mike Fährmann
07f23dc2fa add extractor '4chan' 2015-04-14 15:04:07 +02:00
Mike Fährmann
fae1b28c48 [pixiv] fix parsing of illust_ids 2015-04-12 18:05:49 +02:00
Mike Fährmann
ffec41f352 [imgchili] update to new extractor interface 2015-04-12 15:59:52 +02:00
Mike Fährmann
f3e208c0ab [batoto] update to new extractor interface 2015-04-11 23:49:36 +02:00
Mike Fährmann
3c6161eea7 small whitespace fixes 2015-04-11 16:22:15 +02:00
Mike Fährmann
593a29b677 [imgbox] update to new extractor interface 2015-04-11 16:12:28 +02:00
Mike Fährmann
e41768d969 [imagebam] update to new extractor interface 2015-04-11 14:15:01 +02:00
Mike Fährmann
758fe00441 [e621] update to new extractor interface 2015-04-11 00:39:26 +02:00
Mike Fährmann
5cb46a2cb3 [gelbooru] update to new extractor interface 2015-04-11 00:17:43 +02:00
Mike Fährmann
1f4866fcd6 [danbooru] update to new extractor interface 2015-04-11 00:17:06 +02:00
Mike Fährmann
8c7da93d19 move and update BooruExtractor classes 2015-04-11 00:16:17 +02:00
Mike Fährmann
28fa7c53b4 docstrings and other small fixes for downloaders 2015-04-10 21:45:41 +02:00
Mike Fährmann
5545624da1 use seperate session in http downloader 2015-04-10 19:19:12 +02:00
Mike Fährmann
8f24329e30 [pixiv] fix http headers and cookies 2015-04-10 17:32:36 +02:00
Mike Fährmann
5806e02f97 better support for KeyboardInterrupt exceptions 2015-04-10 17:31:49 +02:00
Mike Fährmann
1cd25b5369 [pixiv] update to new extractor interface 2015-04-10 15:29:09 +02:00
Mike Fährmann
7c8d787077 add a few docstrings 2015-04-10 01:21:35 +02:00
Mike Fährmann
30b9db43a0 [8chan] combine patterns 2015-04-09 17:28:14 +02:00
Mike Fährmann
3872ccb435 pylint fixes 2015-04-09 16:46:57 +02:00
Mike Fährmann
ce2fab9c7e allow user-specified formats for filenames 2015-04-09 16:40:54 +02:00
Mike Fährmann
652d60a5cd implement new extractor-module selection 2015-04-09 16:13:00 +02:00
Mike Fährmann
cd4a699dd2 add 'Headers' and 'Cookies' message 2015-04-08 19:06:50 +02:00
Mike Fährmann
7b9fcea6bb small fixes 2015-04-08 02:30:10 +02:00
Mike Fährmann
f31c05f522 [8chan] update to new extractor interface 2015-04-08 02:26:13 +02:00
Mike Fährmann
0abbee3710 update download-infrastructure 2015-04-08 01:51:48 +02:00
Mike Fährmann
513808d156 move code from util.py 2015-04-08 01:46:04 +02:00
Mike Fährmann
41f00809ff update extractor base classes 2015-04-08 01:43:25 +02:00
Mike Fährmann
63bf0d1725 update __init__.py 2015-04-05 17:15:27 +02:00
Mike Fährmann
7c12ba1c31 move DownloadManager and ExtractorFinder 2015-04-05 16:23:20 +02:00
Mike Fährmann
d13608e909 [pixiv] fix parsing of illust-ids 2015-03-27 18:09:30 +01:00
Mike Fährmann
a66a5099f8 added extractor 'imgchili' 2015-02-03 00:23:22 +01:00
Mike Fährmann
ac002cc4b3 [8chan] fix image urls 2015-02-03 00:22:39 +01:00
Mike Fährmann
54d40b85fb [pixiv] load balancing for image servers 2015-01-27 21:51:48 +01:00
Mike Fährmann
0f6cc964cc [8chan] use new domainname for thread-urls 2015-01-18 23:45:40 +01:00
Mike Fährmann
34d13bc906 added extractor 'danbooru' + split BooruExtractor to handle XML and JSON 2014-12-30 21:34:55 +01:00
Mike Fährmann
2a7dbd8868 [booru] unquote tags to fix multiple tags in urls 2014-12-22 16:45:58 +01:00
Mike Fährmann
099fe7515e added extractor 'e621' 2014-12-22 16:23:41 +01:00
Mike Fährmann
1244c933a1 [8chan] fix image urls 2014-11-26 17:38:50 +01:00
Mike Fährmann
729d2d8b20 [imagebam] fixed issue with destination direcotry name 2014-11-20 21:45:59 +01:00
Mike Fährmann
98dd5f9a90 added extractor 'imagebam' 2014-11-20 21:27:57 +01:00
Mike Fährmann
ff53b7f6fa added extractor 'imgbox' 2014-11-20 20:08:55 +01:00
Mike Fährmann
4950cb0ab9 use 'safe_request' to handle connection errors 2014-10-31 23:39:59 +01:00
Mike Fährmann
b630753e5e add 'method' parameter 2014-10-31 23:38:21 +01:00
Mike Fährmann
7588974306 fixed various bugs
- forgot "self." before "name_fmt"
- image keys where off by one
2014-10-15 16:17:59 +02:00
Mike Fährmann
deef91eddc initial commit 2014-10-12 21:56:44 +02:00