1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-24 03:32:33 +01:00
Commit Graph

411 Commits

Author SHA1 Message Date
Mike Fährmann
00074a71d7
several changes to make travis build work
- fixed html.unescape not being available on Python3.3
- removed inconsistent test result
- added username/password pairs for authenticating extractors
2017-01-10 13:41:00 +01:00
Mike Fährmann
cfe5bf732a
[gomanga] add chapter extractor 2017-01-10 00:05:08 +01:00
Mike Fährmann
4a8d74973c
adjust login methods to a specific style 2017-01-08 17:33:25 +01:00
Mike Fährmann
98d6d131a3
update unittests for batoto and yonkouprod 2017-01-08 17:30:44 +01:00
Mike Fährmann
468c9aeeec
make tests more reliable 2017-01-05 00:29:05 +01:00
Mike Fährmann
33c799b2ae
[yonkouprod] rename 'yonkou' to 'yonkouprod' 2017-01-05 00:26:41 +01:00
Mike Fährmann
95986ed566
[seiga] add user extractor 2017-01-04 14:21:36 +01:00
Mike Fährmann
efaba5f398
[luscious] support new album URLs + small fixes 2017-01-03 15:03:36 +01:00
Mike Fährmann
79ea457e24
[luscious] use new 'html' attribute in API responses 2017-01-03 14:02:52 +01:00
Mike Fährmann
a8d716c043
[pinterest] tests + fix error message 2017-01-03 12:12:36 +01:00
Mike Fährmann
a849d8f2f7
add a few more tests 2016-12-31 00:51:06 +01:00
Mike Fährmann
7952b8d18d
add a few tests expecting exceptions 2016-12-30 01:46:42 +01:00
Mike Fährmann
efdc299547
[hentaifoundry] get artist name from webpage 2016-12-29 17:38:22 +01:00
Mike Fährmann
1aeb60d997
[jaiminisbox] add extractor 2016-12-29 16:41:08 +01:00
Mike Fährmann
8b2024a1a5
[hentaifoundry] support direct links to images 2016-12-27 15:24:42 +01:00
Mike Fährmann
c604a65b88
[imgyt] use token as filename if none is given 2016-12-25 00:53:32 +01:00
Mike Fährmann
3a7421a6ce
[twitter] get 'original' instead of 'large' image 2016-12-24 01:35:06 +01:00
Mike Fährmann
cb180507ab
[batoto] add manga extractor 2016-12-23 00:33:51 +01:00
Mike Fährmann
ff2a65d5c1
[exhentai] raise proper exception for 'unavailable' galleries 2016-12-22 12:42:41 +01:00
Mike Fährmann
f69209871d
[kisscomic] change some names from 'manga' to 'comic' 2016-12-22 12:40:49 +01:00
Mike Fährmann
d623b9bfdc
[readcomics] code cleanup + tests 2016-12-21 00:24:18 +01:00
Mike Fährmann
c19241e299
[readcomics] add comic extractor 2016-12-21 00:08:31 +01:00
Mike Fährmann
179d62023c
[readcomics] add comic-issue extractor 2016-12-20 16:30:25 +01:00
Mike Fährmann
d12a04af3c
[test] filter out classes without a 'test' attribute 2016-12-17 13:23:29 +01:00
Mike Fährmann
40dbea7ed2
rewrite parts of the cloudflare bypass system 2016-12-16 13:28:36 +01:00
Mike Fährmann
3c4155c9c9
[kisscomic] add extractors 2016-12-15 16:17:07 +01:00
Mike Fährmann
06c798d18e
[yonkou] add chapter extracter 2016-12-14 15:34:30 +01:00
Mike Fährmann
effdf9c3be
[luscious] adapt to API changes 2016-12-13 12:53:59 +01:00
Mike Fährmann
4c55275305
update tests 2016-12-12 14:17:15 +01:00
Mike Fährmann
69cde97c93
add utility extractor that runs test-URLs 2016-12-10 00:01:00 +01:00
Mike Fährmann
b0e8daf415
[imgclick] remove extractor - uses captcha 2016-12-08 16:51:25 +01:00
Mike Fährmann
0211ec4114
update some tests 2016-12-08 00:24:23 +01:00
Mike Fährmann
dfd1992a2c
[hentaifoundry] small updates
- throw an exception if an user or image does not exist
- update tests, since the user of the old ones left
2016-12-07 09:10:18 +01:00
Mike Fährmann
2fae0b1803
[fapat] add extractor 2016-12-07 08:45:52 +01:00
Mike Fährmann
583f1b8bbb
[postimg] add extractor 2016-12-06 12:46:41 +01:00
Mike Fährmann
d1cd9acf54
[pixhost] adjust to new site layout 2016-12-06 10:05:24 +01:00
Mike Fährmann
0989cd2430
add basic support for file:// URLs
this allows you to feed local files into the recursive extractor
2016-12-05 18:27:36 +01:00
Mike Fährmann
91dff9827f
[luscious] always provide URLs to the original images 2016-11-29 17:17:35 +01:00
Mike Fährmann
d402e644bf
update tests 2016-11-29 17:11:41 +01:00
Mike Fährmann
46440fda2d
[imagevenue] add extractor 2016-11-28 22:30:00 +01:00
Mike Fährmann
2449825d53
[kissmanga] solve cloudflare challenge on demand 2016-11-23 12:48:44 +01:00
Mike Fährmann
9e3788175e
implement decorator for cloudflare bypass
this method for enabling and caching a cloudflare bypass for a
requests.session object allows for different cache-timeouts for
different domains
2016-11-20 18:05:49 +01:00
Mike Fährmann
6e98538d36
[mangamint] small fixes and additions
- force https
- update patterns to also catch non-standard URLs to manga and chapters
- handle URLs to non-existing resources gracefully
- fix terminating condition for chapter listings
- add a base class for common code
- add and update tests
2016-11-17 12:13:43 +01:00
Mike Fährmann
c333bc33e3
[mangapark] small fixes and additions
- add a 'title' keyword for chapter-titles and update the directory
  format accordingly
- add a 'type' keyword to distinguish between manga and manhwa
- fix an issue where an exception would be thrown if a chapter number
  did not have any special additions (2.5, 55a, v2, etc.)
- add a test-case without a special chapter number
- unescape manga title
2016-11-16 14:42:13 +01:00
Mike Fährmann
b634ace39e
[readcomiconline] add comic-issue and comic extractor 2016-11-14 18:29:45 +01:00
Mike Fährmann
99440ca51a
[imgtrial] add extractor 2016-11-13 21:25:37 +01:00
Mike Fährmann
5f2824dfe6
[imgspot] add extractor 2016-11-13 21:24:38 +01:00
Mike Fährmann
c85adbdc9d
[mangamint] code simplifications 2016-11-13 21:19:18 +01:00
Mike Fährmann
88193718e8
[pixhost] add extractor 2016-11-09 12:03:14 +01:00
Mike Fährmann
07e9e2c4f1
[imgmaid] add extractor 2016-11-08 00:17:10 +01:00
Mike Fährmann
885aa7f7cf
[img4ever] add extractor 2016-11-08 00:16:47 +01:00
Mike Fährmann
5c69a380f0
[kissmanga] code simplifications 2016-11-08 00:15:27 +01:00
Mike Fährmann
4f51d72d22
[imgbox] handle non-existing images/galleries 2016-11-07 08:39:03 +01:00
Mike Fährmann
68fe58ee72
[imgchili] set encoding 2016-11-07 08:37:43 +01:00
Mike Fährmann
58ce0b55e3
[deviantart] make sure to pick the highest quality image 2016-11-06 10:44:50 +01:00
Mike Fährmann
37ea66098a
add tests 2016-11-05 13:51:52 +01:00
Mike Fährmann
653885abf2
[doujinmode] remove extractor - site is down 2016-11-04 09:42:13 +01:00
Mike Fährmann
78b168820d
move another 4 extractors 2016-11-04 09:33:38 +01:00
Mike Fährmann
5e82e8dfbd
move chronos & co. to imagehosts file 2016-11-03 18:14:33 +01:00
Mike Fährmann
8b7f719f36
combine imagehost extractors into a single file
added extractors for
 - hosturimage.com
 - imageontime.org
 - imgupload.yt
 - imgspice.com
 - imgclick.net

All of these would have shared a lot of common code, so i created a base
class for imagehost extractors and put them all in the same file to
avoid clutter.
2016-11-03 15:46:04 +01:00
Mike Fährmann
e6d26f0476
don't overwrite a response's encoding with None 2016-10-30 20:38:22 +01:00
Mike Fährmann
e0b3339107
[imgur] match mobile urls (m.imgur.com) 2016-10-29 19:46:34 +02:00
Mike Fährmann
04b1519779
[hitomi] fix domain of image-urls 2016-10-29 19:45:17 +02:00
Mike Fährmann
2004f6bd67
add a few tests 2016-10-28 00:42:32 +02:00
Mike Fährmann
005c539829
improve foolslide volume- and chapter-keywords 2016-10-28 00:38:19 +02:00
Mike Fährmann
2a632c9bfd
[worldthree] add chapter extractor 2016-10-26 23:11:24 +02:00
Mike Fährmann
828aedd571
[khinsider] unescape soundtrack title 2016-10-25 15:26:32 +02:00
Mike Fährmann
3078e4c9f5
[sensescans] add chapter extractor 2016-10-25 15:25:25 +02:00
Mike Fährmann
5374f12bd0
[dokireader] use foolslide base class 2016-10-24 15:04:30 +02:00
Mike Fährmann
f4c2461ba7
[powermanga] use foolslide base class 2016-10-24 15:03:54 +02:00
Mike Fährmann
e1ce27f41b
add base class for foolslide based sites 2016-10-23 17:51:12 +02:00
Mike Fährmann
46a3f666df
[whentai] add single image extractor 2016-10-22 18:48:09 +02:00
Mike Fährmann
a0f56b2c54
update tests 2016-10-21 20:52:19 +02:00
Mike Fährmann
f415d4816b
[whentai] add user extractor 2016-10-19 13:15:41 +02:00
Mike Fährmann
d793e16463
[nhentai] fix subcategory value 2016-10-16 13:40:14 +02:00
Mike Fährmann
02a441503a
[pinterest] adjust regex pattern 2016-10-16 12:00:43 +02:00
Mike Fährmann
a33b13c631
[8chan] fix file urls 2016-10-15 23:06:54 +02:00
Mike Fährmann
ffc3c2d32c
[imgbox] transition to https 2016-10-12 15:21:38 +02:00
Mike Fährmann
492cb38391
[exhentai] use image-count as stop signal 2016-10-12 15:19:31 +02:00
Mike Fährmann
607f50effb
[exhentai] retry failed api calls 2016-10-11 13:27:19 +02:00
Mike Fährmann
f7c993d952
set 'extension' keyword whenever possible 2016-10-07 15:11:58 +02:00
Mike Fährmann
be73af551e
[rapidimg] unset test from parent class 2016-10-07 15:10:36 +02:00
Mike Fährmann
8c8ad08e28
[imgur] fix image url retrieval 2016-10-07 00:13:51 +02:00
Mike Fährmann
bf8d88499a
[twitter] add extractor 2016-10-06 19:12:07 +02:00
Mike Fährmann
e3926bf351
[hentaihere] add manga- and chapter-extractors 2016-10-05 09:34:23 +02:00
Mike Fährmann
c155c7b94b
[hentai2read] put some common code in a base class 2016-10-05 09:19:09 +02:00
Mike Fährmann
277c505b8d
[picmaniac] add extractor 2016-10-03 16:14:46 +02:00
Mike Fährmann
a0c044f0c9
[rapidimg] add extractor 2016-10-03 16:13:05 +02:00
Mike Fährmann
883e702fd6
[mangapark] remove 'url' keyword + fix tests 2016-10-03 15:56:27 +02:00
Mike Fährmann
c20a3b3a01
[*chan] code cleanup 2016-10-03 08:23:40 +02:00
Mike Fährmann
d31ccb16f2
rename 'generic' to 'recursive' 2016-10-01 15:54:27 +02:00
Mike Fährmann
12c99293b6
allow extension by Content-Type for exhentai, seiga, senmanga 2016-09-30 16:43:43 +02:00
Mike Fährmann
8d106a447c
[tumblr] delete more useless keywords 2016-09-27 21:49:38 +02:00
Mike Fährmann
051c181138
[dokireader] add chapter extractor 2016-09-26 22:13:23 +02:00
Mike Fährmann
1134339c1f
Merge branch 'category' 2016-09-25 17:52:55 +02:00
Mike Fährmann
56d810c896
update keyword hashes for tests 2016-09-25 17:28:46 +02:00
Mike Fährmann
19c2d4ff6f
remove explicit (sub)category keywords 2016-09-25 14:22:07 +02:00
Mike Fährmann
0a3fb198f3
[batoto] raise exception if chapter is unavailable (#4) 2016-09-24 13:26:19 +02:00
Mike Fährmann
3f985d5342
[hitomi] fix some keywords 2016-09-23 08:21:49 +02:00
Mike Fährmann
9d107b8e1b
[dynastyscans] add chapter extractor 2016-09-22 17:20:57 +02:00