Mike Fährmann
2fae0b1803
[fapat] add extractor
2016-12-07 08:45:52 +01:00
Mike Fährmann
583f1b8bbb
[postimg] add extractor
2016-12-06 12:46:41 +01:00
Mike Fährmann
d1cd9acf54
[pixhost] adjust to new site layout
2016-12-06 10:05:24 +01:00
Mike Fährmann
0989cd2430
add basic support for file:// URLs
...
this allows you to feed local files into the recursive extractor
2016-12-05 18:27:36 +01:00
Mike Fährmann
91dff9827f
[luscious] always provide URLs to the original images
2016-11-29 17:17:35 +01:00
Mike Fährmann
d402e644bf
update tests
2016-11-29 17:11:41 +01:00
Mike Fährmann
46440fda2d
[imagevenue] add extractor
2016-11-28 22:30:00 +01:00
Mike Fährmann
2449825d53
[kissmanga] solve cloudflare challenge on demand
2016-11-23 12:48:44 +01:00
Mike Fährmann
9e3788175e
implement decorator for cloudflare bypass
...
this method for enabling and caching a cloudflare bypass for a
requests.session object allows for different cache-timeouts for
different domains
2016-11-20 18:05:49 +01:00
Mike Fährmann
6e98538d36
[mangamint] small fixes and additions
...
- force https
- update patterns to also catch non-standard URLs to manga and chapters
- handle URLs to non-existing resources gracefully
- fix terminating condition for chapter listings
- add a base class for common code
- add and update tests
2016-11-17 12:13:43 +01:00
Mike Fährmann
c333bc33e3
[mangapark] small fixes and additions
...
- add a 'title' keyword for chapter-titles and update the directory
format accordingly
- add a 'type' keyword to distinguish between manga and manhwa
- fix an issue where an exception would be thrown if a chapter number
did not have any special additions (2.5, 55a, v2, etc.)
- add a test-case without a special chapter number
- unescape manga title
2016-11-16 14:42:13 +01:00
Mike Fährmann
b634ace39e
[readcomiconline] add comic-issue and comic extractor
2016-11-14 18:29:45 +01:00
Mike Fährmann
99440ca51a
[imgtrial] add extractor
2016-11-13 21:25:37 +01:00
Mike Fährmann
5f2824dfe6
[imgspot] add extractor
2016-11-13 21:24:38 +01:00
Mike Fährmann
c85adbdc9d
[mangamint] code simplifications
2016-11-13 21:19:18 +01:00
Mike Fährmann
88193718e8
[pixhost] add extractor
2016-11-09 12:03:14 +01:00
Mike Fährmann
07e9e2c4f1
[imgmaid] add extractor
2016-11-08 00:17:10 +01:00
Mike Fährmann
885aa7f7cf
[img4ever] add extractor
2016-11-08 00:16:47 +01:00
Mike Fährmann
5c69a380f0
[kissmanga] code simplifications
2016-11-08 00:15:27 +01:00
Mike Fährmann
4f51d72d22
[imgbox] handle non-existing images/galleries
2016-11-07 08:39:03 +01:00
Mike Fährmann
68fe58ee72
[imgchili] set encoding
2016-11-07 08:37:43 +01:00
Mike Fährmann
58ce0b55e3
[deviantart] make sure to pick the highest quality image
2016-11-06 10:44:50 +01:00
Mike Fährmann
37ea66098a
add tests
2016-11-05 13:51:52 +01:00
Mike Fährmann
653885abf2
[doujinmode] remove extractor - site is down
2016-11-04 09:42:13 +01:00
Mike Fährmann
78b168820d
move another 4 extractors
2016-11-04 09:33:38 +01:00
Mike Fährmann
5e82e8dfbd
move chronos & co. to imagehosts file
2016-11-03 18:14:33 +01:00
Mike Fährmann
8b7f719f36
combine imagehost extractors into a single file
...
added extractors for
- hosturimage.com
- imageontime.org
- imgupload.yt
- imgspice.com
- imgclick.net
All of these would have shared a lot of common code, so i created a base
class for imagehost extractors and put them all in the same file to
avoid clutter.
2016-11-03 15:46:04 +01:00
Mike Fährmann
e6d26f0476
don't overwrite a response's encoding with None
2016-10-30 20:38:22 +01:00
Mike Fährmann
e0b3339107
[imgur] match mobile urls (m.imgur.com)
2016-10-29 19:46:34 +02:00
Mike Fährmann
04b1519779
[hitomi] fix domain of image-urls
2016-10-29 19:45:17 +02:00
Mike Fährmann
2004f6bd67
add a few tests
2016-10-28 00:42:32 +02:00
Mike Fährmann
005c539829
improve foolslide volume- and chapter-keywords
2016-10-28 00:38:19 +02:00
Mike Fährmann
2a632c9bfd
[worldthree] add chapter extractor
2016-10-26 23:11:24 +02:00
Mike Fährmann
828aedd571
[khinsider] unescape soundtrack title
2016-10-25 15:26:32 +02:00
Mike Fährmann
3078e4c9f5
[sensescans] add chapter extractor
2016-10-25 15:25:25 +02:00
Mike Fährmann
5374f12bd0
[dokireader] use foolslide base class
2016-10-24 15:04:30 +02:00
Mike Fährmann
f4c2461ba7
[powermanga] use foolslide base class
2016-10-24 15:03:54 +02:00
Mike Fährmann
e1ce27f41b
add base class for foolslide based sites
2016-10-23 17:51:12 +02:00
Mike Fährmann
46a3f666df
[whentai] add single image extractor
2016-10-22 18:48:09 +02:00
Mike Fährmann
a0f56b2c54
update tests
2016-10-21 20:52:19 +02:00
Mike Fährmann
f415d4816b
[whentai] add user extractor
2016-10-19 13:15:41 +02:00
Mike Fährmann
d793e16463
[nhentai] fix subcategory value
2016-10-16 13:40:14 +02:00
Mike Fährmann
02a441503a
[pinterest] adjust regex pattern
2016-10-16 12:00:43 +02:00
Mike Fährmann
a33b13c631
[8chan] fix file urls
2016-10-15 23:06:54 +02:00
Mike Fährmann
ffc3c2d32c
[imgbox] transition to https
2016-10-12 15:21:38 +02:00
Mike Fährmann
492cb38391
[exhentai] use image-count as stop signal
2016-10-12 15:19:31 +02:00
Mike Fährmann
607f50effb
[exhentai] retry failed api calls
2016-10-11 13:27:19 +02:00
Mike Fährmann
f7c993d952
set 'extension' keyword whenever possible
2016-10-07 15:11:58 +02:00
Mike Fährmann
be73af551e
[rapidimg] unset test from parent class
2016-10-07 15:10:36 +02:00
Mike Fährmann
8c8ad08e28
[imgur] fix image url retrieval
2016-10-07 00:13:51 +02:00
Mike Fährmann
bf8d88499a
[twitter] add extractor
2016-10-06 19:12:07 +02:00
Mike Fährmann
e3926bf351
[hentaihere] add manga- and chapter-extractors
2016-10-05 09:34:23 +02:00
Mike Fährmann
c155c7b94b
[hentai2read] put some common code in a base class
2016-10-05 09:19:09 +02:00
Mike Fährmann
277c505b8d
[picmaniac] add extractor
2016-10-03 16:14:46 +02:00
Mike Fährmann
a0c044f0c9
[rapidimg] add extractor
2016-10-03 16:13:05 +02:00
Mike Fährmann
883e702fd6
[mangapark] remove 'url' keyword + fix tests
2016-10-03 15:56:27 +02:00
Mike Fährmann
c20a3b3a01
[*chan] code cleanup
2016-10-03 08:23:40 +02:00
Mike Fährmann
d31ccb16f2
rename 'generic' to 'recursive'
2016-10-01 15:54:27 +02:00
Mike Fährmann
12c99293b6
allow extension by Content-Type for exhentai, seiga, senmanga
2016-09-30 16:43:43 +02:00
Mike Fährmann
8d106a447c
[tumblr] delete more useless keywords
2016-09-27 21:49:38 +02:00
Mike Fährmann
051c181138
[dokireader] add chapter extractor
2016-09-26 22:13:23 +02:00
Mike Fährmann
1134339c1f
Merge branch 'category'
2016-09-25 17:52:55 +02:00
Mike Fährmann
56d810c896
update keyword hashes for tests
2016-09-25 17:28:46 +02:00
Mike Fährmann
19c2d4ff6f
remove explicit (sub)category keywords
2016-09-25 14:22:07 +02:00
Mike Fährmann
0a3fb198f3
[batoto] raise exception if chapter is unavailable ( #4 )
2016-09-24 13:26:19 +02:00
Mike Fährmann
3f985d5342
[hitomi] fix some keywords
2016-09-23 08:21:49 +02:00
Mike Fährmann
9d107b8e1b
[dynastyscans] add chapter extractor
2016-09-22 17:20:57 +02:00
Mike Fährmann
975a7cb6b9
[batoto] add (optional) login capabilities
2016-09-21 00:10:22 +02:00
Mike Fährmann
e3d156078c
[exhentai] rewrite
2016-09-20 19:01:16 +02:00
Mike Fährmann
49a05c32ed
add missing tests
2016-09-19 16:15:27 +02:00
Mike Fährmann
a017cd9e63
[exhentai] metadata consistency
2016-09-19 16:13:26 +02:00
Mike Fährmann
fea3be0aed
[nijie] add image-extractor
2016-09-19 08:51:49 +02:00
Mike Fährmann
d324c58038
[rule34] add tag- and image-extractor
2016-09-17 18:12:37 +02:00
Mike Fährmann
85ff3d160e
[tumblr] fix json parsing + metadata consistency
2016-09-16 09:38:14 +02:00
Mike Fährmann
80d98f97fa
[hbrowse] add manga extractor
2016-09-14 09:48:47 +02:00
Mike Fährmann
4cb886be78
[turboimagehost] add tests
2016-09-13 08:01:41 +02:00
Mike Fährmann
26a9b7beee
[imagetwist] small fixes + tests
2016-09-13 08:01:00 +02:00
Mike Fährmann
a9be82ecc2
[imgbox] small fixes + tests
2016-09-13 08:00:08 +02:00
Mike Fährmann
d7e168799d
consistent extractor naming scheme + docstrings
2016-09-12 10:34:31 +02:00
Mike Fährmann
888a988725
[imgchili] workaround for long filenames
2016-09-10 13:12:02 +02:00
Mike Fährmann
155af213a9
[imgtrex] add extractor
2016-09-09 07:37:13 +02:00
Mike Fährmann
dbdd43cff5
[imgcandy] add extractor
2016-09-08 07:56:52 +02:00
Mike Fährmann
44a5052302
[coreimg] add extractor
2016-09-07 09:40:46 +02:00
Mike Fährmann
dcd213f13e
[nijie] raise NotFoundError
2016-09-04 11:01:16 +02:00
Mike Fährmann
8f6d055deb
[pinterest] raise NotFoundError + tests
2016-09-04 11:00:38 +02:00
Mike Fährmann
517e88680f
[pinterest] add board extractor
2016-09-03 10:00:32 +02:00
Mike Fährmann
79721a65ff
[pinterest] add pin extractor
2016-09-02 19:11:16 +02:00
Mike Fährmann
2afa65cfc7
[imagebam] add single-image extractor
2016-09-02 08:25:29 +02:00
Mike Fährmann
808cf69556
update a few tests
2016-09-01 18:28:16 +02:00
Mike Fährmann
49359d375c
[exhentai] unescape title
2016-08-31 10:20:46 +02:00
Mike Fährmann
95097fac00
[exhentai] transition to https
2016-08-30 09:17:40 +02:00
Mike Fährmann
98877a45fb
[seiga] raise NotFoundError
2016-08-29 17:02:53 +02:00
Mike Fährmann
30d10cf595
[pixiv] fix KeyError if no status is present
2016-08-28 16:49:49 +02:00
Mike Fährmann
effa1084f2
[pixiv] raise NotFoundError instead of failing
2016-08-28 16:21:51 +02:00
Mike Fährmann
813320d7db
[seiga] match direct-links to images
2016-08-26 23:32:59 +02:00
Mike Fährmann
85cd7c34b1
[pixiv] match direct-links to images
2016-08-25 20:10:02 +02:00
Mike Fährmann
6d401b1118
precompile regular expressions
2016-08-23 16:36:39 +02:00
Mike Fährmann
fa14ef17ea
[imagefap] deal with long filenames
2016-08-11 15:50:32 +02:00
Mike Fährmann
5a5b47e77a
[imagefap] add user extractor
2016-08-10 12:54:18 +02:00
Mike Fährmann
d9c5b7a102
[imagefap] add single-image extractor
2016-08-10 10:27:32 +02:00