350 Commits

Author	SHA1	Message	Date
Mike Fährmann	322c2e7ed4	renaming variables ... mostly 'keyword(s)' to 'kwdict'	2019-10-29 15:46:35 +01:00
Mike Fährmann	87a87bff7e	[simplyhentai] fix image URLs	2019-10-28 21:11:06 +01:00
Mike Fährmann	d5e3910270	adjust 'util.raises()'	2019-10-28 15:06:17 +01:00
Mike Fährmann	b23c822b23	[luscious] use GraphQL	2019-10-22 21:17:08 +02:00
Mike Fährmann	1693d97bd3	update extractor class hierarchies ... - let the GalleryExtractor class inherit directly from Extractor - make ChapterExtractor a subclass of GalleryExtractor - change enumeration field names of GalleryExtractors to 'num'	2019-10-16 18:15:29 +02:00
Mike Fährmann	7ebd984e8d	[imgur] print error message if no JSON data is found (#446)	2019-10-16 17:45:14 +02:00
Mike Fährmann	de4e2029d1	[nsfwalbum] update test album ... the old one is no longer available	2019-09-28 20:48:15 +02:00
Mike Fährmann	913460240d	[reddit] fix 'extractor.blacklist()' arguments ... The second argument must support 'append()'.	2019-09-24 23:01:12 +02:00
Mike Fährmann	1848788970	update test results etc	2019-09-08 11:33:35 +02:00
Mike Fährmann	d5fbb2d9de	[tumblr] ignore audio links from Spotify etc.	2019-09-07 18:18:12 +02:00
Mike Fährmann	c6c5cb1898	improve 'deviantart.quality' description	2019-08-30 18:41:18 +02:00
Mike Fährmann	c9b97dbca3	extend post processor tests	2019-08-26 23:10:12 +02:00
Mike Fährmann	49f6d7176d	[deviantart] restore filenames (#392) ... <title>_by_<user>_<id> --> <title>_by_<user>-<id>	2019-08-23 22:02:03 +02:00
Mike Fährmann	e528f3cb77	adjust postprocessor test results ... see 2495b99	2019-08-21 23:54:08 +02:00
Mike Fährmann	cb7f149974	fix mtime datetime test ... datetime.timestamp() uses local time for a naive datetime object	2019-08-14 21:57:42 +02:00
Mike Fährmann	23251356cb	require 'extension' data for each URL (#382)	2019-08-14 20:03:03 +02:00
Mike Fährmann	dd72ae7164	add postprocessor tests	2019-08-12 21:46:30 +02:00
Mike Fährmann	0bb873757a	update PathFormat class ... - change 'has_extension' from a simple flag/bool to a field that contains the original filename extension - rename 'keywords' to 'kwdict' and some other stuff as well - inline 'adjust_path()' - put enumeration index before filename extension (#306)	2019-08-12 21:40:37 +02:00
Mike Fährmann	748e37554c	update .travis.yml ... - install pyOpenSSL before running tests - simplify snap tests	2019-08-11 16:03:19 +02:00
Mike Fährmann	b7fb93e2b2	[downloader:http] add 'adjust-extensions' option	2019-08-08 16:54:20 +02:00
Mike Fährmann	eb7da159e2	[imagebam] update URL test results ... Image URLs are now using https://, but the website itself is still served as http://.	2019-08-07 21:47:44 +02:00
Mike Fährmann	fa60109e97	[exhentai] don't use e-hentai.org for exhentai URLs	2019-08-02 21:10:09 +02:00
Mike Fährmann	4a0c98bfc9	miscellaneous fixes and adjustments	2019-08-01 22:09:43 +02:00
Mike Fährmann	40637556fa	[ngomik] fix extraction	2019-07-28 10:53:46 +02:00
Mike Fährmann	d9d44ad953	[tsumino] update test results	2019-07-24 21:17:23 +02:00
Mike Fährmann	b1bea8aaeb	add 'restrict-filenames' option (#348)	2019-07-23 17:41:24 +02:00
Mike Fährmann	b3851e01d9	release version 1.9.0	2019-07-19 21:55:25 +02:00
Mike Fährmann	12da6bd0c9	[simplyhentai] fix/improve extraction	2019-07-06 20:25:53 +02:00
Mike Fährmann	b89f0d8d3c	update extractor result tests	2019-07-01 20:02:47 +02:00
Mike Fährmann	40da44b17f	Merge branch 'v1.9.0'	2019-06-29 15:39:52 +02:00
Mike Fährmann	7a99e85943	[kissmanga] fix download URLs and file extensions ... The current Blogspot image URLs hosted on Kissmanga end with an "invalid" query parameter (/000.png&upx=...), which doesn't get recognized by 'spliturl()' and 'parseurl()' as such and gets therefore included in the 'extension' field from 'text.nameext_from_url()'.	2019-06-28 20:34:43 +02:00
Mike Fährmann	a9c89085fb	[instagram] implement login support (#195)	2019-06-26 23:58:47 +02:00
Mike Fährmann	b1985d6579	test default format strings during extractor result tests ... A missing value or an invalid "syntax" for a format replacement field will raise an exception.	2019-06-25 18:12:32 +02:00
Mike Fährmann	95b1e4c3c0	implement R<old>/<new>/ format option (#318)	2019-06-23 22:45:44 +02:00
Mike Fährmann	70713f0f28	fix extractor result tests	2019-06-20 18:12:36 +02:00
Mike Fährmann	ee4d7c3d89	update downloader.find() and related code ... Instead of replacing 'https' with 'http' for every URL in 'get_downloader()', this now only happens once during downloader initialization. Also unit tests.	2019-06-20 16:59:44 +02:00
Mike Fährmann	179d112083	[downloader] overhaul http and text modules ... Get rid of the modular structure and simplify/specialize those modules.	2019-06-19 22:56:11 +02:00
Mike Fährmann	a77340c647	[keenspot] fix extraction for "TwoKinds"	2019-06-17 19:49:39 +02:00
Mike Fährmann	b171befa87	implement 'parse_unicode_escapes()'	2019-06-16 21:47:24 +02:00
Mike Fährmann	e05a96db5e	[deviantart] rename 'stash' to 'extra' (#302) ... 'stash' is already used as a name for the StashExtractor and therefore expected to be a dictionary.	2019-06-10 21:05:25 +02:00
Mike Fährmann	7c6cb908f9	[xhamster] update test results	2019-06-07 16:28:49 +02:00
Mike Fährmann	62335b9015	[paheal] adjust test results	2019-06-05 11:42:01 +02:00
Mike Fährmann	6a34f4b0c1	skip tests on read timeouts; print list of skipped tests	2019-06-01 20:47:31 +02:00
Mike Fährmann	d33f5a7423	[wallhaven] rewrite ... - use API - remove login support, add 'api-key' option - remove support for "alpha" subdomain - alpha.wallhaven.cc used numeric IDs that can't be translated to the new ID system - support direct links to wallpapers	2019-05-31 14:53:02 +02:00
Mike Fährmann	5499934ae2	[ngomik] fix extraction	2019-05-30 20:18:36 +02:00
Mike Fährmann	2b1999476e	implement 'text.rextract()'	2019-05-28 21:03:41 +02:00
Mike Fährmann	e30ada162d	fix cookie tests ... update _get_extractor(): - always return an Extractor instance with a _login_impl() method - use Extractor.from_url()	2019-05-26 20:22:04 +02:00
Mike Fährmann	2316e0ed3d	fix strptime workaround from b0e85a4 ... Don't return a modified version of 'date_time' if strptime fails.	2019-05-25 23:22:26 +02:00
Mike Fährmann	6764847349	fix cookie tests ... 'cookies' is a CookieJar, not a dict, and removing the call to '.keys()' doesn't have the same effect	2019-05-14 22:32:40 +02:00
Mike Fährmann	a5b060765d	improve code in tests ... - use 'assertRaises' as context manager - remove calls to .keys()	2019-05-13 11:48:20 +02:00