442 Commits

Author	SHA1	Message	Date
Mike Fährmann	5bcf28de93	add a 'extractor.modules' option	2020-10-25 03:05:10 +01:00
Mike Fährmann	18213dc5ba	release version 1.15.2	2020-10-24 18:57:29 +02:00
Mike Fährmann	1686dc1757	[twitter] support media from Cards (#1005, #937) ... Can be enabled with 'extractor.twitter.cards', but for now disabled by default because cards can redirect to rather large videos from YouTube or Twitch.	2020-10-22 21:33:53 +02:00
Mike Fährmann	bac8af69e8	update configuration.rst ... - add some lines to better explain post processor usage - syntax highlighting for JSON blocks and other smaller stuff	2020-10-19 21:57:26 +02:00
Mike Fährmann	05d7009cc6	rename 'Authentication' entries in supportedsites.rst ... - change 'Optional' to 'Supported' - use 'OAuth' and 'Cookies' in their own - add link to weasyl API key option	2020-10-19 20:16:17 +02:00
Mike Fährmann	d1c6d78477	fix rST markup in configuration.rst	2020-10-15 15:17:19 +02:00
Mike Fährmann	b8daabc3ca	[pinterest] implement login support (closes #1055) ... being logged allows access to secret/protected boards	2020-10-15 15:14:18 +02:00
Zanny	3ec60e894a	[weasyl] api-key authentication (#1057) ... * [weasyl] support api keys * [weasyl] document api-key authentication * [weasyl] usernames can contain ~	2020-10-15 15:12:09 +02:00
Mike Fährmann	35056a07d1	release version 1.15.1	2020-10-11 18:44:46 +02:00
Mike Fährmann	dd1e545597	[hentaifoundry] rename GalleryExtractor to PicturesExtractor	2020-10-04 22:53:23 +02:00
Mike Fährmann	c874071f5a	[kissmanga] remove module	2020-10-04 22:46:41 +02:00
Mike Fährmann	430b6d6e2e	[twitter] extend 'retweets' option (closes #1026) ... Setting 'retweets' to '"original"' will use metadata from the original retweeted Tweets, and not from the Retweet entry.	2020-09-28 23:03:35 +02:00
Mike Fährmann	b9bdd2c564	[hentaifoundry] add support for stories (closes #734)	2020-09-27 02:27:40 +02:00
Mike Fährmann	117582d798	use definition lists instead of tables in docs/configuration.rst ... and strip some clutter from generated man pages	2020-09-26 13:33:46 +02:00
Mike Fährmann	cc4ac80302	[weasyl] add 'favorite' extractor (#1032)	2020-09-26 13:09:03 +02:00
Mike Fährmann	e9cc719497	[weasyl] update and simplify ... - simplify 'pattern' regexps - parse 'posted_at' as 'date' - use unaltered 'title' ({title!l:R /_/} to lowercase and replace spaces)	2020-09-26 02:10:45 +02:00
Mike Fährmann	6514312126	[nijie] add 'include' option (closes #1018)	2020-09-25 18:18:35 +02:00
Mike Fährmann	0d43456323	[hentaifoundry] add 'include' option	2020-09-25 18:18:03 +02:00
Zanny	ebb7737b9b	Weasyl Extractor (#977) ... * weasyl extractor * @kattjevfel suggested changes * @mikf changes	2020-09-25 15:18:21 +02:00
Mike Fährmann	1e313d5b84	implement 'sleep-request' option	2020-09-20 20:28:17 +02:00
Mike Fährmann	c43b3894be	[myhentaigallery] update and fix extraction (#1001) ... - extract more metadata - match "/show/" URLs - complete test results - fix missing images for lines starting with " <img" - fix missing comma in supportedsites.py	2020-09-17 18:14:23 +02:00
Mike Fährmann	6a5f6396d4	add clearing cache to dA client-id instructions (#996)	2020-09-16 01:24:18 +02:00
Mike Fährmann	3afd362e2e	add 'sleep-extractor' option (closes #964) ... (would have been nice if this were possible without code duplication)	2020-09-12 21:04:47 +02:00
Mike Fährmann	3108e85b89	[worldthree] remove extractors ... http://www.slide.world-three.org/ hasn't been accessible for a long time.	2020-09-11 18:12:57 +02:00
Mike Fährmann	8fed3eb8cb	[jaiminisbox] remove extractors ... https://jaiminisbox.com/post.html	2020-09-11 18:09:35 +02:00
Mike Fährmann	3918b69677	remove 'extractor.blacklist' context manager	2020-09-11 13:17:35 +02:00
Mike Fährmann	c78aa17506	add general 'blacklist' and 'whitelist' options (#492, #844)	2020-09-11 13:17:12 +02:00
Mike Fährmann	5912727b88	support format string replacement fields in archive paths ... (closes #985)	2020-09-10 22:09:30 +02:00
Mike Fährmann	f6fd449b59	reduce wait time growth rate from exponential to linear ... Waiting for 2**N seconds after each error grows too fast. Simply waiting N seconds seems far more reasonable.	2020-09-06 22:38:25 +02:00
Mike Fährmann	ac3036ef56	add 'filesize-min' and 'filesize-max' options (closes #780)	2020-09-03 18:21:04 +02:00
Mike Fährmann	e33293fdd8	[hentaihand] update to new site layout	2020-08-30 00:41:03 +02:00
Mike Fährmann	ab1af66a97	[imgur] add 'search' extractor (#934)	2020-08-27 22:46:17 +02:00
ArtaxIsSleeping	0e941553ec	[aryion] Add username/password support (#960) ... * Add username/password support to aryion extractor * Update docs to match * Fix code style	2020-08-27 22:45:30 +02:00
Mike Fährmann	063c71cd84	[furaffinity] add 'search' extractor (closes #915)	2020-08-18 21:26:46 +02:00
Mike Fährmann	dbbbb21180	[exhentai] add ability to specify custom image limit (#940)	2020-08-17 22:29:20 +02:00
Mike Fährmann	2b88c90f6f	[blogger] add search extractor (#925)	2020-08-06 19:43:39 +02:00
Mike Fährmann	901a897e6f	[inkbunny] mention login support	2020-07-26 23:52:52 +02:00
Mike Fährmann	b921fee24d	[inkbunny] fix submission order (#283) ... Getting detailed submission info via /api_submissions.php reordered the input submissions and sorted them by ID. InkbunnyAPI.detail() now sorts them back and ensures they are returned in their original order. This commit also removes the 'metadata' option and always requests submission descriptions.	2020-07-26 23:12:45 +02:00
Mike Fährmann	c4ed9f4faa	[inkbunny] add 'metadata' option (#283)	2020-07-24 18:05:53 +02:00
Mike Fährmann	493cadb1e7	[inkbunny] add 'orderby' option (#283)	2020-07-24 17:50:32 +02:00
Mike Fährmann	8dbf827649	[bobx] remove module	2020-07-24 17:00:43 +02:00
Mike Fährmann	87202b8d74	[inkbunny] add 'user' and 'post' extractors (#283)	2020-07-22 22:21:30 +02:00
Mike Fährmann	b62ea72533	release version 1.14.3	2020-07-18 18:34:36 +02:00
Mike Fährmann	d5fcffcced	[subscribestar] add login capabilities (#852)	2020-07-17 22:18:01 +02:00
Mike Fährmann	ecaecc4064	[exhentai] add 'domain' option (#897)	2020-07-17 22:17:46 +02:00
Mike Fährmann	df7217c36d	update supportedsites.py (#889, #893) ... - mention optional auth access for more sites - link to OAuth and Cookies sections in README	2020-07-16 15:00:31 +02:00
HRXN	51b49a361d	mention optional auth access for furaffinity (#893)	2020-07-14 15:12:26 +02:00
jakem72360	7dfdcc3fbf	[mangakakalot] Added extractors for MangaKakalot (#876)	2020-07-13 21:20:09 +02:00
Mike Fährmann	cb0132e441	[khinsider] add 'format' option (closes #840)	2020-07-13 17:17:58 +02:00
Mike Fährmann	c28db7a6ea	[8muses] support 'comics.8muses.com' URLs	2020-07-05 19:43:45 +02:00