2054 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Mike Fährmann	1faec285d1	[nijie] further improvements (closes #423) ... - provide a 'user_name' metadata field - usually the same as 'artist_id', except for favorite downloads - extract the whole description text and properly escape HTML entities - fixed an issue with titles or tags containing double quotes	2019-09-27 23:14:32 +02:00
Mike Fährmann	6d0a533d68	[reddit] respect 'comments:0' for single submissions (#429)	2019-09-27 23:11:28 +02:00
Mike Fährmann	803d8f814e	[oauth] update scope for reddit tokens (#428) ... '/user/<username>/...' requires the 'history' scope to be accessible (https://www.reddit.com/dev/api/#GET_user_{username}_{where})	2019-09-27 17:38:55 +02:00
Mike Fährmann	46ba173ded	[reddit] fix documentation inconsistencies (closes #429) ... - Require 'reddit.comments' to be a number and convert it to an integer to be extra sure - Link to the README's OAuth section were appropriate	2019-09-27 17:34:10 +02:00
Mike Fährmann	20eb6c401f	[nijie] improvements and fixes (#423) ... - ignore unavailable image pages - more metadata fields: artist_name, date, tags - rename 'index' to 'num' - improved code structure	2019-09-26 21:45:01 +02:00
Mike Fährmann	d1ea08c67d	[weibo] fixes and improvements ... - ignore unavailable videos (fixes #427) - handle empty 'geo' fields - consistent metadata fields for images and videos	2019-09-26 14:57:35 +02:00
Mike Fährmann	38d97f3da6	[deviantart] add debug message about API credentials (#424)	2019-09-25 21:20:55 +02:00
Mike Fährmann	80c2104fb5	[deviantart] fix 429 handling if 'fatal' is False (closes #424)	2019-09-25 21:16:35 +02:00
Mike Fährmann	913460240d	[reddit] fix 'extractor.blacklist()' arguments ... The second argument must support 'append()'.	2019-09-24 23:01:12 +02:00
Mike Fährmann	22bac14452	[pixiv] match '/artworks/' URLs	2019-09-24 21:53:14 +02:00
Mike Fährmann	66cac207ac	[twitter] match and use 'i/web' status URLs	2019-09-24 21:18:05 +02:00
Mike Fährmann	5a1a0f5325	change text representation of user extractors to "User Profiles"	2019-09-22 22:21:48 +02:00
Mike Fährmann	946f2751e2	[reddit] add 'user' extractor (closes #350)	2019-09-22 22:18:17 +02:00
Mike Fährmann	c14abb9fb8	[reddit] improve URL parameter handling for subreddit links	2019-09-22 22:03:22 +02:00
Mike Fährmann	ee8b654464	[instagram] implement 'highlights' option (closes #329)	2019-09-21 23:38:20 +02:00
Mike Fährmann	f63c3097a9	[instagram] rework some code paths ... - combine fetching an HTML page and extracting its 'shared_data' - move 'shared_data' and field access info out of '_extract_page()' - introduce a '_request_graphql()' method	2019-09-21 23:10:41 +02:00
Mike Fährmann	4330133114	[imgur] add 'favorite' extractor (closes #420) ... … and use a newer site-internal API endpoint for user posts	2019-09-19 15:54:26 +02:00
Mike Fährmann	ee5e20221f	[imgth] fix image URLs	2019-09-19 14:56:48 +02:00
Mike Fährmann	b63b126808	[hentaicafe] extend URL pattern	2019-09-18 19:08:45 +02:00
Mike Fährmann	d780f0357e	[imgur] add user extractor	2019-09-17 22:58:18 +02:00
Mike Fährmann	11ea689013	[simplyhentai] fix image and video URLs	2019-09-16 21:37:16 +02:00
Mike Fährmann	15632a1570	[tsumino] fix extraction	2019-09-15 22:09:59 +02:00
Mike Fährmann	d92802fd37	[luscious] fix detection of unavailable galleries	2019-09-15 21:16:25 +02:00
Mike Fährmann	f99da2b866	[imgbb] detect invalid album and user profile links ... and update test results, since the old album got deleted	2019-09-14 23:22:08 +02:00
Mike Fährmann	01bc7adadc	[deviantart] improve journal detection (#419) ... Some journal-like posts are not reported to be journals (isJournal is set to False), even though they have a textContent field. https://www.deviantart.com/gliitchlord/art/brashstrokes-812942668	2019-09-14 22:45:22 +02:00
Mike Fährmann	776e9e073f	close archive on job completion (#417)	2019-09-10 22:43:51 +02:00
Mike Fährmann	5ac9732adc	call 'sys.exit()' on Ctrl+c	2019-09-10 16:53:21 +02:00
Mike Fährmann	9178b54eae	handle errors when opening download archive file (#417)	2019-09-10 16:44:47 +02:00
Mike Fährmann	6e12907de6	[deviantart] improve handling of private deviations (#414) ... - don't try to call '/deviation/metadata' with an empty list of deviation ids - print a warning when detecting private deviations without having a 'refresh-token'	2019-09-10 16:09:03 +02:00
Mike Fährmann	4203931d79	release version 1.10.4	2019-09-08 13:54:45 +02:00
Mike Fährmann	e7690ac694	[vsco] update URL pattern (closes #410)	2019-09-08 11:37:27 +02:00
Mike Fährmann	1848788970	update test results etc	2019-09-08 11:33:35 +02:00
Mike Fährmann	d5fbb2d9de	[tumblr] ignore audio links from Spotify etc.	2019-09-07 18:18:12 +02:00
Mike Fährmann	b1cddce865	Revert "[simplyhentai] fix extraction; remove image+video extractors" ... This reverts commit d1db5180ab.	2019-09-07 14:48:31 +02:00
Mike Fährmann	d23660c04d	[hentaicafe] restore default 'request()' behavior	2019-09-07 14:35:00 +02:00
Mike Fährmann	9ae58a6b3e	[exhentai] update image limit checks ... - adjust cost of original images - delay limit initialization until gallery and first image page have been requested and all cookies are available	2019-09-07 13:29:01 +02:00
Mike Fährmann	6fe9a134bf	[lineblog] add blog and post extractors (closes #404)	2019-09-06 22:16:42 +02:00
Mike Fährmann	4e8a548a61	[livedoor] update metadata extraction	2019-09-06 21:44:25 +02:00
Mike Fährmann	f9285f99e6	[pixiv] fix authentication	2019-09-02 22:38:56 +02:00
Mike Fährmann	6f3df3999a	[fuskator] add gallery and search extractor (closes #407)	2019-09-02 21:20:02 +02:00
Mike Fährmann	bc0ca66c99	[twitter] small improvements ... - handle reply tweets (#403) - unset cookies in Tweet extractor to "force" the legacy interface	2019-09-01 17:37:48 +02:00
Mike Fährmann	682105b8ee	prevent crash when loading unavailable downloader (#405)	2019-08-31 21:58:33 +02:00
Mike Fährmann	5fcebb69c2	[postprocessor:ugoira] improve error messages (#406)	2019-08-31 21:55:42 +02:00
Mike Fährmann	f02a768b5c	[danbooru] add 'ugoira' option (#406) ... to choose between ZIP archives or converted video files for Ugoira posts	2019-08-31 21:51:52 +02:00
Mike Fährmann	9646ccb320	release version 1.10.3	2019-08-30 19:41:16 +02:00
Mike Fährmann	dedea3b4db	[deviantart] fix journal creation (#400)	2019-08-30 18:50:04 +02:00
Mike Fährmann	c6c5cb1898	improve 'deviantart.quality' description	2019-08-30 18:41:18 +02:00
Mike Fährmann	8eaae58045	[downloader:http] change log message level to 'debug'	2019-08-29 23:05:47 +02:00
Mike Fährmann	efb64ad031	[deviantart] generate filenames (#392, #400)	2019-08-29 10:09:21 +02:00
Mike Fährmann	0ce98169b8	improve path generation ... - fix 'abspath()' results for Python <3.7 (closes #402) - 'abspath()' in Python 3.7+ removes trailing path separators - in Python <3.7 it doesn't - filter empty path segments	2019-08-28 23:25:18 +02:00