gallery-dl

mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-25 04:02:32 +01:00

Author	SHA1	Message	Date
Mike Fährmann	c006f9c949	[docs] add ability to specify more than one 'event' https://github.com/mikf/gallery-dl/issues/146#issuecomment-1969407203	2024-02-29 14:40:18 +01:00
Mike Fährmann	495c9ee126	[bluesky] add 'reposts' option (#4438 , #5248 )	2024-02-27 18:42:29 +01:00
Mike Fährmann	cc6b9e4c18	[zerochan] use API by default (#3669 ) add 'pagination' option	2024-02-25 00:36:14 +01:00
Mike Fährmann	741fd00cec	[deviantart] extend 'metadata' option (#5175 ) alloe fetching extended metadata in addition to the usual 'description', 'tags', etc by setting 'metadata' to a list of 'camera', 'stats', 'submission', 'collection', and 'gallery' for example "metadata": "stats,submission"	2024-02-18 23:14:14 +01:00
Mike Fährmann	91e5c4fdfe	[bluesky] add 'avatar' and 'background' extractors (#4438 )	2024-02-16 15:41:19 +01:00
Mike Fährmann	0abd9723af	[bluesky] add 'metadata' option (#4438 ) allow extracting 'user' metadata and make 'facets' extraction optional	2024-02-15 23:30:16 +01:00
Mike Fährmann	7e036ea290	[bluesky] add 'depth' option (#4438 ) and reduce default depth and parentHeight values	2024-02-15 22:26:05 +01:00
Mike Fährmann	04e4ffc64c	[deviantart] combine 'png' option with 'quality' (#4846 ) "quality": "png" to download PNGs instead og JPEGs	2024-02-14 22:07:29 +01:00
Mike Fährmann	9cc4ec2c58	[deviantart] add 'png' option (#4846 )	2024-02-14 01:03:15 +01:00
Mike Fährmann	c83d0a1596	[weibo] add 'gifs' option (#5183 )	2024-02-10 18:17:07 +01:00
Mike Fährmann	cf7d6be2d4	[bluesky] initial support (#4438 , #4708 , #4722 , #5047 )	2024-02-07 19:09:33 +01:00
Mike Fährmann	34a4ddc399	[sankaku] add 'id-format' option (#5073 )	2024-01-26 17:56:08 +01:00
Mike Fährmann	afd20ef42c	[kemonoparty] implement filtering duplicate revisions (#5013 ) set 'revisions' to '"unique"' to have it ignore duplicate revisions	2024-01-26 14:44:15 +01:00
Mike Fährmann	355b909f46	merge #5041 : [steamgriddb] add support (#5033 )	2024-01-13 00:59:15 +01:00
blankie	8995fd5f01	[steamgriddb] implement suggestions	2024-01-13 09:55:39 +11:00
Mike Fährmann	39904c9e4e	[deviantart:avatar] add 'formats' option (#4995 )	2024-01-10 17:13:34 +01:00
Mike Fährmann	5c43098a1a	[twitter] revert to using 'media' timeline by default (#4953 ) This reverts commit `a94f944148`.	2024-01-09 23:19:39 +01:00
blankie	2ccb7d3bd3	[steamgriddb] add support	2024-01-09 17:12:56 +11:00
Mike Fährmann	7eaf648f2e	[fanbox] add 'metadata' option (#4921 ) extracts 'plan' and extended 'user' metadata	2024-01-04 15:01:33 +01:00
Mike Fährmann	4f3671458e	[deviantart] add 'avatar' and 'background' extractors (#4995 )	2024-01-03 00:07:55 +01:00
Mike Fährmann	27d5fc3697	[docs] document 'tls12' (#4543 ) https://github.com/mikf/gallery-dl/issues/4760#issuecomment-1793345940	2024-01-01 16:12:43 +01:00
Mike Fährmann	fe2147b3ef	[docs] document 'write-pages' (#4543 )	2024-01-01 16:12:28 +01:00
Mike Fährmann	108c978073	merge #4919 : [postmill] add support (#4917 )	2023-12-23 15:23:56 +01:00
blankie	8a42ea736a	[postmill] implement suggestions	2023-12-23 13:28:36 +11:00
Mike Fährmann	fbebc58189	[deviantart] add 'intermediary' option (#4955 )	2023-12-21 02:23:22 +01:00
Mike Fährmann	92ff99c8e5	[twitter] remove 'syndication' option (#3889 )	2023-12-20 14:38:36 +01:00
Mike Fährmann	a94f944148	[twitter] default to 'tweets' timeline when 'replies' are enabled (#4953 )	2023-12-20 01:57:18 +01:00
blankie	fbe14a2745	[postmill] add support	2023-12-12 21:36:52 +11:00
Mike Fährmann	d59d4ebff4	[tumblr] support infinite 'fallback-retries'	2023-12-11 23:40:13 +01:00
Mike Fährmann	75697dfb26	implement -e/--error-file as a logging handler similar to --write-unsupported	2023-12-10 00:06:39 +01:00
Mike Fährmann	9a8dc6b02b	[exhentai] add 'fallback-retries' option (#4792 )	2023-12-09 02:01:59 +01:00
Mike Fährmann	042a9da451	add 'output.errorfile' config option	2023-12-08 17:29:54 +01:00
Mike Fährmann	9dd5cb8c8a	interactively prompt for passwords on login when none is provided	2023-12-06 22:12:59 +01:00
Mike Fährmann	4e15513415	[docs] fix 'Example' -> 'Default' from `b43be672` copy-paste mistake	2023-11-22 22:14:30 +01:00
Mike Fährmann	b43be67206	[exhentai] add 'gp' option (#4576 )	2023-11-22 20:15:00 +01:00
Mike Fährmann	cb9a1176e6	[pixeldrain] add 'api-key' option (#4839 )	2023-11-22 19:13:51 +01:00
Mike Fährmann	aea15f6d17	add 'metadata-extractor' option (#4549 )	2023-11-20 22:16:15 +01:00
Mike Fährmann	34a387b6e2	support 'metadata-' names for '-metadata' options For example, instead of 'url-metadata' it is now also possible to use 'metadata-url' as option name. - metadata-url - metadata-path - metadata-http - metadata-version - metadata-parent	2023-11-18 23:52:10 +01:00
Mike Fährmann	07cb584231	[behance] add 'modules' option (#4799 )	2023-11-17 22:54:38 +01:00
Mike Fährmann	7a0f145cbe	[twitter] ignore promoted Tweets (#4790 , #3894 ) add 'ads' option in case someone actually wants to download promoted content for whatever reason	2023-11-10 23:46:46 +01:00
Mike Fährmann	f4e61fd1d5	reword 'reddit.client-id' instructions (#4749 )	2023-11-04 00:52:18 +01:00
Mike Fährmann	007c433677	[patreon] support 'id:<campaign_id>' in place of a user name https://patreon.com/id:12345 … and remove 'campaign-id' config option	2023-11-04 00:17:41 +01:00
Mike Fährmann	12a800ce21	[patreon] improve 'campaign_id' handling (#4699 , #4715 ) - add ways to directly specify a 'campaign_id' - 'campaign-id' config option - 'c' or 'campaign_id' URL query parameter - more descriptive error messages - show 'campaign_id' value in debug log	2023-10-25 17:18:06 +02:00
Mike Fährmann	0d52b775cb	[kemonoparty] add 'revisions' option (#4498 , #4597 )	2023-10-20 15:20:49 +02:00
Mike Fährmann	2d41702762	[deviantart] implement '"group": "skip"' (#4630 )	2023-10-12 22:14:20 +02:00
Mike Fährmann	992e86ec94	[deviantart] disable 'jwt' (#4652 )	2023-10-12 21:37:10 +02:00
Mike Fährmann	2974b8e3c8	[moebooru] add 'metadata' option (#4646 ) for extended 'pool' metadata	2023-10-12 21:34:25 +02:00
Mike Fährmann	0c5d8b1505	[deviantart] re-add 'quality' option and 'intermediary' transform	2023-09-24 17:36:05 +02:00
Mike Fährmann	20d1683c47	[deviantart] fix JWT replacement (#293 , #4548 , #4563 ) And again, a huge thank you to @Ironchest337 for discovering this.	2023-09-24 15:06:16 +02:00
Mike Fährmann	82296b1f05	[reddit] add 'previews' option (#4322 ) another way to disable this new behavior	2023-09-22 18:10:44 +02:00
Mike Fährmann	9d8317d963	[deviantart] disable JWT updates (#4548 , #4563 ) back to lowres images ...	2023-09-22 17:13:05 +02:00
Mike Fährmann	3ecb512722	send Referer headers by default	2023-09-19 00:02:04 +02:00
Mike Fährmann	6178177227	[twitter] fix '_extractor' of following results (#4536 ) regression from `20ed647f`	2023-09-15 23:04:30 +02:00
Mike Fährmann	f2de70f254	[gfycat] remove module	2023-09-04 18:27:11 +02:00
Mike Fährmann	ceb59e176f	fix default Firefox user agent string note to self: do not trust some random third-party website	2023-09-02 22:22:23 +02:00
Mike Fährmann	5ed245317d	[exhentai] add 'fav' option (#4409 ) The name 'favorite' is already taken as extractor subcategory	2023-08-23 23:58:11 +02:00
Mike Fährmann	410f783a33	implement 'subconfigs' option (#4440 )	2023-08-21 21:18:40 +02:00
Mike Fährmann	c1c73c0b0e	[pp:ugoira] add '"framerate": "uniform"' (#4421 )	2023-08-21 19:43:47 +02:00
Mike Fährmann	70bdf32a88	[pp:ugoira] extend 'ffmpeg-output' (#4421 ) - when setting this option to a string value, pass -hide-banner and -loglevel to FFmpeg - change default to "error"	2023-08-21 18:19:53 +02:00
Mike Fährmann	84089c7368	[docs] add note about 'path-restrict' implementation https://github.com/mikf/gallery-dl/issues/146#issuecomment-1671892152	2023-08-11 18:00:11 +02:00
Mike Fährmann	f9fb276e81	[postprocessor] add 'prepare-after' event (#4083 )	2023-08-10 21:28:48 +02:00
Mike Fährmann	0ef1fcab20	[postprocessor] update 'finalize' events Add 'finalize-error' and 'finalize-success' events that trigger depending on whether error(s) did or did not happen. 'finalize' itself now always triggers regardless of error status. (was supposed to have the same behavior as the new 'finalize-success')	2023-08-10 19:46:37 +02:00
Mike Fährmann	9d67655397	add "ascii+" as a special 'path-restrict' value (#4371 )	2023-08-01 19:33:53 +02:00
Mike Fährmann	1ece3b92ff	[mangadex] allow multiple values for 'lang' (#4093 ) This was already possible by setting 'lang' to a list of strings, but now it can also be done as a more command-line friendly string. -o lang=fr,it	2023-07-26 17:39:27 +02:00
Mike Fährmann	c6d70c7483	[docs] fix typo (#4350 )	2023-07-26 14:24:19 +02:00
Mike Fährmann	7cd5130e88	[docs] small fixes/updates	2023-07-24 14:27:37 +02:00
Mike Fährmann	54d974deb0	add 'python' post processor similar to 'exec' but calls a Python function	2023-07-24 14:06:14 +02:00
Mike Fährmann	ceebacc9e1	remove 'pyopenssl' option	2023-07-19 20:44:07 +02:00
Mike Fährmann	90231f2d5a	[twitter] add 'tweet-endpoint' option (#4307 ) use the newer TweetResultByRestId only for guests by default	2023-07-18 17:19:32 +02:00
Mike Fährmann	20ed647f6f	[twitter] add 'user' extractor and 'include' option (#4275 )	2023-07-18 16:42:55 +02:00
Mike Fährmann	86be197d11	[twitter] remove '/search/adaptive.json'	2023-07-18 15:45:37 +02:00
Mike Fährmann	fc43c74694	[docs] update reddit client-id instructions (#4292 ) add clearing cached access tokens and getting a new refresh token	2023-07-13 20:43:36 +02:00
Mike Fährmann	7444fc125b	[gfycat] implement login support (#3770 , #4271 ) For the record: '/webtoken' and '/weblogin' are not the same ...	2023-07-06 18:56:34 +02:00
Mike Fährmann	5b59a0d143	update default User-Agent header to Firefox 115 ESR	2023-07-05 15:12:50 +02:00
Mike Fährmann	1bf9f52c99	[twitter] add 'ratelimit' option (#4251 )	2023-07-04 18:17:32 +02:00
Mike Fährmann	f86fdf64a6	[twitter] use GraphQL search by default (#4264 )	2023-07-04 17:55:22 +02:00
Mike Fährmann	6ae3101fd0	[mangapark] add 'source' option (#3969 )	2023-07-02 15:07:22 +02:00
Mike Fährmann	c45a913bfd	[flickr] add 'exif' option	2023-07-01 19:19:39 +02:00
Mike Fährmann	ccbc1a1d55	[flickr] add 'metadata' option (#4227 )	2023-06-26 16:49:48 +02:00
Mike Fährmann	c1cce4a80b	[twitter] extend 'conversations' option (#4211 )	2023-06-24 21:34:34 +02:00
Mike Fährmann	f50b81d3e9	[docs] add novel-related keys to 'pixiv.include' (#4111 )	2023-06-19 15:01:53 +02:00
Mike Fährmann	deff3b434d	[vipergirls] implement login support (#4166 )	2023-06-13 21:05:09 +02:00
Mike Fährmann	54cf1fa3e7	[twitter] use GraphQL search endpoint (#3942 ) for guest users; selectable with 'search-endpoint' option. adapted from `9c7b888ffa`	2023-06-01 21:37:31 +02:00
Mike Fährmann	0cf7282fa0	[pixiv] add 'full-series' option for novels (#4111 )	2023-06-01 13:07:20 +02:00
Mike Fährmann	28f6487c64	[instagram] add 'metadata' option (#3107 )	2023-05-27 15:51:13 +02:00
Mike Fährmann	f3cca50b9e	[mangadex] update links to API docs	2023-05-24 12:32:13 +02:00
Mike Fährmann	65a9f4b124	merge #3950 : [misskey] add 'favorite' extractor	2023-05-23 22:18:32 +02:00
Mike Fährmann	c76f0f3a1b	[misskey] update - rename to 'MisskeyFavoriteExtractor' - add 'access-token' option to docs - add test URLs for other instances - simplify 'pattern'	2023-05-23 22:17:17 +02:00
Mike Fährmann	3fca455b82	[pixiv] add 'embeds' option (#1241 )	2023-05-23 12:14:06 +02:00
Mike Fährmann	e6f55d1555	[imagechest] add API support and 'access-token' option (#4065 )	2023-05-20 17:00:27 +02:00
Mike Fährmann	77abcf5ab3	[gofile] automatically fetch 'website-token' by default the hardcoded token changed yet again	2023-05-20 17:00:27 +02:00
Mike Fährmann	a83983c651	[instagram] add 'order-posts' option (#4017 , #3993 )	2023-05-18 22:50:12 +02:00
Mike Fährmann	d680623db3	[instagram] add 'order-files' option (#4017 , #3993 )	2023-05-18 22:34:33 +02:00
Mike Fährmann	5037013e2b	[gofile] update 'website-token' (#4056 )	2023-05-15 14:59:44 +02:00
Mike Fährmann	a14b63d941	support selecting a domain for '--cookies-from-browser' for example 'gallery-dl --cookies-from-browser firefox/twitter.com'	2023-05-06 15:09:49 +02:00
Mike Fährmann	3ca5dac8b6	extend 'cookies-update' functionality Allow writing cookies to a different file than a given cookies.txt, making it possible to export cookies imported with --cookies-from-browser To convert browser cookies to cookies.txt format: gallery-dl --cookies-fr chromium \ -o cookies-update=cookies.txt \ --no-download \ http://example.org/file.jpg	2023-05-04 15:10:47 +02:00
Mike Fährmann	79f47f98dd	[nana] remove module permanently gone since 2023-03-13	2023-05-03 18:05:53 +02:00
Mike Fährmann	c182094ebf	merge #3748 : [downloader:http] add 'consume-content' option	2023-04-26 23:03:18 +02:00
Mike Fährmann	b81ce381f0	fix backticks for 'extractor.redgifs.format' docs https://github.com/mikf/gallery-dl/issues/146#issuecomment-1518331927	2023-04-21 23:12:01 +02:00
Mike Fährmann	aaf58a1259	[imgur] document 'client-id' option (#3937 )	2023-04-21 15:08:50 +02:00
Mike Fährmann	0a7eee3ee0	[deviantart] add 'public' option	2023-04-08 23:04:34 +02:00
Mike Fährmann	75666cf9c3	[danbooru] reduce API requests for fetching extended 'metadata' Instead of using one additional API request per post object (N+1), this requires only one request per 200-post batch.	2023-04-02 20:11:52 +02:00
Mike Fährmann	00f0233b28	[postprocessor:metadata] add 'skip' option (#3786 )	2023-03-17 23:30:11 +01:00
Mike Fährmann	a1ca2404f9	add 'globals' instead of overwriting the default (#3773 )	2023-03-16 18:37:00 +01:00
ClosedPort22	fcaeaf539c	[downloader:http] handle exceptions while consuming content	2023-03-11 21:36:37 +08:00
ClosedPort22	df77271438	[downloader:http] add 'consume-content' option * fix connection not being released when the response is neither successful nor retried * add the ability to consume the HTTP response body instead of closing the connection reference: https://docs.python-requests.org/en/latest/user/advanced/#body-content-workflow	2023-03-09 21:07:10 +08:00
Mike Fährmann	da9840a39d	[reddit] update 'videos' option (#3712 ) - add 'dash' to directly extract DASH manifest URLs (was default behavior since `a7c79531`) - change default strategy back to before `a7c79531` - disable 'Falling back on generic information extractor' warning	2023-03-06 12:18:25 +01:00
enduser420	e1867cf5eb	[misskey] add 'renotes' and 'replies' options	2023-03-02 19:56:19 +05:30
Mike Fährmann	0d142e403c	[szurubooru] add 'tag' and 'post' extractors (#3583 , #3713 )	2023-03-01 18:47:10 +01:00
Mike Fährmann	d788e6c60c	implement 'globals' option	2023-02-28 18:18:55 +01:00
Mike Fährmann	e480a93337	add 'output.stdout', '.stdin', and '.stderr' options (#1621, #2152, #2529) Allow setting custom input/output encodings and options without having to rely on Python's defaults.	2023-02-26 14:56:19 +01:00
Mike Fährmann	b7337d810e	[postprocessor:metadata] add 'sort' and 'separators' options	2023-02-07 18:28:14 +01:00
Mike Fährmann	762a68996b	implement 'archive-pragma' option	2023-02-05 17:00:31 +01:00
Mike Fährmann	bbf0911a46	[e621] implement 'notes' and 'pools' metadata extraction (#3425)	2023-02-04 21:20:38 +01:00
Mike Fährmann	925b467496	split e621 from danbooru module (#3425 )	2023-02-03 19:24:31 +01:00
Mike Fährmann	1ae48a54f8	[twitter] add 'transform' option	2023-02-02 22:01:36 +01:00
Mike Fährmann	78d3960a31	[postprocessor:exec] implement archive options (#3584 )	2023-02-01 13:57:16 +01:00
Mike Fährmann	4572c122d8	document 'extractor.module-sources'	2023-01-30 23:32:36 +01:00
Mike Fährmann	f58215705a	add '-O/--postprocessor-option' command-line option (#3565 )	2023-01-26 14:59:24 +01:00
ClosedPort22	3b32671fbd	[deviantart] add extractor for status updates extract user status updates using the '/user/statuses/' endpoint	2023-01-19 11:30:48 +08:00
Mike Fährmann	4e86aaa4db	document 'extractor.headers' and 'extractor.ciphers'	2023-01-16 14:49:56 +01:00
Mike Fährmann	c881548a27	add 'extractor.retry-codes' option (#3313 ) do not retry 429 and 430 by default	2023-01-14 17:25:30 +01:00
Mike Fährmann	512abeb4ae	[booru] add 'url' option	2023-01-13 16:32:32 +01:00
Mike Fährmann	c87bd1a752	[danbooru] extend 'metadata' option make it possible to specify a custom list of metadata includes	2023-01-13 16:20:01 +01:00
Mike Fährmann	c0d7d2be35	[downloader:http] add 'validate' option	2023-01-11 15:37:40 +01:00
Mike Fährmann	cb9d100bac	update Authentication support in docs https://github.com/mikf/gallery-dl/pull/3075#issuecomment-1374723412	2023-01-08 16:57:31 +01:00
Mike Fährmann	362cd6991b	[pixiv] implement 'metadata-bookmark' option (#3417 )	2023-01-07 23:19:43 +01:00
Mike Fährmann	0895e6afee	merge #3462 : [docs] Update links and fix field typo	2023-01-07 15:22:03 +01:00
Mike Fährmann	4b9bb632f2	[docs] update links	2023-01-07 15:21:40 +01:00
Mike Fährmann	ac78712618	merge #3496 : [docs] update OAuth guide in README.rst	2023-01-06 13:36:23 +01:00
Mike Fährmann	2f31d21509	merge #3455 : [twitter] apply tweet type checks before uniqueness check	2023-01-06 13:32:50 +01:00
Mike Fährmann	64435cc37e	[twitter] update docs	2023-01-06 13:32:08 +01:00
Mike Fährmann	b125fcafc5	update docs/configuration.rst - document metadata.indent - add concrete mappings to object types - fix lists for code examples - fix typos	2023-01-06 13:07:33 +01:00
ClosedPort22	c94692f39b	[docs] document 'access-token' for Mastodon instances	2023-01-06 13:20:41 +08:00
Mike Fährmann	4fd6da474f	merge #3473 : [twitter] fix crash when using 'expand' and 'syndication'	2023-01-05 14:19:47 +01:00
Mike Fährmann	818f6fa71f	merge #3453 : [twitter] document #1396 and #2712	2023-01-05 14:18:21 +01:00
ClosedPort22	455481ad76	[twitter] improve documentation This includes: - The automatic expansion of conversations (#2712) - How to retrieve age-restricted content from search results (#1396)	2023-01-05 12:14:42 +08:00
Mike Fährmann	6933727b45	merge #3483 : [twitter] implement 'syndication=extended'	2023-01-04 17:36:17 +01:00
Mike Fährmann	9116398c1c	[pinterest] add 'domain' option (#3484 ) use input URL domain by default	2023-01-04 17:20:14 +01:00
ClosedPort22	6853b14be3	[twitter] apply suggestions from code review Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>	2023-01-02 21:03:01 +08:00
Mike Fährmann	4611237f8c	merge #3457 : [danbooru] extract uploader metadata (if option is set)	2023-01-01 21:20:39 +01:00
Mike Fährmann	0ed5986062	document custom 'output.mode' (#2529 )	2022-12-30 17:14:42 +01:00
ClosedPort22	7c8eab8d52	[twitter] implement 'syndication=extended' to be able to fetch extended user metadata	2022-12-30 20:48:41 +08:00
ClosedPort22	be3286206a	[twitter] assume 'conversation_id' when using syndication not possible to expand replies at the momemt	2022-12-30 13:57:37 +08:00
ClosedPort22	ce8dbb1ccc	[twitter] fix crash when using 'expand' and 'syndication' caused by KeyError: 'conversation_id_str'	2022-12-30 12:45:44 +08:00
Mike Fährmann	d651d45239	implement specifying ranges in slice notation (#918 , #2865 ) e.g. - '1:101' or ':101' or ':101:' for files 1 to 100 - '1::2' or '::2' for every second file - '1:101:5' or ':101:5' for files 1, 6, 11, ..., 91, 96 (the second argument specifies the first index NOT included)	2022-12-27 18:21:12 +01:00
pi_allen	64902f518e	[docs] Update links and fix field typo	2022-12-26 07:46:41 +01:00
ClosedPort22	5d5ea58887	[twitter] update docs for 'quoted' & 'unique'	2022-12-25 15:59:26 +08:00
blankie	f82ee93676	[danbooru] extract uploader metadata (if metadata is set)	2022-12-25 11:00:59 +07:00
Mike Fährmann	1800bd7d14	allow '*-filter' options to be a list of expressions	2022-12-23 22:20:21 +01:00

1 2 3 4 5 ...

701 Commits