Mike Fährmann
632d5d7745
allow loading config files in TOML format with --config-toml
2023-02-28 21:54:46 +01:00
Mike Fährmann
9e870eb930
rename --ignore-config to --config-ignore
...
--ignore-config still works as before,
but is no longer shown by --help
2023-02-28 21:07:42 +01:00
Mike Fährmann
d66257f2c8
improve option.Formatter performance
...
as always, only a very marginal difference,
but it still uses less resources than before
2023-02-28 20:57:28 +01:00
Mike Fährmann
d788e6c60c
implement 'globals' option
2023-02-28 18:18:55 +01:00
Mike Fährmann
b14f8d5817
[gelbooru] add 'favorite' extractor ( #3704 )
...
requires logged in cookies to work
2023-02-27 18:03:47 +01:00
Mike Fährmann
e480a93337
add 'output.stdout', '.stdin', and '.stderr' options
...
(#1621 , #2152 , #2529 )
Allow setting custom input/output encodings and options
without having to rely on Python's defaults.
2023-02-26 14:56:19 +01:00
Mike Fährmann
a70a3e5da6
[mangasee] extract 'author' and 'genre' metadata ( #3703 )
...
Both are lists/arrays. Use {author!S} or {genre:J, } to format them.
2023-02-26 14:12:19 +01:00
Mike Fährmann
6b03506655
[deviantart] allow searching when not logged in
2023-02-25 19:04:18 +01:00
Mike Fährmann
511a051705
[fanbox] fix crash with missing images ( #3673 )
2023-02-23 23:30:55 +01:00
Mike Fährmann
3fa456d989
[deviantart] remove mature scraps warning ( #3691 )
...
warn about private deviations
when paginating over eclipse results
2023-02-23 22:56:37 +01:00
Mike Fährmann
51301e0c31
replace remaining time.sleep() calls
...
with Extractor.sleep() or request_interval
2023-02-23 00:35:37 +01:00
Mike Fährmann
6ed4309aba
[deviantart] add 'gallery-search' extractor ( #1695 )
2023-02-22 17:25:31 +01:00
Mike Fährmann
3d8777fbc1
move user agent string to util.py
2023-02-22 11:09:17 +01:00
Mike Fährmann
56039d2456
add 'hash_md5' and 'hash_sha1' functions ( #3679 )
...
... to global eval namespace
2023-02-22 10:58:44 +01:00
Mike Fährmann
e1df7f73b1
[deviantart] add 'search' extractor
...
(#538 , #1264 , #2954 , #2970 , #3577 )
Requires login to fetch any results, since the API endpoint raises an
error for not logged in requests.
TODO: parse HTML search results
2023-02-20 20:54:46 +01:00
Mike Fährmann
4f029ab38b
[pornpics] support '/pornstar' and '/channels' listings
...
- fix docstring (#3671 )
- simplify code
2023-02-18 22:38:21 +01:00
Mike Fährmann
cbe4769246
[danbooru] use gallery-dl UA ( #3665 )
...
this removes the ability to set a custom UA via 'user-agent' option
for extractor requests
2023-02-18 22:28:35 +01:00
Mike Fährmann
253ac08203
pre-define and use 'gallery-dö/<version>' UA string
2023-02-18 22:25:54 +01:00
Mike Fährmann
b4899c266f
merge #3656 : [deviantart] fix crash when handling deleted deviations in status updates
2023-02-18 13:11:47 +01:00
Mike Fährmann
bb11c2a576
merge #3662 : [redgifs] add 'collection' extractors
2023-02-18 13:09:17 +01:00
Mike Fährmann
884f1848d6
[redgifs] fix syntax for older Python versions
...
and update docs/supportedsites
2023-02-18 13:07:40 +01:00
Mike Fährmann
725baedad3
[deviantart] use '/collections/all' endpoint for favorites
...
(#3666 ,#3668)
2023-02-17 23:11:35 +01:00
Mike Fährmann
2bd8f2f4bd
[pornpics] add 'search' and 'tag' extractors
...
(#263 , #3544 , #3654 )
2023-02-17 23:03:14 +01:00
Mike Fährmann
79bc82884c
[pornpics] add 'gallery' extractor ( #263 , #3544 , #3654 )
2023-02-17 15:00:57 +01:00
Mike Fährmann
7bdc1d6d3d
[manganelo] update and fix metadata extraction
2023-02-16 22:31:18 +01:00
Mike Fährmann
363bb76dff
[manganelo] simplify URL pattern
2023-02-16 21:36:11 +01:00
enduser420
b28bd9789e
[redgifs] add 'collection' extractors
2023-02-16 20:10:22 +05:30
ClosedPort22
f4e211356d
[deviantart] slight refactor
2023-02-16 21:23:55 +08:00
Mike Fährmann
bd5d08abbc
[catbox] add 'file' extractor ( #3570 )
2023-02-15 19:50:26 +01:00
Mike Fährmann
8e1e8a5bea
[soundgasm] rewrite ( #3578 )
...
use a more standard extractor structure to make -A work as expected
2023-02-15 16:52:07 +01:00
Mike Fährmann
0b93420a81
[pinterest] unescape search terms ( #3621 )
2023-02-15 15:44:20 +01:00
Mike Fährmann
ad96e70546
[bunkr] fix extraction ( #3636 , #3655 )
2023-02-15 15:42:32 +01:00
Mike Fährmann
9335d55bbc
[manganelo] support mobile-only chapters
2023-02-15 00:02:28 +01:00
ClosedPort22
a74114ef7a
[deviantart] fix crash when handling deleted deviations
...
in status updates
2023-02-15 00:17:11 +08:00
Mike Fährmann
75570ad3f1
[oauth] remove stray 'exit()' ( #3628 )
...
- bug from 70ce45d9
2023-02-13 15:58:34 +01:00
Mike Fährmann
d37e7f4898
add 'hooks' option
...
Very much a work in progress.
At the moment, it allows to
- wait and restart an extractor (#3338 )
- change the exit code (#3630 )
- change the log level of a logging message
based on the contents of a logging message
2023-02-13 13:33:42 +01:00
Mike Fährmann
8fb043e8ff
[tumblr] raise more detailed errors for dashboard-only blogs
...
(#3628 )
2023-02-12 19:38:14 +01:00
Mike Fährmann
d4232f3a8b
implement restarting an extractor ( #3338 )
2023-02-11 21:06:14 +01:00
Mike Fährmann
ce996dd21b
[poipiku] warn about incorrect passwords ( #3646 )
2023-02-11 15:10:49 +01:00
Mike Fährmann
70ce45d965
[oauth] use default name for browsers without 'name' attribute
...
(#3645 )
Seem to only be an issue for MacOSXOSAScript before Python 3.11.
d12bec6993
2023-02-11 14:48:59 +01:00
Mike Fährmann
1aae72773f
put argument init on separate lines
2023-02-10 17:05:20 +01:00
Mike Fährmann
2a53e6445c
[bunkr] update domain ( #3636 )
2023-02-09 19:28:32 +01:00
Mike Fährmann
5503ac4d5e
replace json.dumps with direct calls to JSONEncoder.encode
2023-02-09 15:51:40 +01:00
Mike Fährmann
dd884b02ee
replace json.loads with direct calls to JSONDecoder.decode
2023-02-09 15:22:00 +01:00
Mike Fährmann
b7337d810e
[postprocessor:metadata] add 'sort' and 'separators' options
2023-02-07 18:28:14 +01:00
Mike Fährmann
8805bd38ab
merge #3622 : [imagetwist] add phun.imagetwist.com and imagehaha.com support
2023-02-06 14:52:45 +01:00
Mike Fährmann
706ec70e89
[imagetwist] simplify pattern and add tests
2023-02-06 14:51:57 +01:00
Mike Fährmann
f2e91732ae
[instagram] add 'user' metadata field ( #3107 )
...
at the moment only for URLs that need to translate user name to ID
2023-02-06 14:43:35 +01:00
Mike Fährmann
3436c6b117
[postprocessor:metadata] speed up JSON encoding
2023-02-06 12:35:28 +01:00
Prinz23
29f0830b53
[imagetwist] add phun.imagetwist.com and imagehaha.com alias to imagetwist extractor
2023-02-05 21:13:39 +01:00
