Mike Fährmann
1cbc234819
[mangafox] extract more metadata ( #3167 )
2022-12-14 19:56:59 +01:00
Mike Fährmann
3082544fff
misc fixes
...
- fix typo (#3399 )
- remove double assignment
- [bunkr] update things I forgot in 6b6f886d
- [soundgasm] adjust 'archive_fmt' (#3388 )
2022-12-14 13:30:27 +01:00
enduser420
41bf236d36
[lynxchan] add generic extractors for lynxchan imageboards ( #3394 )
...
* [lynxchan] add generic extractors for lynxchan imageboards
includes kohlchan.net, endchan.org:wq
* [lynxchan] set pop default to empty tuple
* Apply suggestions from code review
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2022-12-12 13:13:39 +01:00
Mike Fährmann
3c75c3bbc4
[soundgasm] add 'user' extractor ( #3384 )
...
based on code from PR #3388 by @enduser420
2022-12-12 12:23:59 +01:00
Mike Fährmann
2952add4a8
[reddit] increase 'id-max' default value ( #3397 )
...
to float("inf")
2022-12-12 12:10:06 +01:00
Mike Fährmann
a001c9c06f
[instagram] prevent post 'date' overwriting file 'date' ( #3392 )
2022-12-12 11:38:48 +01:00
Mike Fährmann
6b6f886dcf
[bunkr] update domain ( #3391 )
...
and improve bunkr/app.bunkr handling
2022-12-11 23:18:01 +01:00
ClosedPort22
bf3fd5951a
Merge branch 'master' into da-extra-stash
2022-12-10 21:34:37 +08:00
Mike Fährmann
eb94568e1f
[soundgasm] add 'audio' extractor ( #3384 )
2022-12-09 23:19:07 +01:00
Mike Fährmann
dfe7b23579
support Firefox containers for --cookies-from-browser ( #3346 )
2022-12-09 19:43:55 +01:00
Mike Fährmann
cd931e1139
update extractor test results
2022-12-08 18:58:29 +01:00
Mike Fährmann
989ec9fc79
[khinsider] fix metadata extraction
2022-12-07 21:36:34 +01:00
Mike Fährmann
1c25cc7a3e
[warosu] fix and update
2022-12-07 21:23:45 +01:00
Mike Fährmann
79e52f3539
[imgth] rewrite
...
- inherit from GalleryExtractor
- fix image URLs
- better metadata
2022-12-07 21:19:06 +01:00
Mike Fährmann
202c1210d5
[exhentai] fix pagination
2022-12-06 22:39:13 +01:00
Mike Fährmann
ca4742200b
use util.NONE as 'keyword-default' default value
2022-12-06 22:27:57 +01:00
Mike Fährmann
43c211f1a7
extend and rename util.CustomNone
2022-12-06 22:08:51 +01:00
Mike Fährmann
6afb3cc766
restore paths for archived files ( #3362 )
2022-12-06 22:01:37 +01:00
Mike Fährmann
4a3a1f4c87
[komikcast] update domain and fix extraction
2022-12-06 22:00:23 +01:00
ClosedPort22
13d825731e
[deviantart] fix test for sta.sh URL extraction
...
Without the 'count' assertion, the test would be essentially useless.
2022-12-07 00:32:03 +08:00
ClosedPort22
6356c9be96
[deviantart] extract sta.sh URLs from 'text_content'
2022-12-06 22:57:53 +08:00
Mike Fährmann
5f57a27ba6
[imagetwist] fix extraction
2022-12-05 22:15:59 +01:00
Mike Fährmann
a42ba25ca1
[foolslide] remove 'kireicake'
...
site redirects to (unclaimed) mangadex group
2022-12-05 19:47:56 +01:00
Mike Fährmann
86f0597c95
[kissgoddess] remove module
...
site does not host albums anymore
2022-12-05 19:28:50 +01:00
Mike Fährmann
049d1bae9a
release version 1.24.1
2022-12-04 21:10:14 +01:00
Mike Fährmann
d0b160461a
terrible workaround for errors with 'http-metadata' ( #3334 )
2022-12-04 19:36:21 +01:00
Mike Fährmann
20e12b5d7c
[nitter] support '/i/user/' URLs ( #3310 )
...
as well as using 'id:<userid>' as username
not all nitter instances seem to support '/i/user/' ...
2022-12-04 16:21:13 +01:00
Mike Fährmann
f820fbed53
remove no longer used entries from supportedsites.py
2022-12-04 16:21:13 +01:00
Mike Fährmann
fceaee3c4f
[lolisafe] remove zz.ht
2022-12-04 16:21:13 +01:00
Mike Fährmann
4554c43d5f
[bunkr] use 'media-files' servers for more file types
2022-12-04 16:21:13 +01:00
enduser420
4bc756dfe0
[2chen] fix extraction ( #3356 )
...
update 'archive_fmt'
update tests
update 'board' regex
2022-12-04 16:19:36 +01:00
enduser420
54844944ab
[pixhost] add 'gallery' support ( #3353 )
2022-12-04 16:19:14 +01:00
enduser420
213676c785
[fapachi] add 'post' and 'user' extractors ( #3347 )
...
* [fapachi] add 'post' and 'user' extractors
* [fapachi] add 'keyword' to test
* [fapachi] remove whitespaces
2022-12-02 13:54:29 +01:00
Mike Fährmann
a18511e346
[nitter] retry downloads on 404 ( #3313 )
2022-12-01 11:09:02 +01:00
Mike Fährmann
80102fa367
[downloader:http] add 'retry-codes' option ( #3313 )
2022-12-01 11:08:23 +01:00
Mike Fährmann
88610c3478
[patreon] update API query parameters
2022-12-01 10:02:28 +01:00
Mike Fährmann
c19b1f03b9
[patreon] fix '403 Forbidden' errors
...
send 'Content-Type' headers for API requests
2022-12-01 09:52:36 +01:00
Mike Fährmann
b4253f69c9
[downloader:http] fix ZeroDivisionError ( #3328 )
...
ensure 'time_elapsed' only get used as divisor
when it is greater than zero
2022-11-30 21:56:18 +01:00
Mike Fährmann
fc34f76cc5
[bunkr] fix video downloads ( #3326 )
...
by sending 'https://stream.bunkr.is/ ' as Referer header
2022-11-30 15:10:31 +01:00
Mike Fährmann
86a396e086
[bcy] fix JSONDecodeError ( #3321 )
2022-11-30 14:44:19 +01:00
Mike Fährmann
5b9a22af7f
[patreon] improve 'campaign_id' extraction ( #3235 )
2022-11-30 11:57:52 +01:00
Mike Fährmann
1bdd0e4338
[nitter] support '/i/web/' Tweet URLs ( #3310 )
2022-11-30 11:45:56 +01:00
Mike Fährmann
7e277d0f7d
[weibo] add 'count' metadata field ( #3305 )
...
or '{status[count]}', as most metadata for weibo is inside 'status'
2022-11-30 11:36:46 +01:00
Mike Fährmann
4287a93202
[nitter] handle base64-encoded filenames
2022-11-27 18:09:07 +01:00
ClosedPort22
b14b33f19e
Implement version-metadata
option ( #3201 )
2022-11-27 16:09:42 +01:00
sudo
a6305d031c
[hitomi] apply format check for every image ( #3030 ) ( #3280 )
2022-11-27 15:55:25 +01:00
Steven Docherty
a7c7953107
[reddit] use 'dash_url' for videos ( #3258 ) ( #3306 )
...
* use fallback_url for reddit_video to fix issue 3258
* changed to dash_url to include audio
* update
- use [] instead of .get
- catch TypeErrors in case one of the elements is not a dict
Co-authored-by: InterruptSpeed <steven@docherty.ca>
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2022-11-27 14:09:55 +01:00
Mike Fährmann
0e75358af8
[twitter] fix using user IDs for suspended accounts
2022-11-26 12:02:05 +01:00
Mike Fährmann
c25905641e
[weibo] fix bug with empty 'playback_list' ( #3301 )
2022-11-26 12:00:17 +01:00
Mike Fährmann
6cb12f513b
[nitter] support quoted Tweets
...
- distinguish between regular and quoted Tweets and media
- add 'quoted' option and metadata field
2022-11-26 11:23:03 +01:00