Mirrors/gallery-dl
1
0
Fork 0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-26 12:42:29 +01:00
Code Issues Releases Wiki Activity
5,651 Commits 6 Branches 164 Tags 15 MiB
6110e3f940
Commit Graph

5163 Commits

Author SHA1 Message Date
HornyQT
24e70b956b [pixeldrain] add support for single file album download 2024-05-25 16:06:50 +02:00
Mike Fährmann
0761b22a7f
[hiperdex] update domain to 'hiperdex.top' (#5635) 2024-05-24 17:13:10 +02:00
Mike Fährmann
ea434963ae
[subscribestar] fix file URLs (#5631) 2024-05-23 19:12:01 +02:00
Mike Fährmann
6198dfa424
[seiga] re-implement login with username & password 2024-05-23 18:52:53 +02:00
Mike Fährmann
329da4db5e
[newgrounds] update and fix login procedure (#5109) 2024-05-23 17:06:22 +02:00
Mike Fährmann
895e633c44
implement 'keywords-eval' option (#5621) 
to allow evaluating 'keywords' values as format strings
 2024-05-22 22:53:34 +02:00
Mike Fährmann
bc25636e63
[patreon] fix bootstrap data extraction (#5624) 
again
 2024-05-22 00:17:49 +02:00
Mike Fährmann
141efc2ad3
[twitter] transfer 'twitter.com' cookies to 'x.com' (#5597) 2024-05-21 23:46:42 +02:00
Jan Wikholm
ece3837408
Enable user_has_liked as IG download filter 
Background and context:

1. Instagram by default requires you to be logged in.
2. Your account can LIKE posts.
3. Getting all of your likes from IG can be a pain.

As an active IG user, I want to be able to download only posts I've liked.

The information of whether or not your logged-in user has liked the target post is available in the API results, but was not available to the end-user for filtering.

This small change allows `user_has_liked` to be used to e.g. download only liked posts of an entire IG account.

Example use:

```
$ gallery-dl --cookies-from-browser FIREFOX--filter 'user_has_liked' https://www.instagram.com/imgur/
```

This will only download the posts that have `has_liked: True` set in the returned REST API data.

Note: it will still need to loop through the entire account's posts since this is done per-post basis instead of looping just the liked posts, but at least you are able to use this IG feature as a download marker.
 2024-05-18 12:05:08 +03:00
Mike Fährmann
6276f5cd94
[twitter] update domain to x.com (#5597) 2024-05-17 22:59:52 +02:00
Mike Fährmann
bfcb66af05
[poipiku] send LANG cookie to ensure English UI (#5590) 2024-05-17 22:59:31 +02:00
Mike Fährmann
f651b3b6ab
merge #5601: [twitter] match '/video/' Tweet URLs 2024-05-17 22:49:12 +02:00
Mike Fährmann
2dec4bef60
merge #5591: [poipoku] avoid language-specific extraction 2024-05-17 22:47:51 +02:00
Mike Fährmann
7f1ed909d5
[imgur] match gallery/album/image URLs with title slugs (#5593) 2024-05-17 22:44:37 +02:00
Delphox
8ba73e2ec9
[twitter] match /video/ tweet urls 2024-05-17 16:50:51 -03:00
fireattack
831f922c1c [poipoku] avoid language-specific extr 2024-05-14 02:42:02 +08:00
Mike Fährmann
33b07c4603
[twitter] wait for rate limit reset before 429 error (#5532) 2024-05-12 01:13:30 +02:00
Mike Fährmann
3b6f306a8b
[exhentai] fix blank page detection 2024-05-11 22:01:34 +02:00
Mike Fährmann
90b3741643
[cookies] set proper 'expires' value for Chrome session cookies 
https://github.com/yt-dlp/yt-dlp/pull/9747
 2024-05-11 19:46:35 +02:00
Mike Fährmann
f178839fc2
[exhentai] fix multi-page viewer detection (#4969) 2024-05-11 18:32:52 +02:00
Mike Fährmann
5b6b5dd81b
[8chan] fix downloaded files by sending 'TOS' cookie (#5578) 2024-05-11 15:34:21 +02:00
Mike Fährmann
d2f50ecf09
add 'skip-filter' option (#5255) 2024-05-10 22:59:52 +02:00
Mike Fährmann
fd734b9222
[archive] add 'archive-mode' option (#5255) 2024-05-10 22:59:51 +02:00
Mike Fährmann
28039229fe
[common] use 'create_urllib3_context' for creating SSLContexts 
enables dumping TLS session keys by setting SSLKEYLOGFILE (#5215)
as well as other potentially useful settings.
 2024-05-10 22:59:29 +02:00
Mike Fährmann
33006fe126
[common] disable 'check_hostname' for non-urllib3 SSLContexts 
e.g. when 'browser' is set to a non-empty value and gallery-dl creates
its own SSLContext instance instead of using requests' and urllib3's
defaults.

urllib3 disables this option for its default contexts,
since it does this check on its own.

Fixes "ValueError: Cannot set verify_mode to CERT_NONE when
check_hostname is enabled" when using --no-check-certificate.

(#3614, #4891, #5576)
 2024-05-10 18:20:08 +02:00
Mike Fährmann
215abbc3e4
[archive] implement DownloadArchiveMemory class (#5255) 
keeps archive IDs in memory
and only writes them to disk in a 'finalize' step
 2024-05-10 01:15:44 +02:00
Mike Fährmann
88f94190f4
[archive] move DownloadArchive into its own module 2024-05-10 01:05:28 +02:00
Mike Fährmann
2ee9ffeed6
merge #5568: [furaffinity] match 'xfuraffinity' URLs 2024-05-09 19:20:12 +02:00
Mike Fährmann
b27ffd790a
[poipiku] fix downloading R-18 posts (#5567) 
… by automatically sending a `POIPIKU_CONTENTS_VIEW_MODE=1` cookie
to enable "adult" mode.
 2024-05-09 15:14:08 +02:00
Delphox
11109d5bad
[furaffinity] match xfuraffinity.com 2024-05-08 12:15:47 -03:00
Mike Fährmann
dc9d83e64b
[output] support 'NO_COLOR' environment variable 2024-05-03 12:25:41 +02:00
Mike Fährmann
625740c3d2
merge #5538: [cookies] optimize _find_most_recently_used_file for exact profiles 2024-05-02 18:19:19 +02:00
Jan Wikholm
06d102f19a
optimize _find_most_recently_used_file for exact profile 
When reading cookies from the browser, the user is able to give either just the browser name, or also provide profile/container information.

If an exact profile is provided, there is no need to find the latest profile with `os.walk` which is very expensive.

This change optimizes that case and the performance increase is significant (~8 sec to 0.6 sec).

```
$ time gallery-dl --config-ignore -d . -D . --cookies-from-browser FIREFOX https://imgur.com/OO4UNqJ
[cookies][info] Extracted 16 cookies from Firefox
 ./imgur_OO4UNqJ.jpg

real    0m8.429s
user    0m0.216s
sys     0m0.431s

$ time gallery-dl --config-ignore -d . -D . --cookies-from-browser FIREFOX:bgamf5r6.default-release https://imgur.com/OO4UNqJ
[cookies][info] Extracted 16 cookies from Firefox
 ./imgur_OO4UNqJ.jpg

real    0m0.456s
user    0m0.183s
sys     0m0.011s

$ gallery-dl --version
1.26.9
```
 2024-05-02 18:16:13 +02:00
Mike Fährmann
bd8e4797e5
[vsco] add 'avatar' extractor (#5341) 2024-05-02 18:12:19 +02:00
Mike Fährmann
d0cead105b
[formatter] allow dots etc in '…' literals (#5539) 
don't parse fields starting with '

this disables the ability to directly apply […] to '…' literals,
but that's not really useful anyway and can still be done with _lit
 2024-05-02 17:43:24 +02:00
Mike Fährmann
619bf5c644
[inkbunny] retry API calls with a loop instead of recursion 2024-05-01 22:46:24 +02:00
Mike Fährmann
d11ec00908
[common] fix _cfgpath for BaseExtractor objects 
After the changes in 0c17884673,
_cfgpath was mssing its 'category' value
since that hadn't been initialized yet.
 2024-05-01 16:00:07 +02:00
Mike Fährmann
6db1837a6d
[bluesky] filter reposts only for user timelines (#5528) 2024-05-01 16:00:07 +02:00
Mike Fährmann
3cf5366143
[mastodon] add support for card images 2024-05-01 16:00:07 +02:00
Mike Fährmann
9b1995dda3
[mastodon] add 'favorite', 'list', and 'hashtag' extractors (#5529) 2024-05-01 15:59:34 +02:00
Mike Fährmann
7fd31aaf8e
merge #5516: [mastodon] send canonical 'true'/'false' boolean values 
instead of '1'/'0' to be compatible with Mitra instances or others that
do not fully implement Mastodon's boolean value semantics.
 2024-04-27 01:34:56 +02:00
cenodis
3ba5fd9efd
[mastodon] Use boolean instead of integer keys for accounts/statuses endpoint 2024-04-26 22:51:56 +02:00
Mike Fährmann
6c57958806
merge #5511: [twitter] [furaffinity] match fixvx.com and fxfuraffinity/fxraffinity.net URLs 2024-04-25 22:00:19 +02:00
Mike Fährmann
5aefa9465c
[furaffinity] simplify pattern, match original domain first 2024-04-25 21:58:34 +02:00
Delphox
6969963125
[furaffinity] support fxfuraffinity and fxraffinity urls 2024-04-25 13:25:39 -03:00
Delphox
85550a37c4
[twitter] support fixvx urls 2024-04-25 13:19:40 -03:00
Mike Fährmann
cd241bea0a
[downloader:http] add MIME type and signature for .m4v files (#5505) 2024-04-25 01:01:35 +02:00
Mike Fährmann
bef0bd3b49
add '--no-colors' command-line option 2024-04-20 21:06:59 +02:00
Mike Fährmann
20e2c0042b
[output] enable colors by default 2024-04-20 20:51:20 +02:00
Mike Fährmann
14b38264e0
[output] extend 'output.colors' (#2566) 
allow specifying ANSI colors for all loglevels
(debug, info, warning, error)
 2024-04-20 20:50:58 +02:00
Mike Fährmann
ddffeeaa7b
[exhentai] detect CAPTCHAs during login (#5492) 2024-04-20 00:19:22 +02:00
Mike Fährmann
347af7f5c8
[twitter] handle missing 'expanded_url' fields (#5463, #5490) 2024-04-19 21:42:22 +02:00
Mike Fährmann
c9d3b5e5d9
[pixiv] change 'sanity_level' debug message to a warning (#5180) 2024-04-19 16:41:31 +02:00
Mike Fährmann
bffadf35b7
[hotleak] download files with 404 status code (#5395) 2024-04-19 16:08:31 +02:00
Mike Fährmann
a7d8cbab0e
[common] show full URL in Extractor.request() error messages 2024-04-18 15:45:36 +02:00
Mike Fährmann
a5071c9ca0
[common] fix NameError in Extractor.request() 
… when accessing 'code' after an requests exception was raised.

Caused by the changes in 566472f080
 2024-04-18 15:42:53 +02:00
Mike Fährmann
566472f080
[common] add 'sleep-429' option (#5160) 2024-04-16 18:41:28 +02:00
Mike Fährmann
923c6f3214
[common] simplify 'status_code' check in Extractor.request() 2024-04-16 18:39:47 +02:00
Mike Fährmann
68f4208251
[common] update Extractor.wait() message format 2024-04-16 17:51:14 +02:00
Mike Fährmann
9e5d65fbf3
[twitter] improve username & password login procedure (#5445) 
- handle more subtasks
- support 2FA
- support email verification codes
 2024-04-16 01:25:04 +02:00
Mike Fährmann
b38a917355
[common] add Extractor.input() method 2024-04-16 00:02:48 +02:00
Mike Fährmann
257e9fb435
[gelbooru] improve pagination logic for meta tags (#5478) 
similar to 494acabd38
 2024-04-15 23:14:48 +02:00
Aidan Harris
a2affdcef3
re-order verbose and warning options 2024-04-14 13:15:07 +00:00
Aidan Harris
a3f580254a
Add warnings flag 
This commit adds a warnings flag

It can be combined with -q / --quiet to display warnings.
The intent is to provide a silent option that still surfaces
warning and error messages so that they are visible in logs.
 2024-04-14 08:55:50 +00:00
Mike Fährmann
0d72789aa3
merge #5461: [cookies] use tempfile when saving cookies.txt files 2024-04-13 19:02:39 +02:00
Mike Fährmann
63ac06643f
compute tempfile path only once 2024-04-13 18:59:18 +02:00
Mike Fährmann
5227bb6b1d
[text] catch general Exceptions 2024-04-13 18:51:40 +02:00
Mike Fährmann
141a93c8fd
[docs] update docs/configuration links (#5059, #5369, #5423) 2024-04-13 02:18:44 +02:00
Mike Fährmann
85bbb59483
[twitter] implement 'relogin' option (#5445) 2024-04-12 23:01:22 +02:00
Mike Fährmann
e02d2ff45d
[tapas] add 'creator' extractor (#5306) 2024-04-11 23:41:50 +02:00
Mike Fährmann
35d4a706ae
[pixiv:novel] add 'covers' option (#5373) 2024-04-11 22:27:49 +02:00
Mike Fährmann
b57051719f
[wikimedia] support wiki.gg wikis 2024-04-09 19:24:01 +02:00
Mike Fährmann
40c1a8e471
[wikimedia] fix exception for files with empty 'metadata' 2024-04-09 19:12:15 +02:00
Mike Fährmann
0e730ba980
[pp:mtime] do not overwrite '_mtime' for None values (#5439) 2024-04-07 02:33:19 +02:00
Mike Fährmann
647a87d17c
[twitter] match '/photo/' Tweet URLs (#5443) 
fixes regression introduced in 40c05535
 2024-04-06 17:56:21 +02:00
Mike Fährmann
3346a377b3
[pp:ugoira] log errors for general exceptions 2024-04-06 17:00:48 +02:00
Mike Fährmann
40bd145637
remove 'contextlib' imports 2024-04-06 16:59:09 +02:00
Mike Fährmann
9a8403917a
restore LD_LIBRARY_PATH for PyInstaller builds (#5421) 2024-04-06 16:58:33 +02:00
Mike Fährmann
86a97d8e27
[kemonoparty] fix crash on posts with missing datetime info (#5422) 2024-04-05 00:25:23 +02:00
Mike Fährmann
ef8f02c3d9
[oauth] use Extractor.request() for HTTP requests (#5433) 
Enables using proxies and general network options.
 2024-04-04 20:51:54 +02:00
Mike Fährmann
095e5ded6f
[reddit] support comment embeds (#5366) 2024-04-01 23:35:42 +02:00
Mike Fährmann
64948f2c09
[foolfuuka] improve 'board' pattern & support pages (#5408) 2024-04-01 22:31:25 +02:00
Mike Fährmann
0c17884673
store 'match' and 'groups' in Extractor objects 2024-04-01 03:07:52 +02:00
Mike Fährmann
bdbc8be5f3
[twitter] prevent crash when extracting 'birdwatch' metadata (#5403) 2024-03-30 18:13:38 +01:00
Mike Fährmann
ef0c90414c
[wikimedia] suppress exception for entries without 'imageinfo' (#5384) 2024-03-26 15:33:26 +01:00
Mike Fährmann
9cce461627
[kemonoparty] add 'announcements' option (#5262) 
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2015919188
 2024-03-26 15:20:14 +01:00
Mike Fährmann
72ac2c750d
[kemonoparty:favorite] support 'sort' and 'order' query params (#5375) 2024-03-26 02:27:36 +01:00
Mike Fährmann
d1d017ab5d
merge #5372: [twitter] match Tweet URLs with query parameters (#5371) 
fixes regression introduced in 40c05535
 2024-03-25 22:01:46 +01:00
fireattack
423599ce95
[twitter] fix pattern for single tweet (#5371) 
- Add optional slash
- Update tests to include some non-standard tweet URLs
 2024-03-25 21:57:35 +01:00
Mike Fährmann
15a4bc2584
[kemonoparty] fix KeyError for empty files (#5368) 2024-03-24 02:21:38 +01:00
Mike Fährmann
c3bafd6a2b
release version 1.26.9 2024-03-23 17:41:29 +01:00
Mike Fährmann
925123e007
[deviantart] handle CloudFront blocks in general (#5363) 
This was already done for non-OAuth requests (#655)
but CF is now blocking OAuth API requests as well.
 2024-03-23 15:50:24 +01:00
Mike Fährmann
31e7ca73b6
[gelbooru] add 'order-posts' option for favorites (#5220) 2024-03-23 13:30:09 +01:00
Mike Fährmann
4b6f47e571
[pornhub:gif] extract 'viewkey' and 'timestamp' metadata (#4463) 
https://github.com/mikf/gallery-dl/issues/4463#issuecomment-2014550302
 2024-03-22 18:00:20 +01:00
Mike Fährmann
9f73fac5ef
[steamgriddb] raise proper exception for deleted assets 2024-03-22 17:53:06 +01:00
Mike Fährmann
fe9171508f
[kemonoparty] fix exception for '/revision/' URLs 
caused by 03a9ce98
 2024-03-22 03:10:12 +01:00
Mike Fährmann
a650fd3177
[deviantart] improve 'index' extraction for stash files (#5335) 2024-03-22 02:53:54 +01:00
Mike Fährmann
1d6260f456
[bunkr] remove 'description' metadata 
album descriptions are no longer available on album pages
and the previous code erroneously returned just '0'
 2024-03-22 02:14:41 +01:00
Mike Fährmann
32262a048b
[idolcomplex] fix metadata extraction 
- replace legacy 'id' vales with alphanumeric ones, since the former are
  no longer available
- approximate 'vote_average', since the real value is no longer
  available
- fix 'vote_count'
 2024-03-22 01:43:05 +01:00
Mike Fährmann
77ab015df2
[idolcomplex] support new pool URLs 2024-03-22 01:38:25 +01:00
Mike Fährmann
1b34d5ac40
[subscribestar] fix 'date' metadata 2024-03-22 00:45:09 +01:00
Mike Fährmann
ddb2edfd32
[formatter] fix local DST datetime offsets for ':O' 
'O' would get the *current* local UTC offset and apply it to all
'datetime' objects it gets applied to.
This would result in a wrong offset if the current offset includes
DST and the target 'datetime' does not or vice-versa.

'O' now determines the correct local UTC offset while respecting DST for
each individual 'datetime'.
 2024-03-21 20:45:46 +01:00
wankio
56f2d5a5f2
fapello.py Fullsize image 
by remove ".md" and ".th" in image url, it will download fullsize of images
 2024-03-21 18:08:18 +01:00
wankio
eb673a7204
Update fapello.py 
get fullsize image instead resized
 2024-03-19 02:48:53 +07:00
Mike Fährmann
6d93295fea
[gelbooru] add 'date_favorited' metadata field 2024-03-18 20:46:11 +01:00
Mike Fährmann
0d69af94d5
[gelbooru] detect returned favorites order (#5220) 2024-03-18 20:45:06 +01:00
Mike Fährmann
e1c51c0dfb
[vipergirls] add 'domain' option (#4166) 2024-03-18 17:36:16 +01:00
Mike Fährmann
ae116812cc
[vipergirls] add 'like' option (#4166) 2024-03-18 17:36:16 +01:00
Mike Fährmann
da6ba60331
[bluesky] add 'instance' metadata field (#4438) 2024-03-18 17:36:16 +01:00
Mike Fährmann
5c1f5861b6
[flickr] add 'contexts' option (#5324) 2024-03-18 17:36:16 +01:00
Mike Fährmann
26bc2d55f4
[hiperdex] update URL patterns & fix 'manga' metadata (#5340) 2024-03-18 17:36:16 +01:00
Mike Fährmann
8e694d85c4
[twitter] add 'birdwatch' metadata field (#5317) 
should probably get a better name,
but this is what it's called internally by Twitter
 2024-03-18 17:36:02 +01:00
Mike Fährmann
b8e7be225c
merge #5333: [imagefap] fix folder extractor 2024-03-15 23:46:43 +01:00
Herp
99c53f7fa8
Fix imagefap extrcator 2024-03-15 23:44:25 +01:00
Mike Fährmann
03a9ce9832
[kemonoparty] add 'order-revisions' option (#5334) 2024-03-15 23:06:05 +01:00
Mike Fährmann
1418c0ce38
[kemonoparty] add 'revision_count' metadata field (#5334) 2024-03-15 22:28:15 +01:00
Mike Fährmann
ddee5ae7c4
[gofile] fix extraction 2024-03-15 20:34:54 +01:00
Mike Fährmann
5716430c35
[deviantart:stash] recognize 'deviantart.com/stash/…' URLs 2024-03-15 18:14:55 +01:00
Mike Fährmann
76683c5f5c
[deviantart:stash] fix 'index' metadata (#5335) 2024-03-15 18:10:59 +01:00
Mike Fährmann
5158cbb4c1
[weibo] rework pagination logic (#4168) 
don't automatically stop when receiving an empty status list

shouldn't improve 'tabtype=feed' results, but at least 'tabtype=album'
ones and others using cursors won't end prematurely
 2024-03-14 00:06:25 +01:00
Mike Fährmann
d53db6e11a
[twitter] handle "account is temporarily locked" errors (#5300) 
- display proper error message
- add 'locked' option
 2024-03-13 22:34:25 +01:00
Mike Fährmann
108abab537
[twitter] add 'protected' metadata field (#5327) 
for 'author' and 'user'
 2024-03-13 14:46:03 +01:00
Mike Fährmann
dde822e69a
[instagram] change 'posts are private' exception to a warning (#5322) 2024-03-12 18:58:15 +01:00
Mike Fährmann
e40973118d
merge #5323: [instagram] default 'likes' to '0' 2024-03-12 18:47:24 +01:00
Mike Fährmann
b188cb2729
merge #5321: [mastodon] fix handling null 'moved' account field 2024-03-12 18:45:53 +01:00
Martin Contento
c210c7a4ed [instagram] default posts like_count to zero 
I don't know when/why this happens and for private account reasons can't
add an example here, but i had this error out and it feels like a safe
fix to default to `0` here.
 2024-03-12 15:12:07 +00:00
blankie
225d849139
[mastodon] fix handling null 'moved' account field 2024-03-12 11:44:25 +11:00
Mike Fährmann
106dfdb4c3
cleanup sleep-request retry delay code 
more lines but easier to read I'd say
 2024-03-11 21:38:06 +01:00
Mike Fährmann
4565de3c8e
[reddit] provide 'gif' and 'mp4' variant fallbacks (#5315) 2024-03-10 20:50:55 +01:00
Mike Fährmann
5842e4928d
[imgur] fail downloads when redirected to 'removed.png' (#5308) 2024-03-09 23:35:23 +01:00
Mike Fährmann
ac4e29f70a
[lensdump] support more direct link formats (#5293) 2024-03-09 23:33:58 +01:00
Mike Fährmann
146459056c
[reddit] provide 'fallback_url' as video fallback (#5296) 2024-03-07 15:58:01 +01:00
Mike Fährmann
d3003f8531
merge #5270: [imagefap] add 'folder' metadata 2024-03-07 01:31:40 +01:00
Mike Fährmann
05331f9cf1
[imagefap] flake8, cleanup, tests 2024-03-07 01:29:19 +01:00
Mike Fährmann
40c0553523
[twitter] add 'quotes' extractor (#5262) 
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1981571924

It's implemented as a search for 'quoted_tweet_id:…' on Twitter.
 2024-03-07 00:52:50 +01:00
Mike Fährmann
790c0ffb8d
[lensdump] recognize direct image links (#5293 2024-03-06 22:56:57 +01:00
Mike Fährmann
6d9e3c0eb1
[skeb] add extractor for followed users (#5290) 
needs 'Authorization' header from browser session
-o headers.Authorization="Bearer ey…"
 2024-03-06 22:43:01 +01:00
Mike Fährmann
ace16f00f5
[weibo] fix retweets (#2825, #3874, #5263) 
- handle 快转 retweets
- disable 'retweets' by default
- skip all retweet media when 'retweets' are disabled
- extract all retweet media when 'retweets' is set to "original"
 2024-03-06 19:36:53 +01:00
Mike Fährmann
0676a9d6ec
[weibo] fix 'livephoto' filename extensions (#5287) 2024-03-06 19:36:32 +01:00
Mike Fährmann
a8027745e3
[downloader:http] add MIME type and signature for .mov files (#5287) 2024-03-06 14:00:24 +01:00
Mike Fährmann
db507e30c7
[pixiv] fix novel text extraction (#5285) 
change to '/webview/v2/novel'
since '/v1/novel/text' does not work anymore
 2024-03-06 02:31:26 +01:00
Mike Fährmann
296f20e630
[warosu] fix 'board_name' metadata 2024-03-06 01:28:47 +01:00
Mike Fährmann
24873c2724
[warosu] fix crash for threads with deleted posts (#5289) 2024-03-06 01:27:45 +01:00
Mike Fährmann
f296067797
[naver] unescape post 'title' and 'description' 2024-03-06 00:46:19 +01:00
Mike Fährmann
a71cdab53e
merge #5126: [naver] fix EUC-KR encoding issue in old image URLs 2024-03-06 00:22:33 +01:00
Mike Fährmann
a8d3efbb99
[naver] simplify code + add test 2024-03-06 00:21:23 +01:00
Johann Hong
f64fb8f239
[naver] EUC-KR encoding issue in old image URLs Fix 
Around October 2010, the image server URL format and file name
encoding changed from EUC-KR to UTF-8.
Modified to detect old URL format and decode image URLs into EUC-KR

- (lint with flake8) Customize conditions
  Wrap lines smaller than 79 characters

- (lint with flake8) Customize conditions (2nd try)
  - One import per line
  - Indent on consecutive lines

- (lint with flake8) Customize conditions (3rd try)
  - E128 continuation line under-indented for visual indent
  - E123 closing bracket does not match indentation of opening bracket's line

- Update naver.py
  Check encoding for all image URLs
 2024-03-06 00:21:23 +01:00
Mike Fährmann
7b28418f69
[naver] recognize '.naver' URLs 
https://blog.naver.com/PostView.naver?…
 2024-03-05 22:30:29 +01:00
Mike Fährmann
a767832332
[deviantart:avatar] ignore default avatars (#5276) 2024-03-04 23:11:30 +01:00
Mike Fährmann
0cbc910905
[deviantart:avatar] fix 'index' for avatars without '?' (#5276) 2024-03-04 22:31:35 +01:00