Mirrors/gallery-dl
1
0
Fork 0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-22 10:42:34 +01:00
Code Issues Releases Wiki Activity
5,405 Commits 6 Branches 164 Tags 15 MiB
b8e7be225c
Commit Graph

5405 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
b8e7be225c
merge #5333: [imagefap] fix folder extractor 2024-03-15 23:46:43 +01:00
Herp
99c53f7fa8
Fix imagefap extrcator 2024-03-15 23:44:25 +01:00
Mike Fährmann
03a9ce9832
[kemonoparty] add 'order-revisions' option (#5334) 2024-03-15 23:06:05 +01:00
Mike Fährmann
1418c0ce38
[kemonoparty] add 'revision_count' metadata field (#5334) 2024-03-15 22:28:15 +01:00
Mike Fährmann
ddee5ae7c4
[gofile] fix extraction 2024-03-15 20:34:54 +01:00
Mike Fährmann
5716430c35
[deviantart:stash] recognize 'deviantart.com/stash/…' URLs 2024-03-15 18:14:55 +01:00
Mike Fährmann
76683c5f5c
[deviantart:stash] fix 'index' metadata (#5335) 2024-03-15 18:10:59 +01:00
Mike Fährmann
e76d5756a0
merge #5329: fix some typos 2024-03-14 15:20:54 +01:00
teslaedison
ab1fc470b7 chore: fix some typos 
Signed-off-by: teslaedison <qingchengqiushuang@gmail.com>
 2024-03-14 16:07:02 +08:00
Mike Fährmann
5158cbb4c1
[weibo] rework pagination logic (#4168) 
don't automatically stop when receiving an empty status list

shouldn't improve 'tabtype=feed' results, but at least 'tabtype=album'
ones and others using cursors won't end prematurely
 2024-03-14 00:06:25 +01:00
Mike Fährmann
d53db6e11a
[twitter] handle "account is temporarily locked" errors (#5300) 
- display proper error message
- add 'locked' option
 2024-03-13 22:34:25 +01:00
Mike Fährmann
108abab537
[twitter] add 'protected' metadata field (#5327) 
for 'author' and 'user'
 2024-03-13 14:46:03 +01:00
Mike Fährmann
dde822e69a
[instagram] change 'posts are private' exception to a warning (#5322) 2024-03-12 18:58:15 +01:00
Mike Fährmann
e40973118d
merge #5323: [instagram] default 'likes' to '0' 2024-03-12 18:47:24 +01:00
Mike Fährmann
b188cb2729
merge #5321: [mastodon] fix handling null 'moved' account field 2024-03-12 18:45:53 +01:00
Martin Contento
c210c7a4ed [instagram] default posts like_count to zero 
I don't know when/why this happens and for private account reasons can't
add an example here, but i had this error out and it feels like a safe
fix to default to `0` here.
 2024-03-12 15:12:07 +00:00
blankie
225d849139
[mastodon] fix handling null 'moved' account field 2024-03-12 11:44:25 +11:00
Mike Fährmann
416f1b8cc1
[pages] customize layout to remove unnecessary links 
- "docs" header
- "Improve this page"

https://github.com/pages-themes/primer/blob/master/_layouts/default.html
 2024-03-11 23:28:20 +01:00
Mike Fährmann
7ac6274fe0
[docker] change date tags format from YYYYMMDD to YYYY.MM.DD 
to use the same format as in executables
 2024-03-11 22:17:50 +01:00
Mike Fährmann
6601e78b2f
[docker] remove setuptools and wheel __pycache__ directories 
reduces image size by ~2MB
 2024-03-11 21:52:23 +01:00
Mike Fährmann
106dfdb4c3
cleanup sleep-request retry delay code 
more lines but easier to read I'd say
 2024-03-11 21:38:06 +01:00
Mike Fährmann
4ccdba8ccb
[scripts] update release.py 
build Linux binary in ubuntu22.04 VM
 2024-03-11 21:35:50 +01:00
Mike Fährmann
4565de3c8e
[reddit] provide 'gif' and 'mp4' variant fallbacks (#5315) 2024-03-10 20:50:55 +01:00
Mike Fährmann
71cf08af4b
[workflows] update version.py path 2024-03-09 23:47:35 +01:00
Mike Fährmann
5842e4928d
[imgur] fail downloads when redirected to 'removed.png' (#5308) 2024-03-09 23:35:23 +01:00
Mike Fährmann
ac4e29f70a
[lensdump] support more direct link formats (#5293) 2024-03-09 23:33:58 +01:00
Mike Fährmann
a01d334feb
[workflows] update to actions/setup-python@v5 2024-03-09 23:32:31 +01:00
Mike Fährmann
3c979e1f05
[workflows] release standalone executables in gdl-org/builds 
needs some form of release notes,
probably just git commits since last stable release
 2024-03-09 23:30:39 +01:00
Mike Fährmann
146459056c
[reddit] provide 'fallback_url' as video fallback (#5296) 2024-03-07 15:58:01 +01:00
Mike Fährmann
d3003f8531
merge #5270: [imagefap] add 'folder' metadata 2024-03-07 01:31:40 +01:00
Mike Fährmann
05331f9cf1
[imagefap] flake8, cleanup, tests 2024-03-07 01:29:19 +01:00
Mike Fährmann
052811b57f
[docs] fix another typo (#5262) 
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1980094380

This on was on the same line as the previous one ... (9fd851cd)
 2024-03-07 00:59:02 +01:00
Mike Fährmann
40c0553523
[twitter] add 'quotes' extractor (#5262) 
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1981571924

It's implemented as a search for 'quoted_tweet_id:…' on Twitter.
 2024-03-07 00:52:50 +01:00
Mike Fährmann
790c0ffb8d
[lensdump] recognize direct image links (#5293 2024-03-06 22:56:57 +01:00
Mike Fährmann
6d9e3c0eb1
[skeb] add extractor for followed users (#5290) 
needs 'Authorization' header from browser session
-o headers.Authorization="Bearer ey…"
 2024-03-06 22:43:01 +01:00
Mike Fährmann
ace16f00f5
[weibo] fix retweets (#2825, #3874, #5263) 
- handle 快转 retweets
- disable 'retweets' by default
- skip all retweet media when 'retweets' are disabled
- extract all retweet media when 'retweets' is set to "original"
 2024-03-06 19:36:53 +01:00
Mike Fährmann
0676a9d6ec
[weibo] fix 'livephoto' filename extensions (#5287) 2024-03-06 19:36:32 +01:00
Mike Fährmann
a8027745e3
[downloader:http] add MIME type and signature for .mov files (#5287) 2024-03-06 14:00:24 +01:00
Mike Fährmann
db507e30c7
[pixiv] fix novel text extraction (#5285) 
change to '/webview/v2/novel'
since '/v1/novel/text' does not work anymore
 2024-03-06 02:31:26 +01:00
Mike Fährmann
9fd851cda1
[docs] fix typo: rebot -> robot (#5262) 
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1979884897
 2024-03-06 02:30:38 +01:00
Mike Fährmann
296f20e630
[warosu] fix 'board_name' metadata 2024-03-06 01:28:47 +01:00
Mike Fährmann
24873c2724
[warosu] fix crash for threads with deleted posts (#5289) 2024-03-06 01:27:45 +01:00
Mike Fährmann
f296067797
[naver] unescape post 'title' and 'description' 2024-03-06 00:46:19 +01:00
Mike Fährmann
a71cdab53e
merge #5126: [naver] fix EUC-KR encoding issue in old image URLs 2024-03-06 00:22:33 +01:00
Mike Fährmann
a8d3efbb99
[naver] simplify code + add test 2024-03-06 00:21:23 +01:00
Johann Hong
f64fb8f239
[naver] EUC-KR encoding issue in old image URLs Fix 
Around October 2010, the image server URL format and file name
encoding changed from EUC-KR to UTF-8.
Modified to detect old URL format and decode image URLs into EUC-KR

- (lint with flake8) Customize conditions
  Wrap lines smaller than 79 characters

- (lint with flake8) Customize conditions (2nd try)
  - One import per line
  - Indent on consecutive lines

- (lint with flake8) Customize conditions (3rd try)
  - E128 continuation line under-indented for visual indent
  - E123 closing bracket does not match indentation of opening bracket's line

- Update naver.py
  Check encoding for all image URLs
 2024-03-06 00:21:23 +01:00
Mike Fährmann
7b28418f69
[naver] recognize '.naver' URLs 
https://blog.naver.com/PostView.naver?…
 2024-03-05 22:30:29 +01:00
Mike Fährmann
36fc510d3a
[docker] update workflow 
- run on every push to master
- build images from GitHub source instead of PyPI package
- build arm64 image (#5227)
- include more tags
  - build date as 'YYYYMMDD'
  - 'dev' for most recent build from master
  - 'latest' for most recent release build
 2024-03-05 03:15:20 +01:00
Mike Fährmann
96af12cec2
[docker] update Dockerfile 
- add LANG=C.UTF-8
  (better utf-8 support or so I heard)
- restructure RUN commands to be more easily extendable and have
  simpler git diffs
- swap 'apk' and 'pip' since 'apk' results are more likely to be stable
  and therefore cacheable
- disable Python bytecode caching with -B
  - reduces image size by 10Mb
  - bytecode for explicitly installed packages (gallery-dl, yt-dlp,
    dependencies) is still cached
- add some (hopefully) helpful command-line arguments to pip
 2024-03-05 03:14:33 +01:00
Mike Fährmann
461b55da4b
[docs] deploy pages in both repositories 
mikf/galleryx-dl and gdl-org/docs
 2024-03-05 00:11:19 +01:00