1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-26 04:32:51 +01:00
Commit Graph

5791 Commits

Author SHA1 Message Date
Martin Contento
c210c7a4ed [instagram] default posts like_count to zero
I don't know when/why this happens and for private account reasons can't
add an example here, but i had this error out and it feels like a safe
fix to default to `0` here.
2024-03-12 15:12:07 +00:00
blankie
225d849139
[mastodon] fix handling null 'moved' account field 2024-03-12 11:44:25 +11:00
Mike Fährmann
416f1b8cc1
[pages] customize layout to remove unnecessary links
- "docs" header
- "Improve this page"

https://github.com/pages-themes/primer/blob/master/_layouts/default.html
2024-03-11 23:28:20 +01:00
Mike Fährmann
7ac6274fe0
[docker] change date tags format from YYYYMMDD to YYYY.MM.DD
to use the same format as in executables
2024-03-11 22:17:50 +01:00
Mike Fährmann
6601e78b2f
[docker] remove setuptools and wheel __pycache__ directories
reduces image size by ~2MB
2024-03-11 21:52:23 +01:00
Mike Fährmann
106dfdb4c3
cleanup sleep-request retry delay code
more lines but easier to read I'd say
2024-03-11 21:38:06 +01:00
Mike Fährmann
4ccdba8ccb
[scripts] update release.py
build Linux binary in ubuntu22.04 VM
2024-03-11 21:35:50 +01:00
Mike Fährmann
4565de3c8e
[reddit] provide 'gif' and 'mp4' variant fallbacks (#5315) 2024-03-10 20:50:55 +01:00
Mike Fährmann
71cf08af4b
[workflows] update version.py path 2024-03-09 23:47:35 +01:00
Mike Fährmann
5842e4928d
[imgur] fail downloads when redirected to 'removed.png' (#5308) 2024-03-09 23:35:23 +01:00
Mike Fährmann
ac4e29f70a
[lensdump] support more direct link formats (#5293) 2024-03-09 23:33:58 +01:00
Mike Fährmann
a01d334feb
[workflows] update to actions/setup-python@v5 2024-03-09 23:32:31 +01:00
Mike Fährmann
3c979e1f05
[workflows] release standalone executables in gdl-org/builds
needs some form of release notes,
probably just git commits since last stable release
2024-03-09 23:30:39 +01:00
Mike Fährmann
146459056c
[reddit] provide 'fallback_url' as video fallback (#5296) 2024-03-07 15:58:01 +01:00
Mike Fährmann
d3003f8531
merge #5270: [imagefap] add 'folder' metadata 2024-03-07 01:31:40 +01:00
Mike Fährmann
05331f9cf1
[imagefap] flake8, cleanup, tests 2024-03-07 01:29:19 +01:00
Mike Fährmann
052811b57f
[docs] fix another typo (#5262)
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1980094380

This on was on the same line as the previous one ... (9fd851cd)
2024-03-07 00:59:02 +01:00
Mike Fährmann
40c0553523
[twitter] add 'quotes' extractor (#5262)
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1981571924

It's implemented as a search for 'quoted_tweet_id:…' on Twitter.
2024-03-07 00:52:50 +01:00
Mike Fährmann
790c0ffb8d
[lensdump] recognize direct image links (#5293 2024-03-06 22:56:57 +01:00
Mike Fährmann
6d9e3c0eb1
[skeb] add extractor for followed users (#5290)
needs 'Authorization' header from browser session
-o headers.Authorization="Bearer ey…"
2024-03-06 22:43:01 +01:00
Mike Fährmann
ace16f00f5
[weibo] fix retweets (#2825, #3874, #5263)
- handle 快转 retweets
- disable 'retweets' by default
- skip all retweet media when 'retweets' are disabled
- extract all retweet media when 'retweets' is set to "original"
2024-03-06 19:36:53 +01:00
Mike Fährmann
0676a9d6ec
[weibo] fix 'livephoto' filename extensions (#5287) 2024-03-06 19:36:32 +01:00
Mike Fährmann
a8027745e3
[downloader:http] add MIME type and signature for .mov files (#5287) 2024-03-06 14:00:24 +01:00
Mike Fährmann
db507e30c7
[pixiv] fix novel text extraction (#5285)
change to '/webview/v2/novel'
since '/v1/novel/text' does not work anymore
2024-03-06 02:31:26 +01:00
Mike Fährmann
9fd851cda1
[docs] fix typo: rebot -> robot (#5262)
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1979884897
2024-03-06 02:30:38 +01:00
Mike Fährmann
296f20e630
[warosu] fix 'board_name' metadata 2024-03-06 01:28:47 +01:00
Mike Fährmann
24873c2724
[warosu] fix crash for threads with deleted posts (#5289) 2024-03-06 01:27:45 +01:00
Mike Fährmann
f296067797
[naver] unescape post 'title' and 'description' 2024-03-06 00:46:19 +01:00
Mike Fährmann
a71cdab53e
merge #5126: [naver] fix EUC-KR encoding issue in old image URLs 2024-03-06 00:22:33 +01:00
Mike Fährmann
a8d3efbb99
[naver] simplify code + add test 2024-03-06 00:21:23 +01:00
Johann Hong
f64fb8f239
[naver] EUC-KR encoding issue in old image URLs Fix
Around October 2010, the image server URL format and file name
encoding changed from EUC-KR to UTF-8.
Modified to detect old URL format and decode image URLs into EUC-KR

- (lint with flake8) Customize conditions
  Wrap lines smaller than 79 characters

- (lint with flake8) Customize conditions (2nd try)
  - One import per line
  - Indent on consecutive lines

- (lint with flake8) Customize conditions (3rd try)
  - E128 continuation line under-indented for visual indent
  - E123 closing bracket does not match indentation of opening bracket's line

- Update naver.py
  Check encoding for all image URLs
2024-03-06 00:21:23 +01:00
Mike Fährmann
7b28418f69
[naver] recognize '.naver' URLs
https://blog.naver.com/PostView.naver?…
2024-03-05 22:30:29 +01:00
Mike Fährmann
36fc510d3a
[docker] update workflow
- run on every push to master
- build images from GitHub source instead of PyPI package
- build arm64 image (#5227)
- include more tags
  - build date as 'YYYYMMDD'
  - 'dev' for most recent build from master
  - 'latest' for most recent release build
2024-03-05 03:15:20 +01:00
Mike Fährmann
96af12cec2
[docker] update Dockerfile
- add LANG=C.UTF-8
  (better utf-8 support or so I heard)
- restructure RUN commands to be more easily extendable and have
  simpler git diffs
- swap 'apk' and 'pip' since 'apk' results are more likely to be stable
  and therefore cacheable
- disable Python bytecode caching with -B
  - reduces image size by 10Mb
  - bytecode for explicitly installed packages (gallery-dl, yt-dlp,
    dependencies) is still cached
- add some (hopefully) helpful command-line arguments to pip
2024-03-05 03:14:33 +01:00
Mike Fährmann
461b55da4b
[docs] deploy pages in both repositories
mikf/galleryx-dl and gdl-org/docs
2024-03-05 00:11:19 +01:00
Mike Fährmann
a767832332
[deviantart:avatar] ignore default avatars (#5276) 2024-03-04 23:11:30 +01:00
Mike Fährmann
0cbc910905
[deviantart:avatar] fix 'index' for avatars without '?' (#5276) 2024-03-04 22:31:35 +01:00
Mike Fährmann
40af26f68b
[docs] link to documentation files in index.md 2024-03-03 22:50:09 +01:00
Mike Fährmann
a97e39d94a
[docs] automatically trigger pages build on gdl-org/docs 2024-03-03 22:49:55 +01:00
Mike Fährmann
6482bbc525
[bluesky] handle different 'embed' structure 2024-03-03 20:41:01 +01:00
Mike Fährmann
1115dccd0d
[bluesky] fix feeds and lists
bug introduced in 495c9ee1
2024-03-03 20:22:34 +01:00
Mike Fährmann
f3bc048ff7
allow workflows to be triggered manually 2024-03-03 18:10:55 +01:00
Mike Fährmann
1a9b9aa310
[artstation] support video clips (#2566, #3309, #3911)
- add 'videos' and 'previews' options
- fix 403 errors for video previews
2024-03-03 18:00:45 +01:00
termvacycurtocs
f8b037ed40
[Imagefap] Add folder metadata
[Imagefap] Add "folder" metadata when downloading a folder or user profile.
No additional request is made to the server.

Use for example with the following configuration :
"parent-metadata": true
"directory":["{category}", "{uploader}", "{folder}", "{gallery_id} {title}"]
2024-03-02 22:15:45 +01:00
Mike Fährmann
982880615d
[deviantart] prevent unnecessary API requests (#4995)
… when using 'comments-avatars'

This also has the added benefit of making it possible to download
comment avatars from users without a valid user profile entry,
like deleted users.
2024-03-02 21:59:16 +01:00
Mike Fährmann
25d2854272
[deviantart] add 'comments-avatars' option (#4995) 2024-03-02 21:59:16 +01:00
Mike Fährmann
218ec1a9ee
[instagram] raise proper error for missing 'reels_media' (#5257) 2024-03-02 21:58:59 +01:00
Mike Fährmann
82c73c77b0
[redgifs] make 'date' available for directories (#5262)
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1973975415
2024-03-01 23:39:16 +01:00
Mike Fährmann
cf9e99c07b
[artstation] support collections (#146)
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1972101003
2024-03-01 20:21:21 +01:00
Mike Fährmann
32ec695195
merge #5256: [wikimedia] add azurlane.koumakan.jp 2024-02-29 21:50:24 +01:00