1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-25 20:22:36 +01:00
Commit Graph

324 Commits

Author SHA1 Message Date
Mike Fährmann
36883e458e
use 'v[0] == "c"' instead of 'v.startswith("c")' 2024-10-15 08:24:06 +02:00
Mike Fährmann
d68bb78f44
use 'True if COND else False' for bool conversions
faster than 'bool(COND)', especially on older Pythons < 3.11
2024-10-14 20:57:47 +02:00
Mike Fährmann
5dd17910d1
[deviantart] fix sta.sh folder extraction 2024-10-11 09:51:20 +02:00
Mike Fährmann
cfb7b3dd71
[deviantart] improve 'tiptap' conversion (#6207)
- support literature link embeds
- support @ mentions
- support more text styles
2024-10-09 20:59:36 +02:00
Mike Fährmann
a9671f160b
[deviantart] support converting 'tiptap' markup to HTML (#6207) 2024-10-05 23:43:32 +02:00
Mike Fährmann
7dbd53e9b4
[deviantart] extract journal HTML from webpage (#6254, #6207, #6196) 2024-10-01 21:47:14 +02:00
Mike Fährmann
ed859f05ed
[deviantart] fix & improve journal/literature extraction (#6254, #6207)
fetch text from HTML __INITIAL_STATE__,
since the API doesn't reliably work and is unusable for sta.sh journals
2024-10-01 14:36:49 +02:00
Mike Fährmann
bc11dc0de2
[deviantart] add 'previews' option (#3782, #6124) 2024-09-27 10:41:26 +02:00
Mike Fährmann
928e170721
[deviantart] work around OAuth API returning empty journal texts
(#6196, #6207, #5916)
2024-09-27 10:41:26 +02:00
Mike Fährmann
a9dc7a6f98
[deviantart] warn about empty journal texts (#5916)
https://github.com/mikf/gallery-dl/issues/5916#issuecomment-2351069092
2024-09-16 10:12:25 +02:00
Mike Fährmann
0b53f3d0e9
[deviantart] fix '"original": "images"' (#6124) 2024-09-02 15:15:37 +02:00
Mike Fährmann
3bffe7a8bd
[deviantart] fix 'manual' cursor-based pagination (#6079) 2024-08-23 16:03:38 +02:00
Mike Fährmann
269b2808f1
[deviantart] fix "KeyError - 'category'" (#5960, #5961)
'deviation' objects returned by the OAuth API no longer include a
'category' or 'category_path' value.
2024-08-08 09:34:51 +02:00
Mike Fährmann
bb07313227
[deviantart] try to work around journal/status API changes (#5916)
The new /user/profile/posts endpoint is documented to
"return all journals & status updates for a given user in a single feed"
but it does not do this.

There are usually several or even all status updates missing.
2024-08-03 13:17:27 +02:00
Mike Fährmann
2bf76461ce
[deviantart:following] use OAuth API endpoint (#2511) 2024-07-31 17:21:39 +02:00
Mike Fährmann
e17b1d5073
[deviantart] fix 2c8aa9b2 (#5696) 2024-06-08 02:00:36 +02:00
Mike Fährmann
2c8aa9b2de
[deviantart] fix watching module ID extraction (#5696) 2024-06-06 15:21:04 +02:00
Mike Fährmann
141a93c8fd
[docs] update docs/configuration links (#5059, #5369, #5423) 2024-04-13 02:18:44 +02:00
Mike Fährmann
925123e007
[deviantart] handle CloudFront blocks in general (#5363)
This was already done for non-OAuth requests (#655)
but CF is now blocking OAuth API requests as well.
2024-03-23 15:50:24 +01:00
Mike Fährmann
a650fd3177
[deviantart] improve 'index' extraction for stash files (#5335) 2024-03-22 02:53:54 +01:00
Mike Fährmann
5716430c35
[deviantart:stash] recognize 'deviantart.com/stash/…' URLs 2024-03-15 18:14:55 +01:00
Mike Fährmann
76683c5f5c
[deviantart:stash] fix 'index' metadata (#5335) 2024-03-15 18:10:59 +01:00
Mike Fährmann
a767832332
[deviantart:avatar] ignore default avatars (#5276) 2024-03-04 23:11:30 +01:00
Mike Fährmann
0cbc910905
[deviantart:avatar] fix 'index' for avatars without '?' (#5276) 2024-03-04 22:31:35 +01:00
Mike Fährmann
982880615d
[deviantart] prevent unnecessary API requests (#4995)
… when using 'comments-avatars'

This also has the added benefit of making it possible to download
comment avatars from users without a valid user profile entry,
like deleted users.
2024-03-02 21:59:16 +01:00
Mike Fährmann
25d2854272
[deviantart] add 'comments-avatars' option (#4995) 2024-03-02 21:59:16 +01:00
Mike Fährmann
c60ebc6519
[deviantart] improve fetching extended metadata (#5175)
use multiple metadata API calls per chunk of deviations if necessary
2024-02-25 03:36:00 +01:00
Mike Fährmann
741fd00cec
[deviantart] extend 'metadata' option (#5175)
alloe fetching extended metadata in addition to the usual
'description', 'tags', etc by setting 'metadata' to a list of
'camera', 'stats', 'submission', 'collection', and 'gallery'

for example "metadata": "stats,submission"
2024-02-18 23:14:14 +01:00
Mike Fährmann
04e4ffc64c
[deviantart] combine 'png' option with 'quality' (#4846)
"quality": "png" to download PNGs instead og JPEGs
2024-02-14 22:07:29 +01:00
Mike Fährmann
9cc4ec2c58
[deviantart] add 'png' option (#4846) 2024-02-14 01:03:15 +01:00
Mike Fährmann
966c8608e6
[deviantart] move image content extraction into separate function 2024-02-14 00:30:06 +01:00
Mike Fährmann
814ad9321e
[deviantart] skip locked/blurred posts (#4567, #5193) 2024-02-13 14:15:12 +01:00
Mike Fährmann
90b382304a
[deviantart] fix KeyError: 'premium_folder_data' (#5063) 2024-01-15 17:30:03 +01:00
Mike Fährmann
4cedf378d5
[deviantart] fix AttributeError for URLs without username (#5065)
caused by 4f367145
2024-01-15 16:28:57 +01:00
Mike Fährmann
39904c9e4e
[deviantart:avatar] add 'formats' option (#4995) 2024-01-10 17:13:34 +01:00
Mike Fährmann
5f9a98cf0f
[deviantart:avatar] fix exception when 'comments' are enabled (#4995) 2024-01-09 20:04:46 +01:00
Mike Fährmann
4f3671458e
[deviantart] add 'avatar' and 'background' extractors (#4995) 2024-01-03 00:07:55 +01:00
Mike Fährmann
2a60645095
[deviantart] set 'is_original' for intermediary URLs to 'false' 2023-12-22 14:49:10 +01:00
Mike Fährmann
fbebc58189
[deviantart] add 'intermediary' option (#4955) 2023-12-21 02:23:22 +01:00
Mike Fährmann
57fc6fcf83
replace '24*3600' with '86400'
and generalize cache maxage values
2023-12-18 23:57:22 +01:00
Mike Fährmann
aac8bb4eae
[deviantart] simplify 9951c112 2023-12-15 17:39:42 +01:00
Mike Fährmann
9951c112f8
[deviantart] workaround for integer client_id values (#4924) 2023-12-14 16:25:06 +01:00
Mike Fährmann
e256434c9e
use custom HTTPBasicAuth class
to support LazyPrompt as password
and to generate the Authorization header only once
instead of for every request
2023-12-07 01:40:31 +01:00
Mike Fährmann
bfdc07632a
[deviantart] expand nested comment replies (#4653) 2023-10-17 19:40:53 +02:00
Mike Fährmann
2d41702762
[deviantart] implement '"group": "skip"' (#4630) 2023-10-12 22:14:20 +02:00
Mike Fährmann
992e86ec94
[deviantart] disable 'jwt' (#4652) 2023-10-12 21:37:10 +02:00
Mike Fährmann
64dbc58a5a
[deviantart] update Eclipse API endpoints 2 (#4615) 2023-10-03 14:58:52 +02:00
Mike Fährmann
bb39779e1a
[deviantart] use private tokens for 'is_mature' posts (#4563) 2023-09-24 19:15:35 +02:00
Mike Fährmann
0c5d8b1505
[deviantart] re-add 'quality' option and 'intermediary' transform 2023-09-24 17:36:05 +02:00
Mike Fährmann
20d1683c47
[deviantart] fix JWT replacement (#293, #4548, #4563)
And again, a huge thank you to @Ironchest337
for discovering this.
2023-09-24 15:06:16 +02:00