Mirrors/gallery-dl
1
0
Fork 0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-23 19:22:32 +01:00
Code Issues Releases Wiki Activity
3,761 Commits 6 Branches 164 Tags 16 MiB
6db77d4656
Commit Graph

2737 Commits

Author SHA1 Message Date
Mike Fährmann
6db77d4656
[weibo] support '?tabtype=video' listings (#2601) 2022-06-12 17:55:23 +02:00
Mike Fährmann
1da3ccf608
[twitter] implement 'expand' option (#2665) 2022-06-12 17:26:51 +02:00
Mike Fährmann
0add1fc090
[twitter] improve strategy for user URLs (#2665) 
- use '/with_replies' when appropriate
- consider 'text-tweets'
- build search query as necessary
 2022-06-12 17:24:53 +02:00
Mike Fährmann
45c980daf0
[weibo] fix retweets (#2601) 2022-06-11 15:30:26 +02:00
Mike Fährmann
ae1b24aa6a
[instagram] automatically invalidate expired login sessions 2022-06-10 22:43:11 +02:00
Mike Fährmann
47a92c8c7e
[instagram] provide 'date' for 'carousel_media' files (#2660) 2022-06-07 15:11:49 +02:00
Mike Fährmann
2064f20e11
[instagram} fix 'tag' extractor (#2659) 2022-06-06 14:30:44 +02:00
Mike Fährmann
6c0fa2f258
[readcomiconline] update 2022-06-05 21:40:08 +02:00
Mike Fährmann
61cbf8318c
[weibo] fix URLs generated by 'user' extractor (#2601) 2022-06-05 21:37:57 +02:00
Mike Fährmann
4b78bd423f
[paheal] add 'metadata' option (#2641) 2022-06-04 16:05:49 +02:00
Mike Fährmann
535cbcb185
cache extracted browser cookies 
(in memory, for as long as gallery-dl is running)

Extracting encrypted cookies from a chromium-based browser can take a
long time, so repeating this process for each extractor should be
avoided.

Same goes for creating a temporary copy of the entire cookie database.
 2022-06-04 12:38:38 +02:00
Mike Fährmann
541a61d344
[subscribestar] fix 'date' metadata (#2642) 
Handle instances where the actual datetime information
is preceded by "Updated on "
 2022-06-04 12:24:08 +02:00
Mike Fährmann
46d171c938
[instagram] fix stories (#2644) 
fixing the fix ...
 2022-06-03 19:01:32 +02:00
Mike Fährmann
e59bcb8437
[weibo] ensure media URLs use https:// 2022-06-03 17:37:57 +02:00
Mike Fährmann
73f673e3ca
[weibo] handle 'gif' pictures 2022-06-03 17:33:14 +02:00
Mike Fährmann
345199a3ec
[pixiv] include '.gif' in background fallback URLs (#2495) 2022-06-03 17:25:23 +02:00
Mike Fährmann
57508d3bb7
[weibo] support all different 'tabtype' listings (#686, #2601) 2022-06-03 16:36:22 +02:00
Mike Fährmann
2687ef6bd9
[nozomi] remove slashes from search terms (fixes #2653) 2022-06-02 22:17:15 +02:00
Mike Fährmann
ee7cea888e
[instagram] 
it is now possible to use 'id:…' instead of a user's screen name:
- https://www.instagram.com/instagram/
- https://www.instagram.com/id:25025320/

similar to the same functionality for twitter:
a3b473bd2f

for /tagged/ URLs, using a user ID will only have 'tagged_owner_id'
defined. 'tagged_username' and 'tagged_full_name', which are available
when using a screen name, will not be defined.
 2022-06-02 21:49:09 +02:00
Mike Fährmann
d0dc29f312
[instagram] fix stories (#2644) 2022-06-02 13:14:19 +02:00
Mike Fährmann
2fb01938f4
[instagram] fix and update extractors (#2644) 
- use different way to fetch user IDs
- use new API endpoints for /tagged/ and single posts
 2022-06-01 22:05:45 +02:00
Mike Fährmann
05d4a0215a
[sankaku] extend URL patterns (fixes #2647) 
- support URLs with ISO 639-1 language codes
- support black.… and white.… subdomains
 2022-06-01 21:31:11 +02:00
Mike Fährmann
e0ac358aa5
[gofile] fix 401 Unauthorized errors (#2632) 2022-06-01 13:02:34 +02:00
Mike Fährmann
8a42d859bf
[bunkr] change domain to 'app.bunkr.is' (#2634) 2022-06-01 11:30:27 +02:00
Mike Fährmann
7a9cba9c10
[weibo] add support for usernames in URLs (#1662) 2022-05-31 22:48:34 +02:00
Mike Fährmann
4bf5bc2403
[weibo] support 'livephoto' entries (#2146) 2022-05-31 15:35:24 +02:00
Mike Fährmann
a0692818af
[weibo] switch to desktop API (#2601) 2022-05-31 12:46:35 +02:00
Mike Fährmann
61fa9b535a
[paheal] improve metadata extraction (#2641) 
- unescape 'tags'
- add 'date', 'source', and 'uploader' for single posts
 2022-05-30 17:23:08 +02:00
Mike Fährmann
415c208c1f
[gfycat] cleanup 2022-05-29 15:24:23 +02:00
Mike Fährmann
a80ba17ed4
[gfycat] add 'collections' extractor (#2629) 2022-05-29 14:39:08 +02:00
Mike Fährmann
ff5e10a86d
[hypnohub] move to gelbooru_v02 instances (#2631) 2022-05-28 21:10:05 +02:00
Mike Fährmann
d6e744bf0f
[gfycat] add 'collection' extractor (#2629) 2022-05-28 16:53:27 +02:00
Mike Fährmann
4f7fe9b4be
[deviantart] fix folder listings with 'pagination: manual' 
(#2488)
 2022-05-27 18:41:06 +02:00
Mike Fährmann
310fee99d5
[readcomiconline] remove automatic 'browser' setting (#2625) 2022-05-27 13:44:28 +02:00
Mike Fährmann
d4e9d51760
[reddit] add 'home' extractor (#2614) 2022-05-26 15:28:33 +02:00
Infinitay
f54525573b
[Instagram] Add tagged_users to keywords for stories (#2582) (#2584) 2022-05-25 17:02:42 +02:00
thatfuckingbird
da0696e1f5
recognize vxtwitter URLs (#2621) 2022-05-25 17:01:58 +02:00
Mike Fährmann
dcb580240d
[twitter] extract alt texts as 'description' (closes #2617) 2022-05-24 12:37:38 +02:00
Mike Fährmann
915dba8345
[twitter] improve results for regular user URLs 
- continuation of 3346f58a
- use media timeline results (or tweet timeline if retweets are enabled)
  plus search results starting from the last tweet id of the first
  timeline, similar to how Twitter Media Downloader operates
- the old behavior can be forced by appending '/tweets' to a user URL,
  like with '/media' (https://twitter.com/USER/tweets)
  although there should be no need to ever do that
 2022-05-23 18:33:52 +02:00
Mike Fährmann
9df4e0f65b
[twitter] disable 'cards' by default 2022-05-21 15:39:25 +02:00
Mike Fährmann
79dce8ae68
[weasyl] implement 'metadata' option (#2610) 2022-05-20 22:32:35 +02:00
Mike Fährmann
9d5580a091
[khinsider] fix metadata extraction (closes #2611) 2022-05-20 20:00:39 +02:00
Mike Fährmann
688d6553b4
replace calls to print() with stdout_write() (#2529) 2022-05-19 17:09:24 +02:00
Mike Fährmann
86cbf485ab
[webtoons] extract real episode number (#2591) 
The number from the 'episode_no' query parameter
got renamed to 'episode_no'.
 2022-05-17 22:33:29 +02:00
Mike Fährmann
82c1cc130b
[readcomiconline] update deobfuscation code (#2481) 2022-05-17 10:52:45 +02:00
Mike Fährmann
4005171db3
[pixiv] provide more metadata fields when option enabled (#2594) 2022-05-15 14:47:14 +02:00
Mike Fährmann
c8abb16c60
[mangahere] send Referer headers (#2592) 2022-05-15 14:41:16 +02:00
Mike Fährmann
3fd9249717
[mangafox] send Referer headers (#2592) 2022-05-15 14:41:16 +02:00
Mike Fährmann
90d28387ef
[instagram] detect empty story listings faster 2022-05-15 14:41:03 +02:00
Mike Fährmann
bd6ec5c352
[foolfuuka] match 4chan filenames (#2577) 
introduce two new metadata fields:
- filename_media: original filename of file uploaded to 4chan
- timestamp_ms  : timestamp with millisecond precision (tim)
 2022-05-15 14:39:54 +02:00