Mirrors/gallery-dl
1
0
Fork 0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-23 11:12:40 +01:00
Code Issues Releases Wiki Activity
5,267 Commits 6 Branches 164 Tags 16 MiB
da292ded4e
Commit Graph

103 Commits

Author SHA1 Message Date
Mike Fährmann
57fc6fcf83
replace '24*3600' with '86400' 
and generalize cache maxage values
 2023-12-18 23:57:22 +01:00
Mike Fährmann
92fbf09643
remove single quotes in some logging messages (#4908) 
('FileNotFoundError: [Errno 2] No such file or directory: ''')
->
(FileNotFoundError: [Errno 2] No such file or directory: '')
 2023-12-11 19:13:45 +01:00
Mike Fährmann
e256434c9e
use custom HTTPBasicAuth class 
to support LazyPrompt as password
and to generate the Authorization header only once
instead of for every request
 2023-12-07 01:40:31 +01:00
inty
b68aad3dab [reddit] implement Reddit Mobile share links 2023-10-22 10:38:05 +00:00
Mike Fährmann
8bb7243c10
[reddit] fix wrong previews (#4649) 
caused by a failed comment URL
using the main submission's preview as fallback

14af15bd
4963bb9b
 2023-10-10 18:33:01 +02:00
HRXN
ec91eeb7ef
Update gallery_dl/extractor/reddit.py 
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2023-09-26 14:00:29 +02:00
HRXN
66613c3a32
[reddit] ignore '/message/compose' URLs without www subdomain 2023-09-25 02:24:44 +02:00
Mike Fährmann
d7aac9fc06
[reddit] ignore '/message/compose' URLs (#4482) 2023-09-23 00:13:05 +02:00
Mike Fährmann
82296b1f05
[reddit] add 'previews' option (#4322) 
another way to disable this new behavior
 2023-09-22 18:10:44 +02:00
Mike Fährmann
4963bb9b30
[reddit] improve comment metadata v2 (#4482) 
provide main submission metadata at the top level
and comment metadata inside the 'comment' field,
i.e. the other way round than in 1710f1e9
 2023-09-20 22:12:40 +02:00
Mike Fährmann
27ec653991
fix bug in test_init and update example URLs 2023-09-14 13:27:03 +02:00
Mike Fährmann
6ae92da57e
Merge branch 'tests' 2023-09-13 21:34:28 +02:00
Mike Fährmann
1710f1e983
[reddit] improve comment metadata (#4482) 
- provide 'date'
- make metadata of the main submission available as 'submission[…]'
 2023-09-12 22:00:04 +02:00
Mike Fährmann
a453335a9f
remove test results in extractor modules 
and add generic example URLs
 2023-09-11 16:30:55 +02:00
Mike Fährmann
7defb24e1e
[reddit] provide video previews if available (#4322) 2023-08-28 22:22:10 +02:00
Mike Fährmann
fd65f27ede
[reddit] fix 'preview.redd.it' URLs (#4470) 2023-08-28 17:17:03 +02:00
Mike Fährmann
14af15bd18
[reddit] download preview for 404ed imgur links (#4322) 
This is a pretty ugly hack as the internal infrastructure doesn't
really support switching from external URL to regular download in
case the former fails, but it kind of works ...

Can be disabled by setting 'reddit.fallback' to 'false'.
 2023-08-24 15:41:05 +02:00
Mike Fährmann
d97b8c2fba
consistent cookie-related names 
- rename every cookie variable or method to 'cookies_*'
- simplify '.session.cookies' to just '.cookies'
- more consistent 'login()' structure
 2023-07-22 01:20:50 +02:00
Mike Fährmann
c6b31a2169
[reddit] set default 0.6s delay between requests (#4292) 
to limit API requests to 100 per minute
https://www.reddit.com/r/redditdev/comments/14nbw6g/
 2023-07-14 14:41:16 +02:00
Mike Fährmann
f079d9a703
[reddit] notify users about registering an oauth application 
(#4292, #4253, #3943)
 2023-07-12 21:43:00 +02:00
Mike Fährmann
94b6a67666
[reddit] fix crash with empty 'crosspost_parent_lists' (#4120) 2023-06-01 14:51:58 +02:00
Mike Fährmann
f8c4c5eef9
[reddit] simplify and add tests 2023-05-25 13:15:11 +02:00
Alexandru Vasilescu
d4f8b2fe22 fix: linter issues 2023-04-28 13:45:23 +03:00
Alexandru Vasilescu
1b918bd937 fix(extractor): fix extraction for cross-posted reddit videos and galleries 2023-04-28 13:13:25 +03:00
Mike Fährmann
3fc2223893
merge #3935: [reddit] match 'preview.redd.it' URLs 2023-04-21 20:09:20 +02:00
Mike Fährmann
202f5d86a7
[reddit] ignore 'id-max' value "zik0zj"/2147483647 
(#3939, #3862, #3697, #3606, #3546, #3521, #3412)
 2023-04-21 15:08:50 +02:00
ClosedPort22
cd4bfb0dd1
[reddit] match 'preview.redd.it' URLs 2023-04-20 15:54:09 +08:00
Mike Fährmann
da9840a39d
[reddit] update 'videos' option (#3712) 
- add 'dash' to directly extract DASH manifest URLs
  (was default behavior since a7c79531)
- change default strategy back to before a7c79531
- disable 'Falling back on generic information extractor' warning
 2023-03-06 12:18:25 +01:00
Mike Fährmann
2952add4a8
[reddit] increase 'id-max' default value (#3397) 
to float("inf")
 2022-12-12 12:10:06 +01:00
Steven Docherty
a7c7953107
[reddit] use 'dash_url' for videos (#3258) (#3306) 
* use fallback_url for reddit_video to fix issue 3258

* changed to dash_url to include audio

* update

- use [] instead of .get
- catch TypeErrors in case one of the elements is not a dict

Co-authored-by: InterruptSpeed <steven@docherty.ca>
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2022-11-27 14:09:55 +01:00
Mike Fährmann
35eddaa94e
[reddit] prevent exception with empty submission URLs (#2913) 2022-09-14 16:14:42 +02:00
Mike Fährmann
d4e9d51760
[reddit] add 'home' extractor (#2614) 2022-05-26 15:28:33 +02:00
Ailothaen
203a04a4a3
[reddit] Support of standalone submissions on personal pages of users (#2301) 
* [reddit] Support of submissions on personal pages of users

* [reddit] Design improvement for user submissions

* [reddit] Removed functions declared twice
 2022-02-13 23:03:46 +01:00
Mike Fährmann
2d34d8ff8b
[reddit] allow downloading from quarantined subreddits (#2180) 2022-01-14 21:55:59 +01:00
Mike Fährmann
1fac74b14d
[reddit] prevent crash for galleries with no 'media_metadata' 
(fixes #2001)
 2021-11-03 17:55:40 +01:00
Mike Fährmann
e93360e45d
[reddit] extend subcategory depending on input URL (closes #1836) 
- https://www.reddit.com/r/lavaporn/
  -> 'subreddit'

- https://www.reddit.com/r/lavaporn/new/
  -> 'subreddit-new'

- https://www.reddit.com/user/username/
  -> 'user'

- https://www.reddit.com/user/username/gilded/
  -> 'user-gilded'
 2021-09-10 20:44:17 +02:00
Mike Fährmann
8cd7759682
[reddit] cleanup ReddeitAPI.__init__ (#1813) 
- remove warning about 'client-id'/'user-agent' mismatch
- only use 'user-agent' from config for custom 'client-id'
 2021-08-31 17:08:02 +02:00
Mike Fährmann
0a94fe5774
[reddit] delay RedditAPI initialization (#1813) 
Move it outside the constructor so that eventual exceptions can get
caught in the expected places.
 2021-08-30 22:39:40 +02:00
Mike Fährmann
bd08ee2859
remove most 'yield Message.Version' statements 
only leave them in oauth.py as noop results
 2021-08-16 03:10:48 +02:00
Mike Fährmann
102c482f5e
[reddit] skip invalid/failed gallery items (fixes #1127) 2020-11-21 17:34:38 +01:00
Mike Fährmann
968d3e8465
remove '&' from URL patterns 
'/?&#' -> '/?#' and '?&#' -> '?#'

According to https://www.ietf.org/rfc/rfc3986.txt, URLs are
"organized hierarchically" by using "the slash ("/"), question
mark ("?"), and number sign ("#") characters to delimit components"
 2020-10-22 23:31:25 +02:00
Mike Fährmann
76dfa11a65
[reddit] add 'date' metadata field (closes #1068) 2020-10-16 15:48:04 +02:00
Mike Fährmann
d4ff767291
[reddit] improve gallery extraction (fixes #955) 2020-08-23 22:06:06 +02:00
Mike Fährmann
a57b6b3c3a
[reddit] handle deleted galleries (fixes #953) 2020-08-20 20:14:07 +02:00
Mike Fährmann
60ba3cb946
[reddit] support gallery posts (closes #920) 2020-08-03 22:06:15 +02:00
Mike Fährmann
5a6e750704
[reddit] fix AttributeError when using 'recursion' (fixes #879) 2020-07-09 19:19:05 +02:00
Mike Fährmann
94a08f0bcb
[reddit] limit title length in default filenames (#873) 2020-07-09 18:19:33 +02:00
Mike Fährmann
be04e44e2c
[reddit] catch JSON decode errors (#765) 2020-06-11 18:32:52 +02:00
Mike Fährmann
dfcf2a2c91
write OAuth token to cache by default (#616) 2020-05-25 22:35:45 +02:00
Mike Fährmann
0bf0146bfe
[reddit] don't send OAuth headers for file downloads (fixes #729) 2020-05-08 21:42:52 +02:00