Mike Fährmann
bfa5e61900
[patreon] add explicit 'image_large' file type ( #2257 )
...
to allow more control over when and if to download 'large_url' images
4fee3a0e52
2022-03-06 17:07:13 +01:00
Mike Fährmann
4fee3a0e52
[patreon] download 'large_url' images if available ( #2257 )
2022-02-17 18:23:59 +01:00
Mike Fährmann
7e6981dda6
rename 'disabletls12' to 'tls12'
...
and let config options override any default settings
2022-02-01 01:37:03 +01:00
Robert Pendell
4c651f6252
[patreon] Disable TLS 1.2 by default ( #2249 )
...
Disables TLS 1.2 on Patreon by default.
2022-01-30 23:30:44 +01:00
Mike Fährmann
6f2e0c9c3d
fix cookie checks for patreon, fanbox, fantia
...
The changes in 9a255344
2022-01-01 17:55:58 +01:00
Mike Fährmann
9a25534490
use Extractor._check_cookies() for all cookie checks
2021-12-16 02:21:16 +01:00
Mike Fährmann
211de95dd0
update extractor test results
2021-11-01 02:58:53 +01:00
Mike Fährmann
8d676151b7
[patreon] implement 'files' option ( #1935 )
2021-10-17 04:17:10 +02:00
Mike Fährmann
6695ef2e10
[patreon] better filenames for 'content' images ( #1954 )
2021-10-16 23:21:14 +02:00
Mike Fährmann
bd08ee2859
remove most 'yield Message.Version' statements
...
only leave them in oauth.py as noop results
2021-08-16 03:10:48 +02:00
Mike Fährmann
24dd10ac3c
[patreon] extract user defined 'tags' ( #1539 , closes #1540 )
2021-05-18 00:35:52 +02:00
Mike Fährmann
fe2ec9cf68
[patreon] reduce redirects when fetching campaign ID
2021-02-27 16:37:41 +01:00
Mike Fährmann
29ea54dc41
[patreon] use '"browser": "firefox"' by default ( #1117 )
2021-02-27 16:26:42 +01:00
Mike Fährmann
fbfcbcbf57
Merge branch '1.17.0'
2021-02-15 02:32:33 +01:00
Mike Fährmann
ba693d8686
[patreon] skip posts without view permission ( #1316 )
2021-02-14 16:03:11 +01:00
Mike Fährmann
56a8968435
remove 'Message.Metadata' ( #866 )
2021-01-31 02:12:37 +01:00
Mike Fährmann
968d3e8465
remove '&' from URL patterns
...
'/?&#' -> '/?#' and '?&#' -> '?#'
According to https://www.ietf.org/rfc/rfc3986.txt , URLs are
"organized hierarchically" by using "the slash ("/"), question
mark ("?"), and number sign ("#") characters to delimit components"
2020-10-22 23:31:25 +02:00
Mike Fährmann
f1344fe552
[patreon] yield images and attachments before postfiles ( #871 )
...
The reported filename of the 'postfile' entry of each post may differ
from the corresponding entry in the list of images or attachments,
and be outright "wrong".
2020-07-09 00:10:26 +02:00
Mike Fährmann
d5bfb0b38c
set pseudo extension for Metadata messages ( #865 )
...
This prevents pathfmt.filename from potentially being empty.
2020-07-04 22:14:39 +02:00
Mike Fährmann
6294e2c540
add 'text.ensure_http_scheme()'
2020-05-19 22:32:53 +02:00
Mike Fährmann
fc3e54275b
[patreon] respect filters and sort order in query params ( #711 )
2020-04-28 23:58:03 +02:00
Mike Fährmann
46b9a4d8ff
[patreon] improve hash extraction ( #693 , #713 )
...
Instead of accessing a specific part of a download URL, potentially
causing an exception if it doesn't exist, we're now searching through
all parts for a potential MD5 hash without ever raising an exception.
2020-04-28 21:47:18 +02:00
Mike Fährmann
233b6f93a2
[patreon] recognize URLs with creator IDs ( #711 )
...
e.g. https://www.patreon.com/user/posts?u= …
2020-04-26 22:19:10 +02:00
Mike Fährmann
08674a91f3
[patreon] fix hash extraction from download URLs ( closes #693 )
...
The old method was assuming every URL path ends with '/1'. For URLs
where this is not the case, the segment containing the post ID was
used as file hash.
2020-04-15 23:28:57 +02:00
Mike Fährmann
b9c574bd1d
[patreon] log skipped files ( #590 )
2020-02-11 19:01:07 +01:00
Mike Fährmann
109f6c8685
[patreon] filter duplicate files per post ( #590 )
2020-02-05 23:38:24 +01:00
Mike Fährmann
8c11e81c9f
Merge commit '63e6993716db8d8bedfb7b0d445c7161493046b6'
2019-12-16 17:25:23 +01:00
Mike Fährmann
63e6993716
merge 'bypost' functionality into metadata postprocessor
2019-12-16 17:19:23 +01:00
Mike Fährmann
0cd157300e
[patreon] fix regex pattern for posts
...
The previous one would match the first number in the URL slug as
post ID, which would fail for posts with numbers in their title.
2019-12-14 22:08:49 +01:00
Mike Fährmann
76e60d10a6
[patreon] raise proper exception if creator/post doesn't exist
2019-12-12 01:14:32 +01:00
Mike Fährmann
9e63804347
[patreon] make retrieving user info nonfatal ( #508 )
...
… and fall back to the included data if an error occurs.
2019-12-12 00:31:35 +01:00
Gio
c0b9ad678d
Separate metadata from handle_url into handle_metadata, commenting
2019-12-09 16:02:15 -06:00
Mike Fährmann
c9ef1b21c3
[patreon] get partial user info without /api/user/<id> ( #507 )
...
It's a lot less data, but doesn't invoke any additional
HTTP requests with potential Cloudflare CAPTCHAs.
2019-12-09 20:38:05 +01:00
Gio
cfc70a97ab
Added an additional channel for downloading the metadata of an entire post or gallery.
2019-12-09 00:56:27 -06:00
Mike Fährmann
6abe5f5bbb
[patreon] fix pagination ( #444 )
...
The Patreon-provided URLs for the next set of posts aren't
always complete, i.e. they can be missing their scheme and
the subsequent double slash: "www.patreon.com/…"
2019-10-12 22:30:51 +02:00
Mike Fährmann
51d10783fc
[patreon] include image info in API results ( #383 )
2019-08-18 23:28:47 +02:00
Mike Fährmann
b1728f512d
[patreon] support multi image posts and post URLs ( #383 )
2019-08-17 23:24:46 +02:00
Mike Fährmann
bb32a2d490
[patreon] use file extensions from original filenames ( #268 )
2019-05-20 15:46:59 +02:00
Mike Fährmann
ca3bad1779
[patreon] small fixes and adjustments ( #226 )
...
- fix datetime parsing
- rename 'user' to 'creator'
- convert 'id' to integer
- improve tests
2019-05-17 19:32:41 +02:00
Mike Fährmann
e82cadac61
[patreon] add extractors ( #226 )
2019-05-17 10:47:22 +02:00
