Mike Fährmann
65b6011cc5
update test/test_extractor.py
2023-09-11 17:20:06 +02:00
Mike Fährmann
a453335a9f
remove test results in extractor modules
...
and add generic example URLs
2023-09-11 16:30:55 +02:00
Mike Fährmann
a833c244c8
add exported extractor results
2023-09-10 14:45:01 +02:00
Mike Fährmann
b611bf9629
fix '"' escapes
2023-09-09 22:36:23 +02:00
Mike Fährmann
28b79354fb
fix for categories containing '.'
...
Files with ':' in their name cannot be imported, as __import__()
will try to interpret them as submodules.
2023-09-09 22:34:03 +02:00
Mike Fährmann
c297745118
add -t and -c command-line arguments to export_tests.py
2023-09-09 19:52:26 +02:00
Mike Fährmann
8c0a656ccf
publish export_tests.py script
2023-09-06 18:42:20 +02:00
Mike Fährmann
1d2b5d0c60
update test comment positions
...
always put them above the test they're referring to
2023-09-06 18:16:09 +02:00
Mike Fährmann
93a7a89cf6
[formatter] use value of last alternative ( #4492 )
...
fixes {fieldname|''} evaluating to the value of 'keywords-default'
instead of an empty string
2023-09-05 17:53:27 +02:00
Mike Fährmann
f856987297
[subscribestar] fix preview detection ( #4468 )
...
and show a warning message when posts contain previews
2023-09-04 22:21:14 +02:00
Mike Fährmann
4c0b3d5dc5
[twitter] fix crash when 'sortIndex' is None ( #4499 )
2023-09-04 18:28:43 +02:00
Mike Fährmann
f2de70f254
[gfycat] remove module
2023-09-04 18:27:11 +02:00
Mike Fährmann
6eca1fab9b
[gelbooru_v02] support 'xbooru.com' ( #4493 )
2023-09-03 15:39:02 +02:00
Mike Fährmann
23bac772f2
[jpgfish] update domain to 'jpg1.su' ( #4494 )
2023-09-03 15:03:47 +02:00
Mike Fährmann
ceb59e176f
fix default Firefox user agent string
...
note to self: do not trust some random third-party website
2023-09-02 22:22:23 +02:00
Mike Fährmann
8259a5abe4
flake8
2023-09-02 13:03:11 +02:00
Mike Fährmann
0b6e5b8161
[hiperdex] send Referer headers during file downloads ( #4490 )
2023-09-02 12:59:30 +02:00
Mike Fährmann
a05821f8b4
[hiperdex] fix 'manga' metadata
...
remove trailing ' Manga'
2023-09-02 12:59:30 +02:00
Mike Fährmann
03d471a0d4
merge #4481 : [pixiv] handle errors for private novels
2023-09-02 12:50:23 +02:00
Mike Fährmann
3cb4cee502
merge #4489 : [bunkr] fix media domain for cdn-pizza.bunkr.ru
2023-09-02 12:47:44 +02:00
Cisney-Gassai
8c477f7146
[bunkr] Fixes media-files-pizza.bunkr.ru failed to resolve.
2023-09-02 01:45:59 -06:00
johnsmith1202gmail
c7e31b2724
Update pixiv.py
2023-08-30 12:42:31 -07:00
johnsmith1202gmail
d3046561d4
continue downloading when the item is made private on pixiv
2023-08-30 18:21:06 +00:00
Mike Fährmann
28798594e8
[gfycat] update pagination logic ( #4479 )
...
Some searches do not use cursor based pagination
but an offset based one.
2023-08-30 18:54:15 +02:00
Mike Fährmann
a783c4f0fe
[pornhub] add 'gif' support ( #4463 )
2023-08-29 19:34:27 +02:00
Mike Fährmann
ba842981af
[imagevenue] fix extraction ( #4473 )
2023-08-29 12:06:30 +02:00
Mike Fährmann
7defb24e1e
[reddit] provide video previews if available ( #4322 )
2023-08-28 22:22:10 +02:00
Mike Fährmann
fd65f27ede
[reddit] fix 'preview.redd.it' URLs ( #4470 )
2023-08-28 17:17:03 +02:00
Mike Fährmann
06aaedded5
[twitter] extract 'source' metadata ( #4459 )
2023-08-28 16:31:57 +02:00
Mike Fährmann
14af15bd18
[reddit] download preview for 404ed imgur links ( #4322 )
...
This is a pretty ugly hack as the internal infrastructure doesn't
really support switching from external URL to regular download in
case the former fails, but it kind of works ...
Can be disabled by setting 'reddit.fallback' to 'false'.
2023-08-24 15:41:05 +02:00
Mike Fährmann
d12a5e440a
update docs/supportedsites
2023-08-24 15:01:26 +02:00
Mike Fährmann
3a27150479
[instagram] add 'following' extractor ( #1848 )
2023-08-23 23:58:12 +02:00
Mike Fährmann
e0829ff0fd
[twitter] add 'date_original' metadata for retweets ( #4337 , #4443 )
2023-08-23 23:58:11 +02:00
Mike Fährmann
5ed245317d
[exhentai] add 'fav' option ( #4409 )
...
The name 'favorite' is already taken as extractor subcategory
2023-08-23 23:58:11 +02:00
Mike Fährmann
fd6b413f3c
[exhentai] fix 'domain' option ( #4458 )
...
regression from a383eca7
2023-08-23 23:58:04 +02:00
Mike Fährmann
fdfb22c91f
[instagram] fix video preview archive IDs ( #2135 , #4455 )
2023-08-23 12:29:32 +02:00
Mike Fährmann
92f98e6f5e
'sys.exit' -> 'SystemExit'
2023-08-21 23:46:39 +02:00
Mike Fährmann
410f783a33
implement 'subconfigs' option ( #4440 )
2023-08-21 21:18:40 +02:00
Mike Fährmann
2b88ad19e9
[twitter] accept 'x.com' URLs ( #4452 )
2023-08-21 19:47:07 +02:00
Mike Fährmann
c1c73c0b0e
[pp:ugoira] add '"framerate": "uniform"' ( #4421 )
2023-08-21 19:43:47 +02:00
Mike Fährmann
2a3acd318a
[pp:ugoira] fix high frame rates ( #4421 )
...
only return an output frame rate for non-uniform ugoira
when the frame delay gcd is >= 10, i.e. 100 fps
2023-08-21 19:17:14 +02:00
Mike Fährmann
70bdf32a88
[pp:ugoira] extend 'ffmpeg-output' ( #4421 )
...
- when setting this option to a string value,
pass -hide-banner and -loglevel to FFmpeg
- change default to "error"
2023-08-21 18:19:53 +02:00
Mike Fährmann
8dceea3384
[shimme2] move 'giantessbooru' back into shimmie module ( #4373 )
...
Do the same thing as for 'realbooru' and override 'posts()'
insteadd of using a separate module.
2023-08-18 15:25:28 +02:00
Mike Fährmann
6482f9453b
[behance] fix cookie usage ( #4417 )
2023-08-18 14:48:20 +02:00
Mike Fährmann
d34195b41d
[behance] fix and update 'user' extractor ( #4417 )
2023-08-17 16:06:35 +02:00
Mike Fährmann
4d3cf709da
[behance] add 'date' metadata field ( #4417 )
2023-08-17 15:33:47 +02:00
Mike Fährmann
c689cd9720
[behance] show error for mature content ( #4417 )
2023-08-17 15:31:37 +02:00
Mike Fährmann
33d912490f
merge #4419 : [bunkr] Fix extracting wmv files
2023-08-17 15:28:29 +02:00
Mike Fährmann
01610a6e9e
merge #4412 : [bunkr] fix media domain for cdn9
2023-08-17 15:18:49 +02:00
Mike Fährmann
b19d62263b
merge #4420 : [issuu] fix extraction
2023-08-17 15:17:09 +02:00
