1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-23 03:02:50 +01:00
Commit Graph

5071 Commits

Author SHA1 Message Date
Mike Fährmann
e0829ff0fd
[twitter] add 'date_original' metadata for retweets (#4337, #4443) 2023-08-23 23:58:11 +02:00
Mike Fährmann
5ed245317d
[exhentai] add 'fav' option (#4409)
The name 'favorite' is already taken as extractor subcategory
2023-08-23 23:58:11 +02:00
Mike Fährmann
fd6b413f3c
[exhentai] fix 'domain' option (#4458)
regression from a383eca7
2023-08-23 23:58:04 +02:00
Mike Fährmann
fdfb22c91f
[instagram] fix video preview archive IDs (#2135, #4455) 2023-08-23 12:29:32 +02:00
Mike Fährmann
92f98e6f5e
'sys.exit' -> 'SystemExit' 2023-08-21 23:46:39 +02:00
Mike Fährmann
410f783a33
implement 'subconfigs' option (#4440) 2023-08-21 21:18:40 +02:00
Mike Fährmann
2b88ad19e9
[twitter] accept 'x.com' URLs (#4452) 2023-08-21 19:47:07 +02:00
Mike Fährmann
c1c73c0b0e
[pp:ugoira] add '"framerate": "uniform"' (#4421) 2023-08-21 19:43:47 +02:00
Mike Fährmann
2a3acd318a
[pp:ugoira] fix high frame rates (#4421)
only return an output frame rate for non-uniform ugoira
when the frame delay gcd is >= 10, i.e. 100 fps
2023-08-21 19:17:14 +02:00
Mike Fährmann
70bdf32a88
[pp:ugoira] extend 'ffmpeg-output' (#4421)
- when setting this option to a string value,
  pass -hide-banner and -loglevel to FFmpeg
- change default to "error"
2023-08-21 18:19:53 +02:00
Mike Fährmann
8dceea3384
[shimme2] move 'giantessbooru' back into shimmie module (#4373)
Do the same thing as for 'realbooru' and override 'posts()'
insteadd of using a separate module.
2023-08-18 15:25:28 +02:00
Mike Fährmann
6482f9453b
[behance] fix cookie usage (#4417) 2023-08-18 14:48:20 +02:00
Mike Fährmann
d34195b41d
[behance] fix and update 'user' extractor (#4417) 2023-08-17 16:06:35 +02:00
Mike Fährmann
4d3cf709da
[behance] add 'date' metadata field (#4417) 2023-08-17 15:33:47 +02:00
Mike Fährmann
c689cd9720
[behance] show error for mature content (#4417) 2023-08-17 15:31:37 +02:00
Mike Fährmann
33d912490f
merge #4419: [bunkr] Fix extracting wmv files 2023-08-17 15:28:29 +02:00
Mike Fährmann
01610a6e9e
merge #4412: [bunkr] fix media domain for cdn9 2023-08-17 15:18:49 +02:00
Mike Fährmann
b19d62263b
merge #4420: [issuu] fix extraction 2023-08-17 15:17:09 +02:00
ClosedPort22
6dc8be5e48
[issuu] fix extraction 2023-08-13 21:13:50 +08:00
Luc Ritchie
85a070b9e6
[bunkr] Fix extracting wmv files 2023-08-12 16:53:14 -04:00
Mike Fährmann
3f8ff692a7 [bunkr] fix media domain for cdn9
Fixes #4386
2023-08-11 18:14:47 -04:00
Mike Fährmann
d8b21a97bf
[formatter] use 'rpartition' for \fM format strings
fixes using absolute module paths like C:\path\module.py on Windows
2023-08-11 22:29:33 +02:00
Mike Fährmann
84089c7368
[docs] add note about 'path-restrict' implementation
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1671892152
2023-08-11 18:00:11 +02:00
Mike Fährmann
d319777a24
[tests] skip 'test_init_ytdl' on Python<3.6
It passes without error in a Python 3.4/3.5 venv on my own machine,
but fails for some inexplicable reason on Github Actions.
2023-08-10 23:34:49 +02:00
Mike Fährmann
f9fb276e81
[postprocessor] add 'prepare-after' event (#4083) 2023-08-10 21:28:48 +02:00
Mike Fährmann
0ef1fcab20
[postprocessor] update 'finalize' events
Add 'finalize-error' and 'finalize-success' events that trigger
depending on whether error(s) did or did not happen.

'finalize' itself now always triggers regardless of error status.
(was supposed to have the same behavior as the new 'finalize-success')
2023-08-10 19:46:37 +02:00
Mike Fährmann
af4bdb62a7
merge #4403: [downloader:http] close connection when file already exists 2023-08-10 18:35:13 +02:00
Mike Fährmann
15275b3524
[postprocessor:ugoira] restore 'libx264-prevent-odd' (#4407)
was accidentally removed in commit be9547a5
2023-08-10 18:32:52 +02:00
Mike Fährmann
391a7d74c8
[giantessbooru] fix and move to separate module (#4373)
too many differences to the other shimmie2 sites
2023-08-09 18:36:56 +02:00
ClosedPort22
5448268d5c
[downloader:http] close connection when file already exists (#3748) 2023-08-08 23:35:43 +08:00
Mike Fährmann
3963dbe5e4
extend 'parent>child' categories
continuation of ed21908f

allow for children to have an arbitrary distance from their parent,
e.g. reddit -> danbooru -> imgur:gallery -> imgur:album
would still be covered by 'reddit>imgur' or even 'danbooru>imgur'
2023-08-07 23:22:12 +02:00
Mike Fährmann
089d1a4f67
[twitter] fix 'TweetWithVisibilityResults' (#4369) 2023-08-06 22:08:50 +02:00
Mike Fährmann
a4f7f7da17
add '_dump()' convenience method to Extractor 2023-08-06 17:03:09 +02:00
Mike Fährmann
df5c7ee03e
[deviantart] fix search (#4384)
send correct usernames instead of 'u'
2023-08-04 17:16:04 +02:00
Mike Fährmann
a60db454af
[sankaku] update/fix API headers
'Referer' and 'Origin' were both empty
2023-08-04 17:14:43 +02:00
Mike Fährmann
fb3f0453db
[twitter] improve error messages for single Tweets (#4369)
also fixes '"quoted": false' not having any effect
2023-08-03 22:02:07 +02:00
Mike Fährmann
541bff5a37
[pururin] fix extraction (#4375)
- rename 'title_jp' to 'title_ja'
- change type of 'collection', 'convention',  and 'scanlator' to list
2023-08-03 14:40:44 +02:00
Mike Fährmann
6a87c314af
[instagram] fix private posts with long shortcodes (#4362) 2023-08-03 13:51:03 +02:00
Mike Fährmann
f899fac4c5
[giantessbooru] fix extraction (#4373)
This does not fix anything Cloudflare related,
just other things caused by a site update.
2023-08-03 13:40:11 +02:00
Mike Fährmann
136283d402
[shimmie2] update base URL pattern
to match new giantessbooru URLs
2023-08-03 13:34:48 +02:00
Mike Fährmann
9d67655397
add "ascii+" as a special 'path-restrict' value (#4371) 2023-08-01 19:33:53 +02:00
Mike Fährmann
c79359eb3a
[fantia] improve metadata extraction (#4126)
extract all metadata and URLs before starting to download
2023-07-31 22:31:50 +02:00
Mike Fährmann
d50c312ff0
prevent test failure when there's no 'ytdl' module (#4364)
split of ytdl into its own test function and
skip it when there's an ImportError similar to test_ytdl.py
2023-07-29 13:48:31 +02:00
Mike Fährmann
48ef062867
fix issues with 'Extractor.finalize()'
- prevent crash in InstagramUserExtractor (#4359)
- call it at the end of every DownloadJob
- add it to tests
2023-07-29 13:43:27 +02:00
Mike Fährmann
ed21908fda
initial support for child extractor options
Using "parent-category>child-category" as extractor category in a config
file allows to set options for a child extractor when it was spawned by
that parent.

For example "reddit>gfycat" to set gfycat options for when it was found
in a reddit post.

{
    "extractor": {
        "gfycat": {
            "filename": "regular filename"
        },
        "reddit>gfycat": {
            "filename": "reddit-specific filename"
        }
    }
}

Note: This does currently not work for most imgur links due to how its
extractor hierarchy is structured.
2023-07-28 17:07:25 +02:00
Mike Fährmann
255d08b79e
add test for 'Extractor.initialize()' (#4359) 2023-07-28 16:58:16 +02:00
Mike Fährmann
2bcf0a4c49
[instagram] fix initialization order (#4359)
regression caused by the changes in a383eca7
2023-07-28 14:25:37 +02:00
Mike Fährmann
7eab101144
[acidimg] fix extraction
swap ' and " again (2e309a13)
and add a fallback in case this happens yet another time
2023-07-28 14:23:11 +02:00
Mike Fährmann
62fce6a75f
[imagehosts] adjust variable names (#4358)
prefix them with underscores to prevent a clash
with the new 'self.cookies' from d97b8c2f
2023-07-28 14:18:47 +02:00
Mike Fährmann
e8299b459a
[moebooru] match search URLs with empty 'tags' (#4354) 2023-07-26 18:02:26 +02:00