1
0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-23 19:22:32 +01:00
Commit Graph

3405 Commits

Author SHA1 Message Date
Mike Fährmann
99cb28724f
delay directory creation (#2461, #2474)
Only call os.makedirs() when an open() call
fails with a FileNotFoundError

Might cause errors with some post processors etc,
but for now I was unable to find any.
2022-05-04 17:42:53 +02:00
Mike Fährmann
4c8e28db82
avoid circular import in util.py 2022-05-04 17:42:37 +02:00
Mike Fährmann
4598d32370
[imgur] prevent exception for empty albums (closes #2557) 2022-05-04 17:34:50 +02:00
Mike Fährmann
435e9c5d2e
[vk] report errors for private albums (#2556) 2022-05-04 17:34:50 +02:00
Mike Fährmann
9adea93aef
[pixiv] updates to avatar/background extractors (#2495)
- add 'date' metadata to avatar/background files when available
  and use that in default filenames / archive ids
- remove deprecation warnings as their option names clash with
  subcategory names
2022-05-04 17:30:54 +02:00
Mike Fährmann
3e6aba05ab
[vk] add fallback for user ID extraction (#2535) 2022-05-03 13:42:45 +02:00
Mike Fährmann
61887c895b
implement 'output.colors' options (#2532) 2022-05-02 12:41:14 +02:00
Mike Fährmann
52b47c3cf9
[gelbooru_v01] add 'favorite' extractor (#2546) 2022-05-02 11:33:28 +02:00
Mike Fährmann
5b7423d14c
[vk] fix URLs for older photos (#2535) 2022-05-02 11:19:18 +02:00
Mike Fährmann
3346f58a2a
[twitter] use twMediaDownloader strategy for user URLs
- use media timeline + search for default user URLs like
  https://twitter.com/SCREEN_NAME
- fetches all/most media for the type of twitter URL that most users
  use with gallery-dl
- can be disabled by setting 'strategy' to any truthy value,
  like "timeline"
2022-05-02 09:03:35 +02:00
Mike Fährmann
84756982e9
[pixiv] implement 'include' option
- split 'user' extractor and its 'avatar' and 'background' options into
  separate extractors ('artworks', 'avatar', 'background')
- avatars can now be downloaded with
  https://www.pixiv.net/en/users/ID/avatar
  as URL and will use a proper archive key; similar for backgrounds
- options for the 'user' subcategory must be moved to 'artworks' to have
  the same effect as before
2022-05-02 09:03:35 +02:00
Mike Fährmann
d11e2191ae
[nijie] support /history_nuita.php listings (closes #2541) 2022-05-02 09:03:34 +02:00
Mike Fährmann
4aca29b7b4
[naverwebtoon] support (best)challenge comics (closes #2542)
and update URL pattern to match URLs without '.nhn'
2022-05-02 09:03:34 +02:00
Mike Fährmann
3e926bd465
[realbooru] fix extraction (fixes #2530) 2022-05-02 09:03:34 +02:00
Mike Fährmann
82eee72b39
[pixiv] update API interface
- start all endpoints with '/'
- use extractor.wait() for rate limit
- retry with while loop instead of recursion
- in case of error, write entire response to debug log
2022-05-02 09:03:34 +02:00
Mike Fährmann
1bc77efa02
[artstation] use "browser": "firefox" by default (#2527) 2022-05-02 09:03:13 +02:00
Mike Fährmann
a39e7b7366
[vk] handle photos without width/height info (fixes #2535) 2022-05-02 09:03:00 +02:00
Mike Fährmann
9e6c981388
replace '\f' in --filename arguments with form feed character
to make it easier to use special type format strings on command-line

(#2396)
2022-04-28 21:54:05 +02:00
Mike Fährmann
61afa973b7
use extended format strings for archive keys 2022-04-28 20:26:12 +02:00
Mike Fährmann
1c95530525
release version 1.21.2 2022-04-27 22:53:18 +02:00
Federico Ravasio
0381752575
[photovogue] switch to .com, update api endpoint (#2494) 2022-04-27 22:37:53 +02:00
Mike Fährmann
3f02e483c6
[e621] fix applying request_interval_min (#2533)
Setting this property after calling Extractor.__init__() has no effect.
2022-04-27 21:10:34 +02:00
Mike Fährmann
ca3a364db7
fix build_duration_func() (#2533)
for extractors with request_interval_min > 0
2022-04-27 20:28:14 +02:00
Mike Fährmann
afde76269c
[weibo] fix infinite retries for deleted accounts (fixes #2521) 2022-04-27 20:23:11 +02:00
Mike Fährmann
d85e66bcac
[vk] fix extraction (#2512)
Use a different API endpoint, since thumbnail URLs from the old one
cannot be transformed into URLs for "original" photos anymore.
2022-04-21 14:01:50 +02:00
Mike Fährmann
9e6ff42a9d
[pixiv] implement 'background' option (#623, #1124, #2495) 2022-04-21 13:53:02 +02:00
Mike Fährmann
dc22a47c99
[postprocessor:ugoira] report errors with ffmpeg/mkvmerge (#2487) 2022-04-18 18:40:28 +02:00
Mike Fährmann
4d1896830f
[mangadex] download chapters with 'externalUrl' (fixes #2503)
if the have pages hosted on mangadex
2022-04-18 18:09:52 +02:00
Mike Fährmann
97e8a15295
[deviantart] implement 'pagination' option (#2488) 2022-04-18 18:08:01 +02:00
Mike Fährmann
1f9a0e2fd8
update extractor test results 2022-04-18 17:24:00 +02:00
Mike Fährmann
ad5a4b1756
[twitter] fix various syndication issues
- handle retweets
- fix videos without dimensions in URL (3e942a58)
- fix '"retweets": "self"' filter (#2499)
2022-04-15 20:49:26 +02:00
Mike Fährmann
12bd9ba33a
[readcomiconline] add 'quality' option (#2467) 2022-04-15 18:10:37 +02:00
Mike Fährmann
60ad46ddcc
[readcomiconline] unobfuscate image URLs (#2481) 2022-04-15 18:04:09 +02:00
Mike Fährmann
a6c4ff58fb
[cyberdrop] match cyberdrop.to URLs (closes #2496) 2022-04-15 15:39:29 +02:00
Mike Fährmann
13ed18b9aa
[lolisafe] fix typo
LolisafelbumExtractor -> LolisafeAlbumExtractor
2022-04-15 15:02:30 +02:00
Mike Fährmann
24ea1398bc
[postprocessor:ugoira] do not auto-select image2 demuxer (#2492) 2022-04-12 21:47:47 +02:00
Mike Fährmann
3e942a58be
[twitter] improve syndication video selection (#2354)
- ignore .m3u8 manifests
- always select largest format
2022-04-11 17:06:10 +02:00
Mike Fährmann
0794027100
[issuu] fix extraction (#2483) 2022-04-10 14:23:10 +02:00
Mike Fährmann
5d5a08cc69
[sexcom] add fallback for empty files (#2485) 2022-04-10 14:22:07 +02:00
Mike Fährmann
3524c599b8
[postprocessor:ugoira] use compatible paths with mkvmerge (#2487) 2022-04-10 13:26:15 +02:00
Mike Fährmann
c5be28b2e9
release version 1.21.1 2022-04-08 20:54:06 +02:00
Mike Fährmann
7fe54bab2a
attempt to fix some issues with 'contains()' (#2446)
add a third argument that gets used
when the values o search are given as a string
2022-04-08 14:40:26 +02:00
thatfuckingbird
4527a35aba
[twitter] accept fxtwitter.com URLs (#2484) 2022-04-08 14:32:08 +02:00
Mike Fährmann
c1768972c2
[newgrounds] update and fix pagination (#2456) 2022-04-07 15:38:41 +02:00
Mike Fährmann
d78a2c7163
re.escape() arguments for 'contains()' (#2446) 2022-04-07 15:35:54 +02:00
Mike Fährmann
78e5d0c423
[kissgoddess] extract all images (closes #2473)
and not only the first two per page
https://github.com/mikf/gallery-dl/issues/1052#issuecomment-1047367383
2022-04-06 21:28:40 +02:00
Mike Fährmann
0b33435da5
[pinterest] support multiple files per pin (closes #1619, #2452) 2022-04-06 21:21:33 +02:00
Mike Fährmann
9c5d2d7af3
[pinterest] add extractor for created pins (#2452) 2022-04-01 16:59:58 +02:00
Mike Fährmann
1171911dc3
[twitter] add 'syndication' option (#2354)
to fetch age-restricted content using Twitter's  syndication API
2022-04-01 16:56:47 +02:00
Mike Fährmann
a53cfc845e
[newgrounds] warn about age-restricted posts (#2456) 2022-03-30 16:18:33 +02:00