Mike Fährmann
c82f3db098
[common] add 'proxy-env' option
...
(#6134 , #6455 )
disable using environment proxies by default
2024-11-15 18:03:56 +01:00
Mike Fährmann
e763efd36c
[bilibili] add workarounds for getting rate-limited ( #6443 )
...
- set 3-6 second request_interval by default
- retry request after waiting 5 minutes
2024-11-14 23:06:26 +01:00
Mike Fährmann
0b99d9e6b9
[util] add "defaultdict" filters-environment
...
allows accessing undefined values without raising an exception,
but preserves other errors like TypeError, AttributeError, etc
2024-11-14 22:47:25 +01:00
Mike Fährmann
a3276e3b5d
[hentaifoundry] add 'tag' extractor ( #6465 )
2024-11-13 20:56:37 +01:00
Mike Fährmann
82d561e825
[bilibili] update
...
- use self.groups[…] to access matched values
- extract more metadata (count, width, height, size)
- remove type hint
- add tests
- update docs/supportedsites
2024-11-10 17:59:24 +01:00
Mike Fährmann
9e72968154
add '-4/--force-ipv4' and '-6/--force-ipv6' command-line options
2024-11-08 16:37:14 +01:00
Mike Fährmann
6205e255f4
merge #6394 : [tumblr] add 'search' extractor
2024-11-08 08:17:46 +01:00
Mike Fährmann
0b3ddd01af
[hiperdex] update domain to 'hipertoon.com' ( #6420 )
...
and fix 'description' extraction
2024-11-05 15:54:42 +01:00
Mike Fährmann
9afbe91f82
[rule34xyz] add 'format' option ( #1078 )
2024-11-05 15:45:52 +01:00
Mike Fährmann
cb0d8cae77
merge #6227 : [everia] add support ( #1067 , #2472 , #4091 )
2024-11-03 17:52:17 +01:00
Mike Fährmann
cea062ffc5
[everia] update
...
- implement general _pagination method
- simplify code
- adjust URL patterns
- update test results
2024-11-03 17:51:04 +01:00
missionfloyd
d31a3b5da3
[everia.club] Add support
...
- Unescape title and URL
- Add tags and categories metadata
Lookup tag id with API instead of downloading tag page
- Add category extractor
- Add tests
- Rename EveriaExtractor to EveriaPostExtractor
- Fix EveriaPostExtractor example
- Lookup tags/categories by post id
- Add date extractor
- Remove leftover pages parameter
- Add error handling for invalid dates.
- Add filename numbering
Parse date
- Rename extract() to images()
- Remove html import
- Fix search/date URLs with page number
- Fix tag/category search
- Fix post extractor
- Fix tag, category extractors
- Fix search extractor
- Only load first page once
- Fix date extractor
- Fix tests
- Clean up search extractor
2024-11-03 14:09:07 +01:00
Mike Fährmann
d787c0c4ea
[rule34xyz] add support ( #1078 , #4960 )
2024-11-03 10:12:26 +01:00
Mike Fährmann
b92edb4614
[boosty] update default video format list ( #2387 )
2024-10-31 20:55:32 +01:00
Mike Fährmann
f79e57b71e
[dl:ytdl] change 'forward-cookies' default to 'true' ( #6401 , #6348 )
...
revert dba87ca99e
2024-10-31 17:35:08 +01:00
Mike Fährmann
6f54328a39
[hitomi] update
...
- remove f-strings
- fix flake8 warnings
- move tests to test/results/hitomi.py
2024-10-29 16:56:52 +01:00
Allen
0f94fa9015
[tumblr] search extractor minimal styling changes
2024-10-29 13:06:23 +01:00
Mike Fährmann
655e42dc92
merge #6240 : [rule34vault] add support ( #5708 )
2024-10-28 22:31:05 +01:00
ssdaniel24
3d0263b3ab
[rule34vault] Added initial support for rule34vault.com
...
- Added playlists support for rule34vault
- Added support for posts in rule34vault
- Fixed supported sites with script
- Fixed posts pattern in rule34vault
- Added tests for rule34vault
- Clean
- Fixed lint warnings
2024-10-28 22:26:47 +01:00
Mike Fährmann
10c076e7f2
[saint] add 'album' and 'media' extractors ( #4405 , #6324 )
2024-10-27 22:27:30 +01:00
Mike Fährmann
6693ae19e8
[civitai] add 'metadata' option ( #6383 )
2024-10-27 15:46:00 +01:00
Mike Fährmann
a4791f5243
[bluesky] add 'hashtag' extractor ( #4438 )
...
https://github.com/mikf/gallery-dl/issues/4438#issuecomment-2439979958
2024-10-27 13:59:46 +01:00
Mike Fährmann
8f396cfc57
[bluesky] add 'quoted' option ( #6323 )
2024-10-25 17:22:33 +02:00
Mike Fährmann
0fd98f67ba
[mangadex] add 'author' extractor ( #6372 )
2024-10-24 14:57:17 +02:00
Mike Fährmann
b08da4ffc7
[reddit] add 'embeds' option ( #6357 )
2024-10-22 17:06:54 +02:00
Mike Fährmann
33161da121
[pixiv] add 'captions' option ( #4327 )
...
make extra requests for empty captions independent of 'sanity'
2024-10-22 16:31:37 +02:00
Mike Fährmann
66aa514c25
[scrolller] add initial support ( #295 , #3418 , #5051 )
2024-10-21 14:17:18 +02:00
Mike Fährmann
10c56a561d
add '--print' and '--print-to-file' command-line options
2024-10-20 10:06:04 +02:00
Mike Fährmann
2e1dab3036
[pp] add 'error' event
2024-10-19 20:30:34 +02:00
Mike Fährmann
5d984f35aa
[pinterest] support 'story' pins ( #6188 , #6078 , #4229 )
2024-10-19 17:47:31 +02:00
Mike Fährmann
9751b716ef
merge #6328 : [vk] add 'offset' option
2024-10-17 21:21:52 +02:00
Mike Fährmann
0e4e40c9d2
[vk] document 'offset', add '--range' support
2024-10-17 21:20:21 +02:00
Mike Fährmann
69a75b1de2
[civitai] add extractors for global 'models' and 'images' ( #6310 )
2024-10-16 23:00:51 +02:00
Mike Fährmann
09d4c281b6
[shimmie2] remove 'loudbooru.com'
2024-10-10 18:32:42 +02:00
Mike Fährmann
6807bf9c11
[komikcast] update domain to 'komikcast.cz'
2024-10-10 16:52:40 +02:00
Mike Fährmann
bcd920e24d
[lolisafe] remove 'xbunkr.com'
2024-10-10 16:19:08 +02:00
Mike Fährmann
4a1cbe94a9
[pururin] remove module
...
"This domain name has been seized in accordance with a seizure warrant
issued by the United States District Court for the District of Idaho"
2024-10-10 15:57:17 +02:00
Mike Fährmann
3194bcbccc
[blogger] remove 'micmicidol.club'
2024-10-10 14:23:58 +02:00
Mike Fährmann
a25aa26577
[chevereto] remove 'deltaporno.com'
2024-10-10 13:07:08 +02:00
Mike Fährmann
02ca1ac602
[fanbox] add 'comments' option, extend 'metadata' option ( #6287 )
2024-10-06 22:31:41 +02:00
Mike Fährmann
8bcf7bf5ee
[pixiv] add 'comments' option ( #6287 )
2024-10-06 20:41:36 +02:00
Mike Fährmann
9757eacce1
[civitai] add 'post' extractors ( #6279 )
...
- https://civitai.com/posts/12345
- https://civitai.com/user/USER/posts
2024-10-06 17:48:48 +02:00
Mike Fährmann
b12d65ade2
[civitai] use tRPC API by default ( #6279 )
2024-10-06 08:57:58 +02:00
Mike Fährmann
7f945c44f5
[pixiv] support unlisted artworks ( #5162 )
2024-10-05 17:10:03 +02:00
Mike Fährmann
c5be50fdaa
[pixiv] implement workaround for 'limit_sanity_level' works
...
(#4327 , #4747 , #5054 , #5435 , #5651 , #5655 )
Metadata should be ~95% identical (there might be some 'date' differences)
and there could be issues with R-18 works, as these require some URL
manipulation to transform /c/250x250_80_a2/ thumbnail URLs into
/img-original/ ones.
2024-10-04 21:07:56 +02:00
Mike Fährmann
5b968a0a7c
[boosty] extend image URLs with 'signedQuery' ( #2387 )
2024-10-03 20:25:12 +02:00
Mike Fährmann
274d99e7d6
[boosty] add 'feed' and 'following' extractors ( #2387 )
2024-10-03 18:09:31 +02:00
Mike Fährmann
1ad58cab84
[boosty] add initial support ( #2387 )
2024-10-02 20:39:55 +02:00
Mike Fährmann
321161c769
[patreon] use mobile UA ( #6241 , #6239 , #6140 )
2024-10-01 08:22:16 +02:00
Mike Fährmann
a937b72034
[ao3] add 'subscriptions' extractor ( #6247 )
2024-09-29 13:01:51 +02:00
