Mike Fährmann
026e0b97db
merge #5824 : [furaffinity] add 'folders' and 'thumbnail' ( #1284 )
2024-07-18 01:41:15 +02:00
Mike Fährmann
9a8ec95398
[furaffinity] improve
2024-07-18 01:39:58 +02:00
Mike Fährmann
6940ad0e72
[booru] allow multiple 'url' keys ( #5859 )
2024-07-17 20:49:52 +02:00
Mike Fährmann
bf44add132
[booru] prevent crash when file URL is empty ( #5859 )
...
- catch all exceptions, including IndexError, and not just a select few
- change logging message level to warning
2024-07-17 20:20:17 +02:00
Mike Fährmann
51fd14f87d
[gelbooru_v02] use total number of posts as end marker ( #5830 )
...
… and potentially retry on empty responses
2024-07-12 22:51:46 +02:00
Mike Fährmann
6110e3f940
[common] fix Logger names of BaseCategory extractors
...
update of d11ec009
fixes regressions introduced in 0c178846
2024-07-12 22:51:46 +02:00
Mike Fährmann
668219b36e
[exhentai] improve error message when temporarily banned ( #5845 )
2024-07-12 22:51:46 +02:00
Mike Fährmann
c83c812a1e
[instagram][twitter] rename 'profile' to 'info' ( #5262 , #3623 )
2024-07-11 00:22:39 +02:00
Mike Fährmann
16e276fca4
[nijie] fix image URLs for single image posts ( #5842 )
...
fixes regression introduced in 2e11b6e7
2024-07-10 15:06:25 +02:00
Mike Fährmann
eb3ef13d28
include 'zstd' in Accept-Encoding header when supported
...
… and slightly update optional dependency list
2024-07-10 00:33:35 +02:00
Mike Fährmann
8aca0e6970
update default User-Agent header to Firefox 128 ESR
2024-07-09 20:42:06 +02:00
Mike Fährmann
8e747b6dee
[twitter] send initial 'cursor' only when given via option
2024-07-09 20:42:06 +02:00
Mike Fährmann
ff39d28ef4
[twitter] fix 'user' when providing 'cursor' ( #5833 )
2024-07-08 23:16:47 +02:00
Mike Fährmann
65385e09cb
[twitter] remove break ( #5831 )
2024-07-07 01:08:30 +02:00
Mike Fährmann
8f3f061daf
[hentainexus] fix error for spread pages ( #5827 )
2024-07-05 21:36:29 +02:00
Mike Fährmann
b376fa814e
[zerochan] handle "KeyError - 'items'" ( #5826 )
...
Zerochan sometimes sends an empty response when there are no more
accessible posts to be had.
2024-07-05 21:34:33 +02:00
Mike Fährmann
97a50a23d2
[twitter] implement 'cursor' support ( #5753 )
2024-07-05 00:03:02 +02:00
Nicholas Bishop
4f3be2f571
Remove leftover split() statement
...
Forgot to remove this from a previous implementation attempt
2024-07-04 16:50:49 -04:00
Mike Fährmann
162756b684
[toyhouse] fix Content Warning bypass ( #5820 )
2024-07-04 22:42:36 +02:00
Nicholas Bishop
f43bccb5be
[furaffinity] Add 'thumbnail' ( #1284 ) and 'folders' properties
...
Retrieve 'thumbnail' and 'folders' properties for each post.
'thumbnail' (#1284 ):
- Preview image used for search results, writing posts, music, etc.
- Filename format: <post_id>@600-<directory_containing_full_image>.jpg
'Folders' (related to #1817 ):
- A list of all gallery folders containing this post
- Folder name format: [<folder_category> - ]<folder_name>
- Only works on new layout; old layout does not show folders, so list will be empty
A test is included for each property.
2024-07-04 15:41:14 -04:00
Mike Fährmann
d10bfa9065
[vipergirls] improve 'thread' URL pattern
...
allow for query parameters and fragments at tne end of URLs
2024-06-29 17:38:57 +02:00
Mike Fährmann
29eb535e18
merge #5802 : [twitter] extract 'bookmark_count' and 'view_count'
2024-06-28 23:21:57 +02:00
rameerez
ee93dfeb8d
Add bookmark_count and view_count to the X / Twitter extractor
...
- Parse `view_count` as integer in Twitter extractor
- Style fix
- optimize 'view_count' extraction
2024-06-28 23:17:11 +02:00
Mike Fährmann
c2bf4ff99c
[twitter] add 'profile' extractor ( #3623 )
2024-06-28 22:55:48 +02:00
Mike Fährmann
44896b0296
[instagram] add 'profile' extractor ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2188915210
2024-06-28 22:54:07 +02:00
Mike Fährmann
51fdfbe6fc
[erome] extract 'date' metadata ( #5796 )
2024-06-27 21:07:23 +02:00
Mike Fährmann
9329c30b41
merge #5783 : [subscribestar] fix 'date' parsing in updated posts
2024-06-27 18:12:05 +02:00
Arased
03486599af
Fix subscribestar date parsing in udated posts
2024-06-24 16:40:59 +02:00
Mike Fährmann
0bb8831853
[twitter] fix 'username-alt' option name ( #5715 )
2024-06-22 17:49:58 +02:00
Mike Fährmann
606202fb04
[fanbox] remove debug code ( #5759 )
2024-06-21 21:05:01 +02:00
Mike Fährmann
b707b31264
merge #5774 : [tcbscans] support other domains
2024-06-21 19:06:11 +02:00
Mike Fährmann
ad25be3420
[fanbox] fix 8452d04a ( #5759 )
...
The previous code would raise an exception when there are no or
more than 1 plans with a fee higher than 'feeRequired'.
2024-06-21 18:56:43 +02:00
enduser420
5adbfe526d
[tcbscans] support other domains
2024-06-21 21:29:11 +05:30
Mike Fährmann
f58b0e6fc7
[twitter] ignore 'Unavailable' media ( #5736 )
...
… including geo-restricted content.
add 'unavailable' option to allow re-enabling them again
2024-06-21 00:15:10 +02:00
Mike Fährmann
8452d04a33
[fanbox] handle KeyError for no longer existing plans ( #5759 )
...
return the plan of the next higher tier instead
2024-06-21 00:13:25 +02:00
Mike Fährmann
11421cf940
[skeb] fix '429 Too Many Requests' errors ( #5766 )
...
Introduce '_handle_429' method to make it easier for Extractors to react
to 429 errors regardless of 'sleep-429' settings.
2024-06-21 00:12:05 +02:00
Mike Fährmann
60b4541199
improve a1bb3279, fix oauth:pixiv ( #5757 )
...
Check 'input' option only when required.
This also fixes an exception in oauth:pixiv caused by using the same
'_input' name as a method defined there.
2024-06-18 16:50:04 +02:00
Mike Fährmann
a1bb32792b
do not try to read from stdin when it is non-interactive ( #5733 )
...
add '--no-input' command-line option and 'input' config file option
to allow users to manually configure this
2024-06-16 18:31:39 +02:00
Mike Fährmann
ae3706286a
[speakerdeck] inherit from GalleryExtractor
2024-06-15 21:56:51 +02:00
Mike Fährmann
a92c0bef96
merge #5730 : [speakerdeck] fix extraction
2024-06-13 15:55:57 +02:00
Yuta Hayashibe
f272b5d2ac
fix: extractor for speakerdeck.com
2024-06-13 15:54:54 +02:00
Mike Fährmann
c699ce8ebb
[twitter] add 'username-alt' option ( #5715 )
2024-06-13 00:54:43 +02:00
Mike Fährmann
c6fc0281e8
[newgrounds] extend 'format' option ( #5709 )
...
- check more extensions for original formats (mp4, webm, m4v, mov, mkv)
- allow specifying which extensions and recoded formats to check
2024-06-12 20:46:45 +02:00
Mike Fährmann
86f0c3baaf
[szurubooru] support empty tag searches ( #5711 )
2024-06-11 20:25:06 +02:00
Mike Fährmann
40c685dc43
merge #5712 : [hentainexus] update key
2024-06-10 19:58:03 +02:00
KageNiHisomu
87859ff200
fix: static method defines hostname, update url link
2024-06-10 14:35:03 +10:00
KageNiHisomu
68540aef2a
update nexus key
2024-06-10 14:25:51 +10:00
Mike Fährmann
2e11b6e756
[nijie] support downloading videos ( #5707 , #5617 )
2024-06-08 22:55:28 +02:00
Mike Fährmann
e17b1d5073
[deviantart] fix 2c8aa9b2 ( #5696 )
2024-06-08 02:00:36 +02:00
Mike Fährmann
f160859c5c
[hitomi] extract 'title_jpn' metadata ( #5706 )
2024-06-08 00:05:19 +02:00
