Mike Fährmann
84a634fc14
[job] add 'resolve' argument to DataJob ( #5864 )
2024-07-19 14:32:42 +02:00
Mike Fährmann
287a7d13cf
[sankaku] implement 'notes' extraction ( #5865 )
2024-07-18 20:44:49 +02:00
Mike Fährmann
7d5415c201
[workflow:executables] restrict 'setuptools' to <71
...
setuptools 71 together with secretstorage dependencies
causees an ImportErrorWhenRunningHook exception in PyInstaller
for whatever reason
2024-07-18 02:24:52 +02:00
Mike Fährmann
026e0b97db
merge #5824 : [furaffinity] add 'folders' and 'thumbnail' ( #1284 )
2024-07-18 01:41:15 +02:00
Mike Fährmann
9a8ec95398
[furaffinity] improve
2024-07-18 01:39:58 +02:00
Mike Fährmann
60a2fefedd
[tests] restrict 'test_unique_pattern_matches' to internal extractors
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2231649983
2024-07-17 23:35:41 +02:00
Mike Fährmann
3fa74ca4d7
[tests] enable test results for external extractors ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2231649983
2024-07-17 22:29:09 +02:00
Mike Fährmann
6940ad0e72
[booru] allow multiple 'url' keys ( #5859 )
2024-07-17 20:49:52 +02:00
Mike Fährmann
bf44add132
[booru] prevent crash when file URL is empty ( #5859 )
...
- catch all exceptions, including IndexError, and not just a select few
- change logging message level to warning
2024-07-17 20:20:17 +02:00
Mike Fährmann
39b9c8d4b0
[workflows:pages] add repo check to 'deploy' job as well
...
of course I forgot one
a434fc7cb1
2024-07-15 18:26:49 +02:00
Mike Fährmann
51fd14f87d
[gelbooru_v02] use total number of posts as end marker ( #5830 )
...
… and potentially retry on empty responses
2024-07-12 22:51:46 +02:00
Mike Fährmann
6110e3f940
[common] fix Logger names of BaseCategory extractors
...
update of d11ec0090c178846
2024-07-12 22:51:46 +02:00
Mike Fährmann
668219b36e
[exhentai] improve error message when temporarily banned ( #5845 )
2024-07-12 22:51:46 +02:00
Mike Fährmann
f7383a56f8
wrap filters/conditionals in a try-except block
...
allows accessing undefined fields without exception or locals().get(…)
but hides mistakes/typos/etc by evaluating to False without feedback
performance loss compared to the previous version without try-except
is negligible (~20ns for me)
2024-07-12 22:51:11 +02:00
Mike Fährmann
c83c812a1e
[instagram][twitter] rename 'profile' to 'info' ( #5262 , #3623 )
2024-07-11 00:22:39 +02:00
Mike Fährmann
21831eba1e
[tests] completely ignore '#auth' for 'only_matching' tests
2024-07-11 00:20:10 +02:00
Mike Fährmann
16e276fca4
[nijie] fix image URLs for single image posts ( #5842 )
...
fixes regression introduced in 2e11b6e7
2024-07-10 15:06:25 +02:00
Mike Fährmann
eb3ef13d28
include 'zstd' in Accept-Encoding header when supported
...
… and slightly update optional dependency list
2024-07-10 00:33:35 +02:00
Mike Fährmann
8aca0e6970
update default User-Agent header to Firefox 128 ESR
2024-07-09 20:42:06 +02:00
Mike Fährmann
8e747b6dee
[twitter] send initial 'cursor' only when given via option
2024-07-09 20:42:06 +02:00
Mike Fährmann
ff39d28ef4
[twitter] fix 'user' when providing 'cursor' ( #5833 )
2024-07-08 23:16:47 +02:00
Mike Fährmann
65385e09cb
[twitter] remove break ( #5831 )
2024-07-07 01:08:30 +02:00
Mike Fährmann
1656c9287d
[pp:metadata] fix 'directory' when file directory has conditions ( #5728 )
2024-07-06 22:07:17 +02:00
Mike Fährmann
1527ad79e2
[tests] fix syntax for Python < 3.6
...
no f-strings
2024-07-06 18:39:59 +02:00
Mike Fährmann
da9916c01f
[pp:metadata] implement format strings for 'directory' ( #5728 )
2024-07-06 03:08:59 +02:00
Mike Fährmann
8f3f061daf
[hentainexus] fix error for spread pages ( #5827 )
2024-07-05 21:36:29 +02:00
Mike Fährmann
b3aded1939
add '--print-traffic'
2024-07-05 21:34:33 +02:00
Mike Fährmann
b376fa814e
[zerochan] handle "KeyError - 'items'" ( #5826 )
...
Zerochan sometimes sends an empty response when there are no more
accessible posts to be had.
2024-07-05 21:34:33 +02:00
Mike Fährmann
a434fc7cb1
[workflows] only run in 'mikf/gallery-dl' repo
...
The actual code was included in the previous
97a50a23d2
2024-07-05 21:33:39 +02:00
Mike Fährmann
97a50a23d2
[twitter] implement 'cursor' support ( #5753 )
2024-07-05 00:03:02 +02:00
Nicholas Bishop
4f3be2f571
Remove leftover split() statement
...
Forgot to remove this from a previous implementation attempt
2024-07-04 16:50:49 -04:00
Mike Fährmann
162756b684
[toyhouse] fix Content Warning bypass ( #5820 )
2024-07-04 22:42:36 +02:00
Nicholas Bishop
f43bccb5be
[furaffinity] Add 'thumbnail' ( #1284 ) and 'folders' properties
...
Retrieve 'thumbnail' and 'folders' properties for each post.
'thumbnail' (#1284 ):
- Preview image used for search results, writing posts, music, etc.
- Filename format: <post_id>@600-<directory_containing_full_image>.jpg
'Folders' (related to #1817 ):
- A list of all gallery folders containing this post
- Folder name format: [<folder_category> - ]<folder_name>
- Only works on new layout; old layout does not show folders, so list will be empty
A test is included for each property.
2024-07-04 15:41:14 -04:00
Mike Fährmann
e03b99ba0e
[actions] emit logging messages before waiting/exiting/etc
...
distinguish between actions that should run before or after
a logging message gets emitted
2024-07-01 01:19:25 +02:00
Mike Fährmann
f7a6401031
[actions] move LoggerAdapter from 'output' to 'actions'
2024-06-30 20:41:51 +02:00
Mike Fährmann
f41a5065b2
[actions] support multiple actions per pattern
2024-06-30 02:36:33 +02:00
Mike Fährmann
8219a78b8d
[actions] extend 'wait'
...
allow specifying a duration like for --sleep
2024-06-29 23:58:38 +02:00
Mike Fährmann
84b3da54aa
[actions] add 'exec' action ( #5619 )
2024-06-29 23:02:48 +02:00
Mike Fährmann
c9860002ba
[actions] add 'abort' and 'terminate' actions ( #5778 )
2024-06-29 19:20:17 +02:00
Mike Fährmann
d80f4fbc10
[actions] optimize empty patterns
2024-06-29 18:57:48 +02:00
Mike Fährmann
d10bfa9065
[vipergirls] improve 'thread' URL pattern
...
allow for query parameters and fragments at tne end of URLs
2024-06-29 17:38:57 +02:00
Mike Fährmann
ba51c1a8e4
[path] fix 1ca2cf51
2024-06-29 02:41:56 +02:00
Mike Fährmann
1ca2cf51a2
merge #5807 : [path] fix moving files across drives on Windows
2024-06-29 02:37:42 +02:00
AyluinReymaer
de61b3b546
Update path.py
2024-06-29 00:58:03 +01:00
AyluinReymaer
91a989a172
path.py - fix system cannot move file to different drive
...
This fixes the below error message:
OSError(18, 'The system cannot move the file to a different disk drive')
2024-06-29 00:08:53 +01:00
Mike Fährmann
29eb535e18
merge #5802 : [twitter] extract 'bookmark_count' and 'view_count'
2024-06-28 23:21:57 +02:00
rameerez
ee93dfeb8d
Add bookmark_count and view_count to the X / Twitter extractor
...
- Parse `view_count` as integer in Twitter extractor
- Style fix
- optimize 'view_count' extraction
2024-06-28 23:17:11 +02:00
Mike Fährmann
c2bf4ff99c
[twitter] add 'profile' extractor ( #3623 )
2024-06-28 22:55:48 +02:00
Mike Fährmann
44896b0296
[instagram] add 'profile' extractor ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2188915210
2024-06-28 22:54:07 +02:00
Mike Fährmann
ea81fa985f
[archive] implement 'archive-event' option ( #5784 )
...
With this, IDs of skipped files will no longer be written to an archive
by default. Use "archive-event": "file,skip" to restore the previous
behavior.
2024-06-27 22:00:59 +02:00
