Mike Fährmann
1aadc29c5b
[zerochan] fix 'source' extraction
2024-07-23 09:34:44 +02:00
Mike Fährmann
ae40c61c21
[zerochan] fix tag category extraction ( #5874 )
2024-07-23 09:16:32 +02:00
Mike Fährmann
5f6d20c595
[tests] remove internal extractor check
...
revert 60a2fefedd
2024-07-22 18:40:02 +02:00
Mike Fährmann
3eba1f7c29
[tests] load results from ${GDL_TEST_RESULTS} ( #5262 )
2024-07-22 18:35:50 +02:00
Mike Fährmann
3b26748264
[inkbunny:following] fix infinite loop
...
happens when number of watched users is a multiple of 20
2024-07-22 17:59:58 +02:00
Mike Fährmann
db9833c28a
merge #5870 : [aryion] add 'favorite' extractor ( #4511 )
2024-07-21 12:37:47 +02:00
Mike Fährmann
156a70bec0
[aryion] update favorite extractor
...
- add test case
- add docs/supportedsites entry
- add custom directory_fmt and archive_fmt
- remove constructor
- appease flake8
2024-07-21 12:34:06 +02:00
Mike Fährmann
36a64a3aa7
[behance] fix image extraction ( #5873 )
2024-07-21 10:54:12 +02:00
Mike Fährmann
727e53f513
[bunkr] support 'bunkr.fi' URLs ( #5872 )
2024-07-21 06:41:50 +02:00
walkenjoyer
19e98ef8e9
[aryion] Add favorite extractor ( #4511 )
2024-07-20 18:49:59 +02:00
Mike Fährmann
a595949840
[8chan] update 'TOS' cookie name ( #5868 )
2024-07-20 02:15:29 +02:00
Mike Fährmann
fef80a2f55
[zerochan] fetch metadata for each post separately ( #5869 )
...
instead of processing all posts at once before returning any of them
2024-07-20 02:11:27 +02:00
Mike Fährmann
84a634fc14
[job] add 'resolve' argument to DataJob ( #5864 )
2024-07-19 14:32:42 +02:00
Mike Fährmann
287a7d13cf
[sankaku] implement 'notes' extraction ( #5865 )
2024-07-18 20:44:49 +02:00
Mike Fährmann
7d5415c201
[workflow:executables] restrict 'setuptools' to <71
...
setuptools 71 together with secretstorage dependencies
causees an ImportErrorWhenRunningHook exception in PyInstaller
for whatever reason
2024-07-18 02:24:52 +02:00
Mike Fährmann
026e0b97db
merge #5824 : [furaffinity] add 'folders' and 'thumbnail' ( #1284 )
2024-07-18 01:41:15 +02:00
Mike Fährmann
9a8ec95398
[furaffinity] improve
2024-07-18 01:39:58 +02:00
Mike Fährmann
60a2fefedd
[tests] restrict 'test_unique_pattern_matches' to internal extractors
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2231649983
2024-07-17 23:35:41 +02:00
Mike Fährmann
3fa74ca4d7
[tests] enable test results for external extractors ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2231649983
2024-07-17 22:29:09 +02:00
Mike Fährmann
6940ad0e72
[booru] allow multiple 'url' keys ( #5859 )
2024-07-17 20:49:52 +02:00
Mike Fährmann
bf44add132
[booru] prevent crash when file URL is empty ( #5859 )
...
- catch all exceptions, including IndexError, and not just a select few
- change logging message level to warning
2024-07-17 20:20:17 +02:00
Mike Fährmann
39b9c8d4b0
[workflows:pages] add repo check to 'deploy' job as well
...
of course I forgot one
a434fc7cb1
2024-07-15 18:26:49 +02:00
Mike Fährmann
51fd14f87d
[gelbooru_v02] use total number of posts as end marker ( #5830 )
...
… and potentially retry on empty responses
2024-07-12 22:51:46 +02:00
Mike Fährmann
6110e3f940
[common] fix Logger names of BaseCategory extractors
...
update of d11ec0090c178846
2024-07-12 22:51:46 +02:00
Mike Fährmann
668219b36e
[exhentai] improve error message when temporarily banned ( #5845 )
2024-07-12 22:51:46 +02:00
Mike Fährmann
f7383a56f8
wrap filters/conditionals in a try-except block
...
allows accessing undefined fields without exception or locals().get(…)
but hides mistakes/typos/etc by evaluating to False without feedback
performance loss compared to the previous version without try-except
is negligible (~20ns for me)
2024-07-12 22:51:11 +02:00
Mike Fährmann
c83c812a1e
[instagram][twitter] rename 'profile' to 'info' ( #5262 , #3623 )
2024-07-11 00:22:39 +02:00
Mike Fährmann
21831eba1e
[tests] completely ignore '#auth' for 'only_matching' tests
2024-07-11 00:20:10 +02:00
Mike Fährmann
16e276fca4
[nijie] fix image URLs for single image posts ( #5842 )
...
fixes regression introduced in 2e11b6e7
2024-07-10 15:06:25 +02:00
Mike Fährmann
eb3ef13d28
include 'zstd' in Accept-Encoding header when supported
...
… and slightly update optional dependency list
2024-07-10 00:33:35 +02:00
Mike Fährmann
8aca0e6970
update default User-Agent header to Firefox 128 ESR
2024-07-09 20:42:06 +02:00
Mike Fährmann
8e747b6dee
[twitter] send initial 'cursor' only when given via option
2024-07-09 20:42:06 +02:00
Mike Fährmann
ff39d28ef4
[twitter] fix 'user' when providing 'cursor' ( #5833 )
2024-07-08 23:16:47 +02:00
Mike Fährmann
65385e09cb
[twitter] remove break ( #5831 )
2024-07-07 01:08:30 +02:00
Mike Fährmann
1656c9287d
[pp:metadata] fix 'directory' when file directory has conditions ( #5728 )
2024-07-06 22:07:17 +02:00
Mike Fährmann
1527ad79e2
[tests] fix syntax for Python < 3.6
...
no f-strings
2024-07-06 18:39:59 +02:00
Mike Fährmann
da9916c01f
[pp:metadata] implement format strings for 'directory' ( #5728 )
2024-07-06 03:08:59 +02:00
Mike Fährmann
8f3f061daf
[hentainexus] fix error for spread pages ( #5827 )
2024-07-05 21:36:29 +02:00
Mike Fährmann
b3aded1939
add '--print-traffic'
2024-07-05 21:34:33 +02:00
Mike Fährmann
b376fa814e
[zerochan] handle "KeyError - 'items'" ( #5826 )
...
Zerochan sometimes sends an empty response when there are no more
accessible posts to be had.
2024-07-05 21:34:33 +02:00
Mike Fährmann
a434fc7cb1
[workflows] only run in 'mikf/gallery-dl' repo
...
The actual code was included in the previous
97a50a23d2
2024-07-05 21:33:39 +02:00
Mike Fährmann
97a50a23d2
[twitter] implement 'cursor' support ( #5753 )
2024-07-05 00:03:02 +02:00
Nicholas Bishop
4f3be2f571
Remove leftover split() statement
...
Forgot to remove this from a previous implementation attempt
2024-07-04 16:50:49 -04:00
Mike Fährmann
162756b684
[toyhouse] fix Content Warning bypass ( #5820 )
2024-07-04 22:42:36 +02:00
Nicholas Bishop
f43bccb5be
[furaffinity] Add 'thumbnail' ( #1284 ) and 'folders' properties
...
Retrieve 'thumbnail' and 'folders' properties for each post.
'thumbnail' (#1284 ):
- Preview image used for search results, writing posts, music, etc.
- Filename format: <post_id>@600-<directory_containing_full_image>.jpg
'Folders' (related to #1817 ):
- A list of all gallery folders containing this post
- Folder name format: [<folder_category> - ]<folder_name>
- Only works on new layout; old layout does not show folders, so list will be empty
A test is included for each property.
2024-07-04 15:41:14 -04:00
Mike Fährmann
e03b99ba0e
[actions] emit logging messages before waiting/exiting/etc
...
distinguish between actions that should run before or after
a logging message gets emitted
2024-07-01 01:19:25 +02:00
Mike Fährmann
f7a6401031
[actions] move LoggerAdapter from 'output' to 'actions'
2024-06-30 20:41:51 +02:00
Mike Fährmann
f41a5065b2
[actions] support multiple actions per pattern
2024-06-30 02:36:33 +02:00
Mike Fährmann
8219a78b8d
[actions] extend 'wait'
...
allow specifying a duration like for --sleep
2024-06-29 23:58:38 +02:00
Mike Fährmann
84b3da54aa
[actions] add 'exec' action ( #5619 )
2024-06-29 23:02:48 +02:00
