Mirrors/gallery-dl
1
0
Fork 0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-23 03:02:50 +01:00
Code Issues Releases Wiki Activity
1,110 Commits 6 Branches 164 Tags 16 MiB
64b22e0fc1
Commit Graph

1110 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
64b22e0fc1
[pawoo] update URL pattern 
adds support for 'https://pawoo.net/@.../media'
 2018-04-02 13:00:59 +02:00
Mike Fährmann
7b562907c3
[nijie] add favorites extractor 
adds support for 'https://nijie.info/user_like_illust_view.php?id=...'
 2018-03-31 18:54:25 +02:00
Mike Fährmann
445db75955
[nijie] improve extraction and metadata 
- add 'title' and 'description'
- split 'artist_id' into 'user_id' and 'artist_id'
  - 'user_id' is the ID of the user from which the image entry
    originates from
  - 'artist_id' is the ID of the actual image artist
- improve pagination and URL patterns
 2018-03-31 18:48:41 +02:00
Mike Fährmann
a112e3f2a0
[nijie] add doujin extractor 
adds support for "https://nijie.info/members_dojin.php?id=<artist_id>"
 2018-03-31 18:17:41 +02:00
Mike Fährmann
f39153b6e9
[nhentai] add extractor for search results 2018-03-28 17:21:44 +02:00
Mike Fährmann
52d41c41e7
[exhentai] add extractor for favorited galleries 2018-03-27 18:58:42 +02:00
Mike Fährmann
63cc2599c4
[exhentai] add extractor for search results 2018-03-27 16:50:47 +02:00
Mike Fährmann
d1c91a1f2b
[mangadex] fix manga-page extraction 2018-03-25 17:22:12 +02:00
Mike Fährmann
299ae24996
[test] add a few downloader tests 2018-03-25 15:10:25 +02:00
Mike Fährmann
dd314279fb
[test] add unit tests for extractor module functions 2018-03-25 11:49:42 +02:00
Mike Fährmann
a993d0ea90
release version 1.3.2 2018-03-23 15:27:56 +01:00
Mike Fährmann
e7525b1b0e
[artstation] add challenge extractor (#80) 2018-03-23 15:06:09 +01:00
Mike Fährmann
3f2dd6b6f8
avoid double path-separators 
(#74)
 2018-03-22 10:24:59 +01:00
Mike Fährmann
b25ae30a95
reorder options in gallery-dl.conf 2018-03-22 10:05:53 +01:00
Mike Fährmann
f5c6a2d7f5
[nhentai] use API to get gallery info 2018-03-21 12:58:41 +01:00
Mike Fährmann
b2ba2b821d
[hitomi] fix image URLs and improve metadata 
- use '?a.hitomi.la' as subdomain depending in gallery-id
- add 'characters', 'tags' and 'date' information
- support multiple entires per metadata-value
- rename 'num' to 'page'
 2018-03-20 18:09:42 +01:00
Mike Fährmann
d75dc71394
fix travis tests 2018-03-19 18:07:19 +01:00
Mike Fährmann
8ef790de12
update .travis.yml 
- restrict builds to master branch and release tags
- implement 'core' and 'results' test categories
 2018-03-19 17:57:32 +01:00
Mike Fährmann
3905474805
[booru] call update_page() with correct dict (closes #82) 2018-03-19 11:33:19 +01:00
Mike Fährmann
44c267e362
[artstation] add search extractor (#80) 2018-03-17 19:04:37 +01:00
Mike Fährmann
40ca562d7b
[artstation] add album extractor (#80) 2018-03-17 17:36:31 +01:00
Mike Fährmann
7121eeae8b
check supportedsites.rst in release script 2018-03-17 15:35:38 +01:00
HRXN
241eda8c3d Update supportedsites.rst (#81) 
Add ArtStation to Supported Sites.
 2018-03-16 13:40:59 +01:00
Mike Fährmann
c59f9b71f1
release version 1.3.1 2018-03-16 12:29:02 +01:00
Mike Fährmann
f0e3861ec7
update configuration.rst 
- move `base-directory` entry to extractor options
  (it should've been there since v1.0.0 / commit e3bfb83)
- rename "General" to "Miscellaneous" and move it down a bit, since it
  has only two options left
- mention the ability to use a list for tumblr.posts
- replace any appearance of bato.to
 2018-03-16 12:00:55 +01:00
Mike Fährmann
f367d5c281
[deviantart] move delay-increase after expect_error check 
[ci skip]
 2018-03-15 16:44:58 +01:00
Mike Fährmann
557cb94f81
[deviantart] use proper exponential backoff on API errors 
... and use separate API credentials for unit tests.
 2018-03-15 16:01:42 +01:00
Mike Fährmann
723cc66bb1
[artstation] add user-, image- and likes-extractors 2018-03-14 14:05:14 +01:00
Mike Fährmann
b69cc94f0e
[util] implement bencode() 2018-03-14 13:17:34 +01:00
Mike Fährmann
4d74749496
[tests] rework filters for extractor tests 
CI incompatible tests will now only be skipped if tests are run in
a CI environment.
 2018-03-13 13:11:10 +01:00
Mike Fährmann
d6ef52897c
[imgchili] remove module 
All previously hosted images yield a 404
and the main page is just a logo.
 2018-03-13 11:02:58 +01:00
Mike Fährmann
7847ab1d5a
[imagehosts] remove even more dead sites 
All removed sites either
- reject all incoming connections or
- display a message from their domain registrar
 2018-03-12 21:25:13 +01:00
Mike Fährmann
74c8f83056
update gallery-dl.conf and add gallery-dl-example.conf 
- gallery-dl.conf contains all config options set to their default
  values, with the exception of 'filename', 'directory', and
  'cache.file'

- gallery-dl-example.conf contains a potential real-world configuration
  file and demonstrates some more involved options
 2018-03-12 18:15:30 +01:00
Mike Fährmann
5f37d40a3e
[komikcast] bypass cloudflare challenge 2018-03-10 16:09:40 +01:00
Mike Fährmann
f9884e2338
[pixiv] update URL pattern 
add support for 'https://www.pixiv.net/user/<id>'
 2018-03-10 16:05:12 +01:00
Mike Fährmann
85ed023c2e
[mangadex] remove the trailing ' - MangaDex' in a better way 
str.rstrip() works differently than assumed.
 2018-03-10 15:54:50 +01:00
Mike Fährmann
9fb82e6b43
apply expand_path() to archive paths 2018-03-08 18:06:39 +01:00
Mike Fährmann
32bbd12f08
update extractor tests 2018-03-08 18:04:34 +01:00
Mike Fährmann
ca326bd275
[deviantart] fix folder and collection archive IDs 
{folder[index]} and {collection[index]} are both '0' when being
delegated from Gallery- or FavoriteExtractors, as there is no
way of knowing a folder's index when getting folder-information
from the API.
 2018-03-08 14:32:23 +01:00
Mike Fährmann
e32fe1cdf1
[pinterest] cast IDs to int 
... and update test results.

Image URLs changed from
https://s-media-cache-ak0.pinimg.com/... to
https://i.pinimg.com/...
 2018-03-06 14:28:21 +01:00
Mike Fährmann
179ecee965
[turboimagehost] fix extraction 2018-03-06 14:25:10 +01:00
Mike Fährmann
1400868f53
[mangadex] general improvements 
- support >100 chapter entries per manga
- custom archive ID format
- detect non-existing chapters
 2018-03-06 14:15:15 +01:00
Mike Fährmann
749fbbfa6c
[mangadex] add chapter- and manga-extractor 2018-03-05 18:37:21 +01:00
Mike Fährmann
b58449fd88
release version 1.3.0 2018-03-02 18:47:17 +01:00
Mike Fährmann
6e38cf5aab
[mangareader] use 'https://' 
The site now redirects from http://mangareader.net/
to https://mangareader.net/
 2018-03-02 17:19:17 +01:00
Mike Fährmann
1d71123f91
[pixiv] update archive IDs and add metadata-fields 
(Pixiv bookmarks actually have their own IDs, comments and tags,
independent of the bookmarked image, which makes creating an
archive ID a lot easier)
 2018-03-02 16:11:53 +01:00
Mike Fährmann
858fdbdb22
[tumblr] improve 'inline' extraction 
'quote' posts store their HTML content in the 'source' field
 2018-03-02 06:59:44 +01:00
Mike Fährmann
1d54a8e07d
fix logging output during downloads 
from:
filename.ext[download][warning] ...

to:
filename.ext
[download][warning] ...
 2018-03-01 18:43:43 +01:00
Mike Fährmann
5008e105ee
update archive IDs 
... to behave in a more straightforward way when dealing with
bookmarks/favourites/etc.

specific IDs are now grouped by their owner, album-id, ... to
allow for duplicates when it would be expected.
 2018-03-01 18:20:50 +01:00
Mike Fährmann
829ddf4ac1
[sankaku] general improvements 
- simplify regex
- unquote search tags
- increase default wait-time between HTTP requests
  - downloading several hundreds of images always resulted
    in '429 Too Many Requests' eventually
- circumvent paging restrictions for unauthenticated users by only
  using the 'next' parameter
  - setting 'page' to a constant, low value (or simply omitting it)
    does the trick
 2018-02-27 16:51:14 +01:00