Mirrors/gallery-dl
1
0
Fork 0
mirror of https://github.com/mikf/gallery-dl.git synced 2024-11-25 20:22:36 +01:00
Code Issues Releases Wiki Activity
4,041 Commits 6 Branches 164 Tags 15 MiB
c01cad599a
Commit Graph

246 Commits

Author SHA1 Message Date
Mike Fährmann
da7297c0b9
[comicvine] add extractor (closes #1712) 2021-07-23 16:17:06 +02:00
Mike Fährmann
e4788fa663
[bbc] add 'gallery' and 'programme' extractors (closes #1706) 2021-07-22 20:37:05 +02:00
Mike Fährmann
74b457b2b5
remove unused entries 2021-07-20 20:21:32 +02:00
Mike Fährmann
36ac2197db
[ytdl] add extractor for sites supported by youtube-dl 
(#1680, #878)

Can be used by prefixing any URL with 'ytdl:',
or by setting 'extractor,ytdl.enabled' to 'true'.
 2021-07-10 20:55:47 +02:00
Mike Fährmann
8ecca3af58
[pixiv] add extractor for 'pixivision' articles (#1672) 2021-07-07 16:27:16 +02:00
Mike Fährmann
267bbf5996
[mangasee] add 'chapter' and 'manga' extractors 2021-06-27 02:03:03 +02:00
Mike Fährmann
f74cf52e2b
[seisoparty] add 'user' and 'post' extractors (#1635) 2021-06-25 18:40:11 +02:00
Mike Fährmann
1197ee2c20
[mangadex] add extractor for a user's followed feed (#1535) 2021-06-08 02:45:36 +02:00
Mike Fährmann
07c8adbd8b
[mangadex] implement login with username & password (#1535) 2021-06-08 02:12:57 +02:00
Mike Fährmann
407627ec86
[foolfuuka] support 'archive.wakarimasen.moe' (closes #1595) 2021-06-02 15:45:43 +02:00
Mike Fährmann
52052a0e1a
[manganelo] update domain to 'manganato.com' 2021-05-28 17:59:21 +02:00
Mike Fährmann
1eabfa5c7a
[pillowfort] implement login with username & password (#846) 2021-05-19 02:59:16 +02:00
Mike Fährmann
559462789d
add some tests for job.py 2021-05-14 19:44:16 +02:00
Mike Fährmann
c6c4a73f87
update fanbox entry in supportedsites.md 2021-04-25 19:44:19 +02:00
thatfuckingbird
e47952ac14
add extractors for fantia and fanbox (#1459) 
* add extractors for fantia and fanbox

* appease linter

* make docstrings unique

* [fantia] refactor post extraction

* [fantia] capitalize

* [fantia] improve regex pattern

* code style

* capitalize

* [fanbox] use BASE_PATTERN for url regexes

* [fanbox] refactor metadata and post extraction

* [fanbox] improve url base pattern

* [fanbox] accept creator page links ending with /posts

* [fanbox] more tests

* [fantia] improved pagination

* [fanbox] misc. code logic improvements

* [fantia] finish restructuring pagination code

* [fanbox] avoid making a request for each individual post when processing a creator page

* [fanbox] support embedded videos

* [fanbox] fix errors

* [fanbox] document extractor.fanbox.videos

* [fanbox] handle "article" and "entry" post types, all embeds

* [fanbox] fix downloading of embedded fanbox posts
 2021-04-25 19:39:13 +02:00
Mike Fährmann
77a9cc6fd6
update supportedsites.md entry for Instagram 2021-04-23 23:21:01 +02:00
Hans Christian Gunawan
334d690687
[hentaicosplays] Add extractor (#1473) 2021-04-18 20:28:00 +02:00
Mike Fährmann
086925e685
[shopify] support omgmiamiswimwear.com (closes #1280) 2021-04-13 23:54:03 +02:00
Mike Fährmann
78d7ee3ef4
[yuki] remove module for yuki.la 2021-04-12 21:42:32 +02:00
Mike Fährmann
d5aad999dc
[tapas] implement login with username & password (#692) 2021-03-30 01:45:28 +02:00
Mike Fährmann
62cfee4d28
[vk] initial support for albums (#474) 2021-03-23 19:02:16 +01:00
Mike Fährmann
91c2e15da9
[deviantart] add support for posts from watched users (#794) 2021-03-22 19:25:04 +01:00
Mike Fährmann
69ca4e29f1
[deviantart] add 'watch' extractor (#794) 2021-03-17 22:50:02 +01:00
Mike Fährmann
c485d0a956
[philomena] add generalized extractors for philomena sites 
(closes #1379)
 2021-03-14 17:19:57 +01:00
Mike Fährmann
72fe9ac0f3
[gelbooru_v01] support some more boorus by default 
- https://drawfriends.booru.org/
- https://vidyart.booru.org/
- https://tlb.booru.org/
 2021-03-14 17:19:56 +01:00
Mike Fährmann
ec98b2c56f
categorize sites in supportedsites.md by basecategory 2021-03-12 16:53:36 +01:00
Mike Fährmann
a67e002f40
update docs/supportedsites 
- use Markdown with inline HTML instead of reStructuredText
- move file from docs/supportedsites.rst to docs/supportedsites.md
- update Makefile, README, etc
 2021-03-12 03:03:48 +01:00
Mike Fährmann
4be27ff0fe
[nozomi] support '/index-N.html' URLs (closes #1365) 
and '/index-Popular-N.html'
 2021-03-11 01:06:47 +01:00
Seonghyeon Cho
665499924d
Support naver webtoon (#1331) 
* Support naver webtoon (WIP)

* Apply patch

* Change filename format

* Fill test results

* Fill test result
 2021-03-03 15:21:13 +01:00
topozorra
a9119da4d4
support tumblrgallery.xyz (#1298) 
* support `tumblrgallery.xyz`

* fix format issues

* Refactor and add post and search page support

* Fix warnings

* Few improvments

* Better file names

* Fix linting errors

* move id closer to the begining of the file name

Co-authored-by: topozorra <none>
 2021-03-03 15:20:47 +01:00
Mike Fährmann
e165e6c265
[wallhaven] add 'collections' extractor (#1351) 2021-03-02 01:32:26 +01:00
Mike Fährmann
1a38fae785
add option to use different youtube-dl modules (fixes #1330) 
by setting the 'downloader.ytdl.module' value. For example

{
    "downloader": {
        "ytdl": {
            "module": "yt_dlp"
        }
    }
}

or '-o module=yt_dlp'
 2021-03-01 03:10:42 +01:00
Mike Fährmann
e39aea42cd
fix supportedsites.py for modules without docstring 
(fixes #1332)
 2021-02-21 22:57:37 +01:00
Mike Fährmann
03b219db9d
fix supportedsites.py 2021-02-20 22:31:21 +01:00
Mike Fährmann
8974f0361c
[pixiv] update (#1304) 
- remove login with username & password
- require a refresh token
- add 'oauth:pixiv' functionality

See also:
- https://github.com/upbit/pixivpy/issues/158
- https://gist.github.com/ZipFile/c9ebedb224406f4f11845ab700124362
 2021-02-12 18:07:16 +01:00
Mike Fährmann
ae530f6365
[erome] add extractors for albums, users, searches (closes #409) 2021-02-07 22:58:19 +01:00
Mike Fährmann
e1bdd2ab67
add a 'generated by …' comment to supportedsites.rst 2021-01-23 17:24:02 +01:00
Mike Fährmann
0eea424a52
update supportedsites.rst 2021-01-22 19:41:50 +01:00
Mike Fährmann
fa8ee6eac4
[derpibooru] add search and gallery extractors (#862) 2021-01-07 18:05:32 +01:00
Mike Fährmann
b0beed7a06
[sankaku] add support for book searches (closes #1204) 2020-12-29 17:36:37 +01:00
Mike Fährmann
6cdbab07b5
[pinterest] add support for getting all boards of a user 
(#1205)
 2020-12-29 16:57:03 +01:00
Mike Fährmann
df9e40ab35
small updates to release.sh 
- use git push --atomic
- update VM name
- rename (git|pypi)-upload
 2020-12-26 19:01:35 +01:00
Mike Fährmann
bf629a2818
[instagram] add 'include' option (closes #1180) 
Split the functionality of the old 'user' extractor into separate
'posts' and 'highlights' extractors, which respond to virtual URLs
('/<user>/posts' and '/<user>/highlights')
 2020-12-21 02:06:28 +01:00
Mike Fährmann
465015f75a
[sankaku] reimplement login support (#1176, #1182) 2020-12-17 16:12:59 +01:00
Mike Fährmann
b2c55f0a72
[sankaku] remove login support 
The old login method for 'https://chan.sankakucomplex.com/user/login'
and the cookies it produces have no effect on the results from
'beta.sankakucomplex.com'.
 2020-12-08 21:05:47 +01:00
Mike Fährmann
de0c57886d
[twitter] add 'list-members' extractor (closes #1096) 2020-11-13 06:47:45 +01:00
Mike Fährmann
05d7009cc6
rename 'Authentication' entries in supportedsites.rst 
- change 'Optional' to 'Supported'
- use 'OAuth' and 'Cookies' in their own
- add link to weasyl API key option
 2020-10-19 20:16:17 +02:00
Zanny
3ec60e894a
[weasyl] api-key authentication (#1057) 
* [weasyl] support api keys

* [weasyl] document api-key authentication

* [weasyl] usernames can contain ~
 2020-10-15 15:12:09 +02:00
Mike Fährmann
b9bdd2c564
[hentaifoundry] add support for stories (closes #734) 2020-09-27 02:27:40 +02:00
Mike Fährmann
117582d798
use definition lists instead of tables in docs/configuration.rst 
and strip some clutter from generated man pages
 2020-09-26 13:33:46 +02:00
Mike Fährmann
e9cc719497
[weasyl] update and simplify 
- simplify 'pattern' regexps
- parse 'posted_at' as 'date'
- use unaltered 'title' ({title!l:R /_/} to lowercase and replace spaces)
 2020-09-26 02:10:45 +02:00
Mike Fährmann
c43b3894be
[myhentaigallery] update and fix extraction (#1001) 
- extract more metadata
- match "/show/" URLs
- complete test results
- fix missing images for lines starting with " <img"
- fix missing comma in supportedsites.py
 2020-09-17 18:14:23 +02:00
choeronline
05b9ac8d37
[myhentaigallery] add extractor (#1001) 
* adds support for myhentaigallery

* fixes linting issues in myhentaigallery extractor
 2020-09-17 17:32:54 +02:00
ArtaxIsSleeping
0e941553ec
[aryion] Add username/password support (#960) 
* Add username/password support to aryion extractor

* Update docs to match

* Fix code style
 2020-08-27 22:45:30 +02:00
Mike Fährmann
901a897e6f
[inkbunny] mention login support 2020-07-26 23:52:52 +02:00
Mike Fährmann
d5fcffcced
[subscribestar] add login capabilities (#852) 2020-07-17 22:18:01 +02:00
Mike Fährmann
df7217c36d
update supportedsites.py (#889, #893) 
- mention optional auth access for more sites
- link to OAuth and Cookies sections in README
 2020-07-16 15:00:31 +02:00
jakem72360
7dfdcc3fbf
[mangakakalot] Added extractors for MangaKakalot (#876) 2020-07-13 21:20:09 +02:00
Mike Fährmann
74494b43d3
let zsh completion immediately suggest cmdline options 
instead of expecting an URL and trying to complete it.
 2020-07-05 22:36:00 +02:00
Mike Fährmann
d0cd86e0d5
add zsh completion script (#150) 2020-07-04 18:05:31 +02:00
Mike Fährmann
e62ebb4643
update CHANGELOG before building sdist and wheel packages 2020-06-27 19:45:09 +02:00
Mike Fährmann
0f459f340b
[instagram] fix and re-enable login with username&password 
This reverts commit 3e0848a482.
(#756, #771, #797, #803)

https://github.com/althonos/InsaLooter/issues/287#issuecomment-630456522
 2020-05-31 00:29:09 +02:00
Mike Fährmann
3e0848a482
[instagram] disable login with username&password (#756) 2020-05-29 23:29:40 +02:00
Leonardo Taccari
39cd389679
[webtoons] Add a new extractor for webtoons.com (#761) 
The webtoons extractor can extract episode and entire comic (all
episodes) from webtoons.com.

All the logic of the extractors should be trivial except for a couple
of kludges needed:

 - `ageGatePass' cookie is always set to avoid possible redirect and stop of
    extraction, especially in the comic extractor
 - The image URLs returned by the episode extractor could not be fetched
   directly and the `Referer:' HTTP header needs to be passed to fetch them

Close #593.
 2020-05-18 19:04:20 +02:00
Bepis
7b5711ee04
[imagechest] Add new extractor for ImageChest (#750) 
* [imagechest] Add new extractor for ImageChest

* [imagechest] Fix flake8 compliance issues
 2020-05-18 19:02:56 +02:00
Mike Fährmann
f557cac074
[redgifs] add image extractor (#724) 2020-05-10 00:31:42 +02:00
Leonardo Taccari
b47cfc5ac9
[speakerdeck] Add a new extractor for speakerdeck.com (#726) 2020-05-01 22:32:22 +02:00
Mike Fährmann
6143050980
[aryion] add gallery and post extractors (#390, #673) 2020-04-08 21:52:51 +02:00
Mike Fährmann
2587296deb
[mastodon] add access tokens for mastodon.social and baraag.net 
(closes #665)
 2020-04-02 22:34:32 +02:00
Mike Fährmann
c8db2a87e9
fix create_test_data.py script 2020-03-25 22:06:38 +01:00
Mike Fährmann
88ebbadc58
remove dashes from subcategory names in supportedsites.rst 2020-03-24 02:49:00 +01:00
Mike Fährmann
90d15e3682
[instagram] use 'itertools.chain()' 2020-03-17 15:52:44 +01:00
Mike Fährmann
5b676ea59d
[e621] document username & password support (#640) 2020-03-14 01:15:22 +01:00
Mike Fährmann
1b3ba86110
improve lists in man pages 2020-03-14 01:08:31 +01:00
Mike Fährmann
fdd2dd5136
[kabeuchi] add 'user' extractor (closes #561) 2020-03-13 16:45:42 +01:00
Mike Fährmann
402025c3c3
fix some build issues 
- use 'os.name' to decide between Windows/Linux build
- don't check Windows executable version number,
  since Wine fails to run the executable and causes release.sh to stop
 2020-03-06 15:15:59 +01:00
Mike Fährmann
ec85bf90de
use context managers in cache.py & add tests 2020-02-25 23:08:47 +01:00
Mike Fährmann
765b2a0527
[hentaihand] add extractors (closes #605) 2020-02-19 21:55:47 +01:00
Mike Fährmann
138135c190
[furaffinity] add extractors (#284) 2020-02-11 19:51:24 +01:00
Mike Fährmann
719b63d0ca
[bcy] add user and post extractors (#592) 2020-02-09 02:37:14 +01:00
Mike Fährmann
cf7a67d67f
[yaplog] remove module 
Yaplog! ended its service on 2020-01-31
 2020-01-31 12:56:54 +01:00
Mike Fährmann
a6b98d3bec
fix auto-generation of supportedsites.rst 2020-01-14 09:48:32 +01:00
Mike Fährmann
5cac79c3d9
[erolord] remove extractor 2020-01-10 14:40:30 +01:00
Mike Fährmann
173a93454e
fix config.set calls in build_testresults_db.py 2019-12-03 16:29:09 +01:00
Mike Fährmann
d4d8c1c01f
update links to standalone executables in README.rst 2019-11-26 12:05:31 +01:00
Mike Fährmann
3ece3976ae
[newgrounds] implement login support (#394) 2019-11-16 23:45:32 +01:00
Mike Fährmann
ce98a86c0e
fix data file inclusion in source distributions 2019-11-09 00:47:13 +01:00
Mike Fährmann
4f39d2ae64
install bash completion into share/bash-completion/completions 2019-11-07 23:23:48 +01:00
Mike Fährmann
8f38a35b91
[imgur] use API with "public" client_id (#446) 
Using the API endpoints makes it possible to access NSFW content
without logging in.
 2019-10-23 21:43:55 +02:00
Mike Fährmann
b23c822b23
[luscious] use GraphQL 2019-10-22 21:17:08 +02:00
Mike Fährmann
5882b00f2f
[imgur] implement login support (#446) 2019-10-15 22:00:22 +02:00
Mike Fährmann
6779512fc7
[nozomi] add post and tag extractors (#388) 2019-10-13 22:16:03 +02:00
Mike Fährmann
5a1a0f5325
change text representation of user extractors to "User Profiles" 2019-09-22 22:21:48 +02:00
Mike Fährmann
6fe9a134bf
[lineblog] add blog and post extractors (closes #404) 2019-09-06 22:16:42 +02:00
Mike Fährmann
dd72ae7164
add postprocessor tests 2019-08-12 21:46:30 +02:00
Mike Fährmann
f687052daf
have e-hentai and exhentai on supportedsites.rst (#365) 2019-08-03 11:42:28 +02:00
Mike Fährmann
2c839f3760
[imgbb] add user extractor + login support (#361) 2019-08-01 21:39:20 +02:00
Mike Fährmann
2153206093
[imgbb] add album extractor (#361) 2019-07-30 23:11:19 +02:00
Mark Henrick
923e1bb714 [docs] Fix inconsistency about which sites have optional authentication (#359) 
* [docs] Fix inconsistency about which sites have optional authentication

* update authentication docs
 2019-07-29 18:22:31 +02:00
Mike Fährmann
dc73d02d87
[exhentai] always use e-hentai.org as domain + set nw cookie 2019-07-28 10:54:17 +02:00