Mike Fährmann
c6c4a73f87
update fanbox entry in supportedsites.md
2021-04-25 19:44:19 +02:00
thatfuckingbird
e47952ac14
add extractors for fantia and fanbox ( #1459 )
...
* add extractors for fantia and fanbox
* appease linter
* make docstrings unique
* [fantia] refactor post extraction
* [fantia] capitalize
* [fantia] improve regex pattern
* code style
* capitalize
* [fanbox] use BASE_PATTERN for url regexes
* [fanbox] refactor metadata and post extraction
* [fanbox] improve url base pattern
* [fanbox] accept creator page links ending with /posts
* [fanbox] more tests
* [fantia] improved pagination
* [fanbox] misc. code logic improvements
* [fantia] finish restructuring pagination code
* [fanbox] avoid making a request for each individual post when processing a creator page
* [fanbox] support embedded videos
* [fanbox] fix errors
* [fanbox] document extractor.fanbox.videos
* [fanbox] handle "article" and "entry" post types, all embeds
* [fanbox] fix downloading of embedded fanbox posts
2021-04-25 19:39:13 +02:00
Mike Fährmann
77a9cc6fd6
update supportedsites.md entry for Instagram
2021-04-23 23:21:01 +02:00
Hans Christian Gunawan
334d690687
[hentaicosplays] Add extractor ( #1473 )
2021-04-18 20:28:00 +02:00
Mike Fährmann
086925e685
[shopify] support omgmiamiswimwear.com ( closes #1280 )
2021-04-13 23:54:03 +02:00
Mike Fährmann
78d7ee3ef4
[yuki] remove module for yuki.la
2021-04-12 21:42:32 +02:00
Mike Fährmann
d5aad999dc
[tapas] implement login with username & password ( #692 )
2021-03-30 01:45:28 +02:00
Mike Fährmann
62cfee4d28
[vk] initial support for albums ( #474 )
2021-03-23 19:02:16 +01:00
Mike Fährmann
91c2e15da9
[deviantart] add support for posts from watched users ( #794 )
2021-03-22 19:25:04 +01:00
Mike Fährmann
69ca4e29f1
[deviantart] add 'watch' extractor ( #794 )
2021-03-17 22:50:02 +01:00
Mike Fährmann
c485d0a956
[philomena] add generalized extractors for philomena sites
...
(closes #1379 )
2021-03-14 17:19:57 +01:00
Mike Fährmann
72fe9ac0f3
[gelbooru_v01] support some more boorus by default
...
- https://drawfriends.booru.org/
- https://vidyart.booru.org/
- https://tlb.booru.org/
2021-03-14 17:19:56 +01:00
Mike Fährmann
ec98b2c56f
categorize sites in supportedsites.md by basecategory
2021-03-12 16:53:36 +01:00
Mike Fährmann
a67e002f40
update docs/supportedsites
...
- use Markdown with inline HTML instead of reStructuredText
- move file from docs/supportedsites.rst to docs/supportedsites.md
- update Makefile, README, etc
2021-03-12 03:03:48 +01:00
Mike Fährmann
4be27ff0fe
[nozomi] support '/index-N.html' URLs ( closes #1365 )
...
and '/index-Popular-N.html'
2021-03-11 01:06:47 +01:00
Seonghyeon Cho
665499924d
Support naver webtoon ( #1331 )
...
* Support naver webtoon (WIP)
* Apply patch
* Change filename format
* Fill test results
* Fill test result
2021-03-03 15:21:13 +01:00
topozorra
a9119da4d4
support tumblrgallery.xyz
( #1298 )
...
* support `tumblrgallery.xyz`
* fix format issues
* Refactor and add post and search page support
* Fix warnings
* Few improvments
* Better file names
* Fix linting errors
* move id closer to the begining of the file name
Co-authored-by: topozorra <none>
2021-03-03 15:20:47 +01:00
Mike Fährmann
e165e6c265
[wallhaven] add 'collections' extractor ( #1351 )
2021-03-02 01:32:26 +01:00
Mike Fährmann
e39aea42cd
fix supportedsites.py for modules without docstring
...
(fixes #1332 )
2021-02-21 22:57:37 +01:00
Mike Fährmann
03b219db9d
fix supportedsites.py
2021-02-20 22:31:21 +01:00
Mike Fährmann
8974f0361c
[pixiv] update ( #1304 )
...
- remove login with username & password
- require a refresh token
- add 'oauth:pixiv' functionality
See also:
- https://github.com/upbit/pixivpy/issues/158
- https://gist.github.com/ZipFile/c9ebedb224406f4f11845ab700124362
2021-02-12 18:07:16 +01:00
Mike Fährmann
ae530f6365
[erome] add extractors for albums, users, searches ( closes #409 )
2021-02-07 22:58:19 +01:00
Mike Fährmann
e1bdd2ab67
add a 'generated by …' comment to supportedsites.rst
2021-01-23 17:24:02 +01:00
Mike Fährmann
0eea424a52
update supportedsites.rst
2021-01-22 19:41:50 +01:00
Mike Fährmann
fa8ee6eac4
[derpibooru] add search and gallery extractors ( #862 )
2021-01-07 18:05:32 +01:00
Mike Fährmann
b0beed7a06
[sankaku] add support for book searches ( closes #1204 )
2020-12-29 17:36:37 +01:00
Mike Fährmann
6cdbab07b5
[pinterest] add support for getting all boards of a user
...
(#1205 )
2020-12-29 16:57:03 +01:00
Mike Fährmann
bf629a2818
[instagram] add 'include' option ( closes #1180 )
...
Split the functionality of the old 'user' extractor into separate
'posts' and 'highlights' extractors, which respond to virtual URLs
('/<user>/posts' and '/<user>/highlights')
2020-12-21 02:06:28 +01:00
Mike Fährmann
465015f75a
[sankaku] reimplement login support ( #1176 , #1182 )
2020-12-17 16:12:59 +01:00
Mike Fährmann
b2c55f0a72
[sankaku] remove login support
...
The old login method for 'https://chan.sankakucomplex.com/user/login '
and the cookies it produces have no effect on the results from
'beta.sankakucomplex.com'.
2020-12-08 21:05:47 +01:00
Mike Fährmann
de0c57886d
[twitter] add 'list-members' extractor ( closes #1096 )
2020-11-13 06:47:45 +01:00
Mike Fährmann
05d7009cc6
rename 'Authentication' entries in supportedsites.rst
...
- change 'Optional' to 'Supported'
- use 'OAuth' and 'Cookies' in their own
- add link to weasyl API key option
2020-10-19 20:16:17 +02:00
Zanny
3ec60e894a
[weasyl] api-key authentication ( #1057 )
...
* [weasyl] support api keys
* [weasyl] document api-key authentication
* [weasyl] usernames can contain ~
2020-10-15 15:12:09 +02:00
Mike Fährmann
b9bdd2c564
[hentaifoundry] add support for stories ( closes #734 )
2020-09-27 02:27:40 +02:00
Mike Fährmann
e9cc719497
[weasyl] update and simplify
...
- simplify 'pattern' regexps
- parse 'posted_at' as 'date'
- use unaltered 'title' ({title!l:R /_/} to lowercase and replace spaces)
2020-09-26 02:10:45 +02:00
Mike Fährmann
c43b3894be
[myhentaigallery] update and fix extraction ( #1001 )
...
- extract more metadata
- match "/show/" URLs
- complete test results
- fix missing images for lines starting with " <img"
- fix missing comma in supportedsites.py
2020-09-17 18:14:23 +02:00
choeronline
05b9ac8d37
[myhentaigallery] add extractor ( #1001 )
...
* adds support for myhentaigallery
* fixes linting issues in myhentaigallery extractor
2020-09-17 17:32:54 +02:00
ArtaxIsSleeping
0e941553ec
[aryion] Add username/password support ( #960 )
...
* Add username/password support to aryion extractor
* Update docs to match
* Fix code style
2020-08-27 22:45:30 +02:00
Mike Fährmann
901a897e6f
[inkbunny] mention login support
2020-07-26 23:52:52 +02:00
Mike Fährmann
d5fcffcced
[subscribestar] add login capabilities ( #852 )
2020-07-17 22:18:01 +02:00
Mike Fährmann
df7217c36d
update supportedsites.py ( #889 , #893 )
...
- mention optional auth access for more sites
- link to OAuth and Cookies sections in README
2020-07-16 15:00:31 +02:00
jakem72360
7dfdcc3fbf
[mangakakalot] Added extractors for MangaKakalot ( #876 )
2020-07-13 21:20:09 +02:00
Mike Fährmann
0f459f340b
[instagram] fix and re-enable login with username&password
...
This reverts commit 3e0848a482
.
(#756 , #771 , #797 , #803 )
https://github.com/althonos/InsaLooter/issues/287#issuecomment-630456522
2020-05-31 00:29:09 +02:00
Mike Fährmann
3e0848a482
[instagram] disable login with username&password ( #756 )
2020-05-29 23:29:40 +02:00
Leonardo Taccari
39cd389679
[webtoons] Add a new extractor for webtoons.com ( #761 )
...
The webtoons extractor can extract episode and entire comic (all
episodes) from webtoons.com.
All the logic of the extractors should be trivial except for a couple
of kludges needed:
- `ageGatePass' cookie is always set to avoid possible redirect and stop of
extraction, especially in the comic extractor
- The image URLs returned by the episode extractor could not be fetched
directly and the `Referer:' HTTP header needs to be passed to fetch them
Close #593 .
2020-05-18 19:04:20 +02:00
Bepis
7b5711ee04
[imagechest] Add new extractor for ImageChest ( #750 )
...
* [imagechest] Add new extractor for ImageChest
* [imagechest] Fix flake8 compliance issues
2020-05-18 19:02:56 +02:00
Mike Fährmann
f557cac074
[redgifs] add image extractor ( #724 )
2020-05-10 00:31:42 +02:00
Leonardo Taccari
b47cfc5ac9
[speakerdeck] Add a new extractor for speakerdeck.com ( #726 )
2020-05-01 22:32:22 +02:00
Mike Fährmann
6143050980
[aryion] add gallery and post extractors ( #390 , #673 )
2020-04-08 21:52:51 +02:00
Mike Fährmann
2587296deb
[mastodon] add access tokens for mastodon.social and baraag.net
...
(closes #665 )
2020-04-02 22:34:32 +02:00