Mike Fährmann
a6f689e01a
[deviantart] add gallery-folder extractor ( #26 )
...
The code for this and the available metadata is probably going
to change again. This extractor is very similar to the favorite-
extractor, so they might be "combined" or something like that.
2017-07-03 21:57:10 +02:00
Mike Fährmann
1dac76fd1c
update extractor docstrings
2017-06-28 17:39:07 +02:00
Mike Fährmann
e1d82af5e0
small fixes
2017-06-22 18:46:42 +02:00
Mike Fährmann
c921b4f32a
code cleanup and fixing tests
2017-06-02 09:10:58 +02:00
Mike Fährmann
bce51e90a5
[reddit] support sorting options and sub-options ( #15 )
...
Example:
https://www.reddit.com/r/ <subreddit>/top/?sort=top&t=month
(the 'sort=top' parameter is irrelevant and can be omitted)
2017-05-29 12:45:35 +02:00
Mike Fährmann
cbb4323f66
add setup.cfg to configure flake8
2017-05-19 19:22:39 +02:00
Mike Fährmann
b6b214f7e9
[deviantart] fix headers for custom-style journals
...
example: http://shimoda7.deviantart.com/journal/Temporary-absence-231936282
2017-05-15 15:58:06 +02:00
Mike Fährmann
e9a2738257
[deviantart] support images on top of journal entries
...
example: http://raxnae.deviantart.com/art/Kami-s-Journal-679482236
2017-05-13 21:42:29 +02:00
Mike Fährmann
92597f46d4
[deviantart] add title to journals
2017-05-13 15:36:52 +02:00
Mike Fährmann
107d29ad8a
improve handling of text:... URLs
...
- don't require // after the colon
- open output files in text mode
2017-05-12 14:10:25 +02:00
Mike Fährmann
677c8ced11
[deviantart] add "journal" extractor
...
(#14 )
2017-05-10 17:21:33 +02:00
Mike Fährmann
e5f79ae839
[deviantart] add support for all media types
...
- this includes
- images
- videos
- flash-animations
- journals
- also renamed some of the extractors
- User -> Gallery
- Image -> Deviation
2017-05-10 16:45:45 +02:00
Mike Fährmann
9f1c83297f
[pinterest] allow URLs with any TLD
2017-05-08 15:08:39 +02:00
Mike Fährmann
b3b92ac243
[deviantart] support "All" favorites and add "mature" option
...
- since there is apparently no actual way to get the "All" favorites
listing via API, corresponding URLs (.../favourites/?catpath=/) will
be handled by yielding all deviations from all favorite collections of
that user
- the "mature" config key works on a per extractor basis (like "username"
or "password"). values can be the strings "true" or "false", or the
booleans true or false.
- (#14 )
2017-05-06 21:26:27 +02:00
Mike Fährmann
7376ad7f3d
[deviantart] turn the "Mature Content Filter" off
...
(#14 )
2017-05-06 14:56:41 +02:00
Mike Fährmann
af56887a47
[exhentai] fall back to e-hentai if no username is given
2017-04-28 15:59:56 +02:00
Mike Fährmann
13dc5d72bc
update some extractors to use https
2017-04-20 13:32:40 +02:00
Mike Fährmann
0770de0ea1
[deviantart:image] add support for sta.sh URLs
2017-04-17 11:52:16 +02:00
Mike Fährmann
11ce871718
[deviantart] add favourites-extractor
2017-04-03 18:23:13 +02:00
Mike Fährmann
d430732502
[deviantart] update extractors
...
- use base class for all extractors
- use API for single images
- add support for more API endpoints
- add additional keywords
2017-04-03 14:56:47 +02:00
Mike Fährmann
f622411be5
[deviantart] implement 'skip' method
2017-03-13 21:42:16 +01:00
Mike Fährmann
379125746a
[deviantart] improve API error handling
...
(#7 )
2017-03-08 16:40:20 +01:00
Mike Fährmann
2c2de778f2
[deviantart] adjust error message
2017-03-06 19:27:45 +01:00
Mike Fährmann
f36d685ce1
[deviantart] always request access token before api calls
...
(#7 )
2017-03-05 02:22:36 +01:00
Mike Fährmann
38aa496ecb
[deviantart] restore tests + set api version
2017-02-23 20:58:39 +01:00
Mike Fährmann
39b1a18f12
[deviantart] fix issue with missing 'content'-key
2017-02-22 01:42:08 +01:00
Mike Fährmann
94e10f249a
code adjustments according to pep8 nr2
2017-02-01 00:53:19 +01:00
Mike Fährmann
72d3ca0bf9
[deviantart] use API for user-extractor
2017-01-12 21:08:49 +01:00
Mike Fährmann
58ce0b55e3
[deviantart] make sure to pick the highest quality image
2016-11-06 10:44:50 +01:00
Mike Fährmann
56d810c896
update keyword hashes for tests
2016-09-25 17:28:46 +02:00
Mike Fährmann
19c2d4ff6f
remove explicit (sub)category keywords
2016-09-25 14:22:07 +02:00
Mike Fährmann
d7e168799d
consistent extractor naming scheme + docstrings
2016-09-12 10:34:31 +02:00
Mike Fährmann
2449532132
add more extractor test-cases
2015-12-13 04:36:44 +01:00
Mike Fährmann
5589bc2ed7
[deviantart] fix non-terminating loop
2015-12-13 03:16:08 +01:00
Mike Fährmann
995d8578bf
[deviantart] fix dates in image-extractor
2015-12-07 00:34:41 +01:00
Mike Fährmann
7d965a2897
[deviantart] add single image extractor
2015-12-06 21:13:57 +01:00
Mike Fährmann
e4a661fd6b
[deviantart] fix issue with small images
2015-12-06 14:24:27 +01:00
Mike Fährmann
4d56b76aa8
update all other extractors
2015-11-21 04:26:30 +01:00
Mike Fährmann
c2f0720184
code cleanup to use nameext_from_url
2015-11-16 17:32:26 +01:00
Mike Fährmann
7d7c1afe20
[deviantart] adjust constructor paramters
2015-10-05 17:06:58 +02:00
Mike Fährmann
ae535ba0c1
add extractor 'deviantart'
2015-10-04 04:13:50 +02:00
