84 Commits

Author	SHA1	Message	Date
Mike Fährmann	a247c94c34	[sexcom] add pin and board extractors (#147)	2019-04-24 22:09:19 +02:00
Mike Fährmann	166a721c19	include PyInstaller executable in release script	2019-04-17 12:44:45 +02:00
Mike Fährmann	18345381f3	add PyInstaller script and hook (#166)	2019-04-17 12:43:29 +02:00
Mike Fährmann	96c7ccd380	update/cleanup Python dev scripts ... - put common code in its own util.py file - same Python3 shebang for all scripts - add file docstrings - fix format string replacement fields in man page template	2019-04-16 21:21:34 +02:00
Mike Fährmann	d9b94a585d	[mangoxo] add login support (#184) ... A very recent change: It is now only possible to see more than the first 5 images of an album if you are logged in.	2019-04-10 18:55:25 +02:00
Mike Fährmann	e730fc9045	[twitter] add login support (#214)	2019-04-09 09:27:49 +02:00
Mike Fährmann	35919a9bb8	[livedoor] add blog- and post-extractors (#190)	2019-04-06 16:27:48 +02:00
Mike Fährmann	2ff043edfa	[yaplog] add user- and post-extractors (#190)	2019-04-04 17:56:56 +02:00
Mike Fährmann	c70b21248d	[wikiart] add extractors (#179) ... for - artists: https://www.wikiart.org/en/thomas-cole - artist-listings: https://www.wikiart.org/en/artists-by-century/12 - artwork-listings: https://www.wikiart.org/en/paintings-by-media/grisaille	2019-04-02 17:34:57 +02:00
Mike Fährmann	089923e3dd	parse configuration.rst to build gallery-dl.conf.5 (#150) ... … a man-page containing all of gallery-dl's configuration file options. This implementation relies on Python dicts preserving their insertion order. Python 3.4 and 3.5 need to use OrderedDict or they produce randomly ordered man-page sections. The man-page formatting is a bit rough around the edges, but it works for the most part. The only real "problem" are inline-links, but it's better if they are left in there.	2019-03-28 16:20:52 +01:00
Mike Fährmann	e5f44a5160	add Makefile; include manpage&completion in setup.py (#150)	2019-03-24 11:03:02 +01:00
Mike Fährmann	e47a24afc7	script to generate a simple man page (#150)	2019-03-24 11:03:01 +01:00
Mike Fährmann	b0f88c2ab5	script to generate a simple bash completion file (#150)	2019-03-23 09:50:39 +01:00
Mike Fährmann	6277a739e4	[35photo] add user-, genre-, and image-extractors (#162)	2019-03-18 01:11:30 +01:00
Mike Fährmann	9c0e2f294b	[shopify] add generic collection and product extractors (#175) ... with fashionnova.com as a default domain	2019-03-05 22:33:37 +01:00
Mike Fährmann	ea6fbfdd39	simplify build_supportedsites.py	2019-02-21 14:29:19 +01:00
Mike Fährmann	ee2ad76620	update and improve create_test_data.py script	2019-02-20 15:48:31 +01:00
Mike Fährmann	abbd45d0f4	update handling of extractor URL patterns ... When loading extractor classes during 'extractor.find(…)', their 'pattern' attribute will be replaced with a compiled version of itself.	2019-02-08 20:08:16 +01:00
Mike Fährmann	53c2fd4664	add mastodon/foolslide/foolfuuka examples to example config	2019-02-05 16:17:25 +01:00
Mike Fährmann	373cb07b28	update .travis.yml and run_tests.sh ... - add python3.8 and pypy3 builds - remove deprecated 'sudo: true' and 'sudo: false' - enable builds for 'test-...' branches	2019-01-31 15:58:52 +01:00
Mike Fährmann	bfbbac4495	[tsumino] add login capabilities (#161)	2019-01-30 17:58:48 +01:00
Mike Fährmann	0156189468	[hentaifox] add chapter extractor (#160)	2019-01-28 18:00:32 +01:00
Mike Fährmann	e4171d6baf	[luscious] add login capabilities (closes #159)	2019-01-28 17:14:15 +01:00
Mike Fährmann	e53cdfd6a8	update build_supportedsites.py	2019-01-09 14:58:35 +01:00
Mike Fährmann	6c71e9cf5d	[deviantart] add separate 'sta.sh' extractor (#113) ... - supports multiple stashed deviations per page - explicitly mentions sta.sh support on supportedsites.rst	2018-12-26 18:56:57 +01:00
Mike Fährmann	fb53b5dd55	fix control+c during -j and range tests	2018-11-25 18:54:05 +01:00
Mike Fährmann	3c25fa2dad	update build_testresult_db.py script	2018-11-15 22:58:14 +01:00
Mike Fährmann	2cf3f53839	[yuki] add thread extractor (closes #111)	2018-09-28 12:47:32 +02:00
Mike Fährmann	17611bfec0	update build_supportedsites.py script	2018-09-28 12:43:19 +02:00
Mike Fährmann	c402cc4047	[hentaifoundry] add 'popular' and 'recent' extractors ... for "Popular Pictures" and "Recent Pictures" listings	2018-09-24 13:11:18 +02:00
Mike Fährmann	6ea9a78588	[wallhaven] add login capabilities ... Being logged in is required to access NSFW wallpapers.	2018-09-19 21:04:01 +02:00
Mike Fährmann	69fd61ea86	[bobx] add gallery and model extractors	2018-09-13 20:13:12 +02:00
Mike Fährmann	3ecea4cf36	[hentaicafe] add chapter and manga extractors (#101)	2018-09-05 21:08:40 +02:00
Mike Fährmann	75862715ac	[behance] add user extractor	2018-08-31 17:42:09 +02:00
Mike Fährmann	e9dd2eff1d	[twitter] add extractor for media-tweet timelines (#96) ... For example "https://twitter.com/PicturesEarth/media". They are different from normal timelines in that they do not contain any (re)tweets from other users and feature all media the user ever posted, including responses to other tweets.	2018-08-19 20:46:12 +02:00
Mike Fährmann	63fa0b2006	[pinterest] add extractors for related pins ... Related pins can not be accessed by adding a "#related" fragment to the end of a Pinterest URL, for example: - https://www.pinterest.com/pin/858146903966145189/#related - https://www.pinterest.com/g1952849/test-/#related There are no explicit real URLs for related pins, using an option to enable them results in "clunky" code, and a custom "related:<URL>" scheme doesn't feel right either.	2018-08-15 21:49:45 +02:00
Mike Fährmann	84854fcad7	[myportfolio] add user and gallery extractors (#95)	2018-07-19 18:56:45 +02:00
Mike Fährmann	a6fe2bb594	[whatisthisimnotgoodwithcomputers] remove extractor	2018-07-14 09:53:16 +02:00
Mike Fährmann	55b0913412	[simplyhentai] add gallery extractor (#89)	2018-05-27 15:25:04 +02:00
Mike Fährmann	f3483a2b7c	[smugmug] add OAuth support	2018-05-10 18:58:05 +02:00
Mike Fährmann	82c50fa609	release version 1.3.5	2018-05-04 10:03:20 +02:00
Mike Fährmann	16e014baaa	[smugmug] added image and album extractor ... just some initial code that still requires a lot of work ... TODO: - folders - old-style albums (which are nearly all of them ...) - images from users - OAuth It could also happen that the API credentials used will become invalid whenever my 14 day trial period ends (7 days remaining), but that would just require users to supply their own.	2018-04-29 21:27:25 +02:00
Mike Fährmann	d10579edb5	[pinterest] improve PinterestAPI code; remove OAuth mentions ... on another note: access_tokens have been set to only allow for 10 requests per hour (from 200 yesterday)	2018-04-17 17:12:42 +02:00
Mike Fährmann	4bd182c107	[pinterest] implement oauth:pinterest (#83) ... Pinterest access tokens are rate limited at 200 requests per hour (or maybe per 2 or 3 hours?) so having just one access token for all users isn't going to work in the long run.	2018-04-16 20:03:28 +02:00
Mike Fährmann	7b562907c3	[nijie] add favorites extractor ... adds support for 'https://nijie.info/user_like_illust_view.php?id=...'	2018-03-31 18:54:25 +02:00
Mike Fährmann	299ae24996	[test] add a few downloader tests	2018-03-25 15:10:25 +02:00
Mike Fährmann	dd314279fb	[test] add unit tests for extractor module functions	2018-03-25 11:49:42 +02:00
Mike Fährmann	d75dc71394	fix travis tests	2018-03-19 18:07:19 +01:00
Mike Fährmann	8ef790de12	update .travis.yml ... - restrict builds to master branch and release tags - implement 'core' and 'results' test categories	2018-03-19 17:57:32 +01:00
Mike Fährmann	7121eeae8b	check supportedsites.rst in release script	2018-03-17 15:35:38 +01:00