2015-11-03 22:08:19 +01:00
|
|
|
==========
|
|
|
|
gallery-dl
|
|
|
|
==========
|
|
|
|
|
2017-05-09 15:43:55 +02:00
|
|
|
*gallery-dl* is a command-line program to download image-galleries and
|
2017-01-24 02:36:43 +01:00
|
|
|
-collections from several image hosting sites such as pixiv.net, exhentai.org,
|
2017-10-27 15:45:38 +02:00
|
|
|
danbooru.donmai.us and several more (see `Supported Sites`_).
|
|
|
|
It requires Python 3.3+ to run and works on Unix-like systems as well as on
|
|
|
|
Windows.
|
2016-07-25 11:13:54 +02:00
|
|
|
|
2015-11-03 22:08:19 +01:00
|
|
|
|
2018-01-09 15:10:40 +01:00
|
|
|
|pypi| |build| |gitter|
|
2017-01-25 02:31:36 +01:00
|
|
|
|
|
|
|
.. section-numbering::
|
|
|
|
|
|
|
|
|
2015-11-03 22:08:19 +01:00
|
|
|
Installation
|
2015-11-10 21:13:43 +01:00
|
|
|
============
|
2015-11-03 22:08:19 +01:00
|
|
|
|
2017-05-09 15:43:55 +02:00
|
|
|
Installation via pip
|
|
|
|
--------------------
|
|
|
|
|
|
|
|
The stable releases of *gallery-dl* are distributed on PyPI_ and can be
|
2017-10-27 15:45:38 +02:00
|
|
|
easily installed or upgraded using pip_:
|
2017-05-09 15:43:55 +02:00
|
|
|
|
|
|
|
.. code:: bash
|
|
|
|
|
2017-08-06 14:08:14 +02:00
|
|
|
$ pip install --upgrade gallery-dl
|
2017-05-09 15:43:55 +02:00
|
|
|
|
2017-10-27 15:45:38 +02:00
|
|
|
Installing the latest dev-version directly from GitHub can be done with
|
|
|
|
pip_ as well:
|
2015-11-03 22:08:19 +01:00
|
|
|
|
|
|
|
.. code:: bash
|
|
|
|
|
2017-08-06 14:08:14 +02:00
|
|
|
$ pip install --upgrade https://github.com/mikf/gallery-dl/archive/master.zip
|
2015-11-03 22:08:19 +01:00
|
|
|
|
2017-05-09 15:43:55 +02:00
|
|
|
|
|
|
|
Manual installation via Python
|
|
|
|
------------------------------
|
|
|
|
|
2017-06-02 09:08:08 +02:00
|
|
|
You can also install *gallery-dl* manually:
|
|
|
|
|
|
|
|
Get the code by either
|
|
|
|
|
|
|
|
* Downloading a stable_ or dev_ archive and unpacking it
|
|
|
|
* Or via :code:`git clone`
|
|
|
|
|
|
|
|
Navigate into the respective directory and run the :code:`setup.py` file.
|
2015-11-03 22:08:19 +01:00
|
|
|
|
|
|
|
.. code:: bash
|
|
|
|
|
2017-06-02 09:08:08 +02:00
|
|
|
$ wget https://github.com/mikf/gallery-dl/archive/master.zip
|
|
|
|
$ unzip master.zip
|
|
|
|
# or
|
2015-11-03 22:08:19 +01:00
|
|
|
$ git clone https://github.com/mikf/gallery-dl.git
|
2017-06-02 09:08:08 +02:00
|
|
|
|
2015-11-03 22:08:19 +01:00
|
|
|
$ cd gallery-dl
|
2017-05-09 15:43:55 +02:00
|
|
|
$ python setup.py install
|
|
|
|
|
2015-11-03 22:08:19 +01:00
|
|
|
|
2017-05-09 15:43:55 +02:00
|
|
|
Standalone executable (Windows only)
|
|
|
|
------------------------------------
|
|
|
|
|
|
|
|
Windows users can download a `standalone executable`_, which comes with a
|
|
|
|
Python interpreter and all required packages included.
|
2017-06-02 09:08:08 +02:00
|
|
|
|
2017-05-09 15:43:55 +02:00
|
|
|
Put this file in your PATH or use it from the current directory and you are
|
|
|
|
good to go,
|
2017-01-25 02:31:36 +01:00
|
|
|
|
2017-01-24 02:36:43 +01:00
|
|
|
|
2015-11-03 22:08:19 +01:00
|
|
|
Usage
|
2015-11-10 21:13:43 +01:00
|
|
|
=====
|
2015-11-03 22:08:19 +01:00
|
|
|
|
2017-05-09 15:43:55 +02:00
|
|
|
To use *gallery-dl* simply call it with the URLs you wish to download images
|
2017-01-24 02:36:43 +01:00
|
|
|
from:
|
2016-11-10 16:22:59 +01:00
|
|
|
|
2015-11-03 22:08:19 +01:00
|
|
|
.. code:: bash
|
|
|
|
|
2017-01-24 02:36:43 +01:00
|
|
|
$ gallery-dl [OPTION]... URL...
|
2015-11-03 22:08:19 +01:00
|
|
|
|
2016-11-10 16:22:59 +01:00
|
|
|
See also :code:`gallery-dl --help`.
|
|
|
|
|
2017-01-24 02:36:43 +01:00
|
|
|
|
|
|
|
Examples
|
|
|
|
--------
|
|
|
|
|
2017-10-27 15:45:38 +02:00
|
|
|
Download images; in this case from danbooru via tag search for 'bonocho':
|
2017-01-24 02:36:43 +01:00
|
|
|
|
|
|
|
.. code:: bash
|
|
|
|
|
2017-10-27 15:45:38 +02:00
|
|
|
$ gallery-dl http://danbooru.donmai.us/posts?tags=bonocho
|
2017-01-24 02:36:43 +01:00
|
|
|
|
|
|
|
|
|
|
|
Get the direct URL of an image from a site that requires authentication:
|
|
|
|
|
|
|
|
.. code:: bash
|
|
|
|
|
2017-01-25 02:31:36 +01:00
|
|
|
$ gallery-dl -g -u <username> -p <password> http://seiga.nicovideo.jp/seiga/im3211703
|
2017-01-24 02:36:43 +01:00
|
|
|
|
|
|
|
|
|
|
|
| Search a remote resource for URLs and download images from them:
|
|
|
|
| (URLs for which no extractor can be found will be silently ignored)
|
|
|
|
|
|
|
|
.. code:: bash
|
|
|
|
|
|
|
|
$ gallery-dl r:https://pastebin.com/raw/FLwrCYsT
|
|
|
|
|
|
|
|
|
2016-07-25 11:13:54 +02:00
|
|
|
Supported Sites
|
|
|
|
===============
|
|
|
|
|
2017-01-24 02:36:43 +01:00
|
|
|
* pixiv.net
|
|
|
|
* seiga.nicovideo.jp
|
|
|
|
* nijie.info
|
|
|
|
* mangastream.com
|
2017-04-05 12:16:23 +02:00
|
|
|
* kissmanga.com
|
2017-01-24 02:36:43 +01:00
|
|
|
* readcomiconline.to
|
|
|
|
* danbooru.donmai.us
|
|
|
|
* gelbooru.com
|
|
|
|
* exhentai.org
|
|
|
|
* nhentai.net
|
|
|
|
* luscious.net
|
2017-04-20 16:56:50 +02:00
|
|
|
* hentai-foundry.com
|
2017-01-24 02:36:43 +01:00
|
|
|
* deviantart.com
|
|
|
|
* tumblr.com
|
|
|
|
* `Complete List`_
|
|
|
|
|
2015-11-10 21:13:43 +01:00
|
|
|
|
2015-11-03 22:08:19 +01:00
|
|
|
Configuration
|
2015-11-10 21:13:43 +01:00
|
|
|
=============
|
2015-11-03 22:08:19 +01:00
|
|
|
|
2017-05-09 15:43:55 +02:00
|
|
|
Configuration files for *gallery-dl* use a JSON-based file format.
|
2015-11-03 22:08:19 +01:00
|
|
|
|
2018-03-12 18:15:30 +01:00
|
|
|
| For a (more or less) complete example with options set to their default values,
|
|
|
|
see gallery-dl.conf_.
|
|
|
|
| For a configuration file example with more involved settings and options,
|
|
|
|
see gallery-dl-example.conf_.
|
|
|
|
| A list of all available configuration options and their
|
|
|
|
descriptions can be found in configuration.rst_.
|
|
|
|
|
|
|
|
*gallery-dl* searches for configuration files in the following places:
|
2015-11-03 22:08:19 +01:00
|
|
|
|
2016-11-10 16:22:59 +01:00
|
|
|
+--------------------------------------------+------------------------------------------+
|
|
|
|
| Linux | Windows |
|
|
|
|
+--------------------------------------------+------------------------------------------+
|
|
|
|
|* ``/etc/gallery-dl.conf`` |* |
|
|
|
|
|* ``${HOME}/.config/gallery-dl/config.json``|* ``%USERPROFILE%\gallery-dl\config.json``|
|
|
|
|
|* ``${HOME}/.gallery-dl.conf`` |* ``%USERPROFILE%\gallery-dl.conf`` |
|
|
|
|
+--------------------------------------------+------------------------------------------+
|
2015-11-03 22:08:19 +01:00
|
|
|
|
2018-03-12 18:15:30 +01:00
|
|
|
(``%USERPROFILE%`` usually refers to the user's home directory,
|
2016-11-10 16:22:59 +01:00
|
|
|
i.e. ``C:\Users\<username>\``)
|
2015-11-03 22:08:19 +01:00
|
|
|
|
2016-11-10 16:22:59 +01:00
|
|
|
Values in later configuration files will override previous ones.
|
2015-11-03 22:08:19 +01:00
|
|
|
|
2017-01-24 02:36:43 +01:00
|
|
|
|
2016-07-25 11:13:54 +02:00
|
|
|
Authentication
|
|
|
|
==============
|
|
|
|
|
2017-06-23 16:14:51 +02:00
|
|
|
Username & Password
|
|
|
|
-------------------
|
|
|
|
|
|
|
|
Some extractors require you to provide valid login-credentials in the form of
|
|
|
|
a username & password pair.
|
|
|
|
This is necessary for ``pixiv``, ``nijie`` and ``seiga`` and optional
|
2018-03-12 18:15:30 +01:00
|
|
|
(but strongly recommended) for ``exhentai``, ``sankaku`` and ``idolcomplex``.
|
2016-07-25 11:13:54 +02:00
|
|
|
|
|
|
|
You can set the necessary information in your configuration file
|
|
|
|
(cf. gallery-dl.conf_)
|
|
|
|
|
|
|
|
.. code::
|
|
|
|
|
|
|
|
{
|
|
|
|
"extractor": {
|
|
|
|
...
|
2016-10-06 19:12:07 +02:00
|
|
|
"pixiv": {
|
2016-07-25 11:13:54 +02:00
|
|
|
"username": "<username>",
|
|
|
|
"password": "<password>"
|
|
|
|
}
|
|
|
|
...
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
or you can provide them directly via the
|
|
|
|
:code:`-u/--username` and :code:`-p/--password` or via the
|
|
|
|
:code:`-o/--option` command-line options
|
|
|
|
|
|
|
|
.. code:: bash
|
|
|
|
|
|
|
|
$ gallery-dl -u <username> -p <password> URL
|
|
|
|
$ gallery-dl -o username=<username> -o password=<password> URL
|
|
|
|
|
2017-06-23 16:14:51 +02:00
|
|
|
OAuth
|
|
|
|
-----
|
|
|
|
|
2017-12-18 00:12:08 +01:00
|
|
|
*gallery-dl* supports user authentication via OAuth_ for
|
2018-05-10 18:58:05 +02:00
|
|
|
``deviantart``, ``flickr``, ``reddit``, ``smugmug`` and ``tumblr``.
|
2017-12-18 00:12:08 +01:00
|
|
|
This is entirely optional, but grants *gallery-dl* the ability
|
2017-06-23 16:14:51 +02:00
|
|
|
to issue requests on your account's behalf and enables it to access resources
|
|
|
|
which would otherwise be unavailable to a public user.
|
|
|
|
|
|
|
|
To link your account to *gallery-dl*, start by invoking it with
|
|
|
|
``oauth:<site-name>`` as an argument. For example:
|
|
|
|
|
|
|
|
.. code:: bash
|
|
|
|
|
|
|
|
$ gallery-dl oauth:flickr
|
|
|
|
|
|
|
|
You will be sent to the site's authorization page and asked to grant read
|
|
|
|
access to *gallery-dl*. Authorize it and you will he shown one or more
|
|
|
|
"tokens", which should be added to your configuration file.
|
|
|
|
|
2017-01-25 02:31:36 +01:00
|
|
|
|
2018-03-12 18:15:30 +01:00
|
|
|
.. _gallery-dl.conf: https://github.com/mikf/gallery-dl/blob/master/docs/gallery-dl.conf
|
|
|
|
.. _gallery-dl-example.conf: https://github.com/mikf/gallery-dl/blob/master/docs/gallery-dl-example.conf
|
|
|
|
.. _configuration.rst: https://github.com/mikf/gallery-dl/blob/master/docs/configuration.rst
|
|
|
|
.. _Complete List: https://github.com/mikf/gallery-dl/blob/master/docs/supportedsites.rst
|
2018-06-22 16:35:21 +02:00
|
|
|
.. _standalone executable: https://github.com/mikf/gallery-dl/releases/download/v1.4.1/gallery-dl.exe
|
2016-11-10 16:22:59 +01:00
|
|
|
.. _Python: https://www.python.org/downloads/
|
|
|
|
.. _Requests: https://pypi.python.org/pypi/requests/
|
2017-01-24 02:36:43 +01:00
|
|
|
.. _PyPI: https://pypi.python.org/pypi
|
2016-11-10 16:22:59 +01:00
|
|
|
.. _pip: https://pip.pypa.io/en/stable/
|
2018-06-22 16:35:21 +02:00
|
|
|
.. _stable: https://github.com/mikf/gallery-dl/archive/v1.4.1.zip
|
2017-05-10 16:44:26 +02:00
|
|
|
.. _dev: https://github.com/mikf/gallery-dl/archive/master.zip
|
2017-06-23 16:14:51 +02:00
|
|
|
.. _OAuth: https://en.wikipedia.org/wiki/OAuth
|
2017-01-25 02:31:36 +01:00
|
|
|
|
|
|
|
.. |pypi| image:: https://img.shields.io/pypi/v/gallery-dl.svg
|
|
|
|
:target: https://pypi.python.org/pypi/gallery-dl
|
|
|
|
|
|
|
|
.. |build| image:: https://travis-ci.org/mikf/gallery-dl.svg?branch=master
|
|
|
|
:target: https://travis-ci.org/mikf/gallery-dl
|
2018-01-09 15:10:40 +01:00
|
|
|
|
|
|
|
.. |gitter| image:: https://badges.gitter.im/gallery-dl/main.svg
|
|
|
|
:target: https://gitter.im/gallery-dl/main
|