2016-10-14 18:30:36 -04:00
---
title: "dockerd"
description: "The daemon command description and usage"
2016-11-03 18:48:30 -04:00
keywords: "container, daemon, runtime"
2023-11-06 12:25:49 -05:00
aliases:
2020-02-19 18:19:06 -05:00
- /engine/reference/commandline/daemon/
2016-10-14 18:30:36 -04:00
---
2015-06-21 16:41:38 -04:00
2017-10-04 13:03:55 -04:00
<!-- This file is maintained within the docker/cli GitHub
2017-07-28 13:28:23 -04:00
repository at https://github.com/docker/cli/. Make all
2016-10-19 13:25:45 -04:00
pull requests against that repo. If you see this file in
another repository, consider it read-only there, as it will
periodically be overwritten by the definitive file. Pull
requests which include edits to this file in other repositories
will be rejected.
-->
2015-06-21 16:41:38 -04:00
# daemon
2016-07-15 19:52:59 -04:00
```markdown
2022-04-02 08:07:51 -04:00
Usage: dockerd [OPTIONS]
2016-07-15 19:52:59 -04:00
A self-sufficient runtime for containers.
Options:
2017-02-14 19:07:50 -05:00
--add-runtime runtime Register an additional OCI compatible runtime (default [])
2020-05-04 06:17:36 -04:00
--allow-nondistributable-artifacts list Allow push of nondistributable artifacts to registry
--authorization-plugin list Authorization plugins to load
2016-09-25 10:26:46 -04:00
--bip string Specify network bridge IP
-b, --bridge string Attach containers to a network bridge
2024-01-18 07:24:23 -05:00
--cdi-spec-dir list CDI specification directories to use
2016-09-25 10:26:46 -04:00
--cgroup-parent string Set parent cgroup for all containers
--config-file string Daemon configuration file (default "/etc/docker/daemon.json")
2020-05-04 06:17:36 -04:00
--containerd string containerd grpc address
2020-11-06 15:34:10 -05:00
--containerd-namespace string Containerd namespace to use (default "moby")
--containerd-plugins-namespace string Containerd namespace to use for plugins (default "plugins.moby")
2020-05-04 06:22:02 -04:00
--cpu-rt-period int Limit the CPU real-time period in microseconds for the
2022-04-02 08:07:51 -04:00
parent cgroup for all containers (not supported with cgroups v2)
2020-05-04 06:22:02 -04:00
--cpu-rt-runtime int Limit the CPU real-time runtime in microseconds for the
2022-04-02 08:07:51 -04:00
parent cgroup for all containers (not supported with cgroups v2)
2020-05-04 06:17:36 -04:00
--cri-containerd start containerd with cri
2016-11-22 01:17:24 -05:00
--data-root string Root directory of persistent Docker state (default "/var/lib/docker")
2016-09-25 10:26:46 -04:00
-D, --debug Enable debug mode
2020-05-04 06:17:36 -04:00
--default-address-pool pool-options Default address pools for node specific local networks
2022-04-02 08:07:51 -04:00
--default-cgroupns-mode string Default mode for containers cgroup namespace ("host" | "private") (default "private")
2017-02-14 19:07:50 -05:00
--default-gateway ip Container default gateway IPv4 address
--default-gateway-v6 ip Container default gateway IPv6 address
2020-05-04 06:17:36 -04:00
--default-ipc-mode string Default mode for containers ipc ("shareable" | "private") (default "private")
2023-11-03 09:20:54 -04:00
--default-network-opt mapmap Default network options (default map[])
2016-09-25 10:26:46 -04:00
--default-runtime string Default OCI runtime for containers (default "runc")
2020-05-04 06:17:36 -04:00
--default-shm-size bytes Default shm size for containers (default 64MiB)
2017-02-14 19:07:50 -05:00
--default-ulimit ulimit Default ulimits for containers (default [])
2020-05-04 06:17:36 -04:00
--dns list DNS server to use
--dns-opt list DNS options to use
--dns-search list DNS search domains to use
--exec-opt list Runtime execution options
2016-09-25 10:26:46 -04:00
--exec-root string Root directory for execution state files (default "/var/run/docker")
2016-10-06 10:09:54 -04:00
--experimental Enable experimental features
2024-09-16 05:28:41 -04:00
--feature map Enable feature in the daemon
2016-09-25 10:26:46 -04:00
--fixed-cidr string IPv4 subnet for fixed IPs
--fixed-cidr-v6 string IPv6 subnet for fixed IPs
-G, --group string Group for the unix socket (default "docker")
--help Print usage
2020-05-04 06:17:36 -04:00
-H, --host list Daemon socket(s) to connect to
2020-05-04 06:22:02 -04:00
--host-gateway-ip ip IP address that the special 'host-gateway' string in --add-host resolves to.
Defaults to the IP address of the default bridge
2022-04-02 08:07:51 -04:00
--http-proxy string HTTP proxy URL to use for outgoing traffic
--https-proxy string HTTPS proxy URL to use for outgoing traffic
2016-09-25 10:26:46 -04:00
--icc Enable inter-container communication (default true)
--init Run an init in the container to forward signals and reap processes
--init-path string Path to the docker-init binary
2020-05-04 06:17:36 -04:00
--insecure-registry list Enable insecure registry communication
2017-02-14 19:07:50 -05:00
--ip ip Default IP when binding container ports (default 0.0.0.0)
2016-09-25 10:26:46 -04:00
--ip-forward Enable net.ipv4.ip_forward (default true)
--ip-masq Enable IP masquerading (default true)
2022-04-02 08:07:51 -04:00
--ip6tables Enable addition of ip6tables rules (experimental)
2016-09-25 10:26:46 -04:00
--iptables Enable addition of iptables rules (default true)
--ipv6 Enable IPv6 networking
2020-05-04 06:17:36 -04:00
--label list Set key=value labels to the daemon
2017-02-14 19:07:50 -05:00
--live-restore Enable live restore of docker when containers are still running
2016-09-25 10:26:46 -04:00
--log-driver string Default driver for container logs (default "json-file")
2024-09-16 07:16:13 -04:00
--log-format string Set the logging format ("text"|"json") (default "text")
2020-05-04 06:17:36 -04:00
-l, --log-level string Set the logging level ("debug"|"info"|"warn"|"error"|"fatal") (default "info")
2017-02-14 19:07:50 -05:00
--log-opt map Default log driver options for containers (default map[])
2022-10-26 06:03:07 -04:00
--max-concurrent-downloads int Set the max concurrent downloads (default 3)
--max-concurrent-uploads int Set the max concurrent uploads (default 5)
2019-10-14 07:33:37 -04:00
--max-download-attempts int Set the max download attempts for each pull (default 5)
2017-02-14 19:07:50 -05:00
--metrics-addr string Set default address and port to serve the metrics api on
2022-04-02 08:07:51 -04:00
--mtu int Set the containers network MTU (default 1500)
2020-05-04 06:17:36 -04:00
--network-control-plane-mtu int Network Control plane MTU (default 1500)
2017-05-01 10:15:03 -04:00
--no-new-privileges Set no-new-privileges by default for new containers
2022-04-02 08:07:51 -04:00
--no-proxy string Comma-separated list of hosts or IP addresses for which the proxy is skipped
2020-05-04 06:17:36 -04:00
--node-generic-resource list Advertise user-defined resource
2023-04-12 12:45:20 -04:00
--oom-score-adjust int Set the oom_score_adj for the daemon
2016-09-25 10:26:46 -04:00
-p, --pidfile string Path to use for daemon PID file (default "/var/run/docker.pid")
--raw-logs Full timestamps without ANSI coloring
2022-04-01 09:32:55 -04:00
--registry-mirror list Preferred registry mirror
2020-05-04 06:22:02 -04:00
--rootless Enable rootless mode; typically used with RootlessKit
2023-04-12 12:41:27 -04:00
--seccomp-profile string Path to seccomp profile. Use "unconfined" to disable the default seccomp profile (default "builtin")
2016-09-25 10:26:46 -04:00
--selinux-enabled Enable selinux support
2017-02-14 19:07:50 -05:00
--shutdown-timeout int Set the default shutdown timeout (default 15)
2016-09-25 10:26:46 -04:00
-s, --storage-driver string Storage driver to use
2020-05-04 06:17:36 -04:00
--storage-opt list Storage driver options
2016-09-25 10:26:46 -04:00
--swarm-default-advertise-addr string Set default address or interface for swarm advertised address
--tls Use TLS; implied by --tlsverify
2017-02-14 19:07:50 -05:00
--tlscacert string Trust certs signed only by this CA (default "~/.docker/ca.pem")
--tlscert string Path to TLS certificate file (default "~/.docker/cert.pem")
2020-05-04 06:31:31 -04:00
--tlskey string Path to TLS key file (default "~/.docker/key.pem")
2016-09-25 10:26:46 -04:00
--tlsverify Use TLS and verify the remote
--userland-proxy Use userland proxy for loopback traffic (default true)
--userland-proxy-path string Path to the userland proxy binary
--userns-remap string User/Group setting for user namespaces
2021-05-25 10:26:41 -04:00
--validate Validate daemon configuration and exit
2016-09-25 10:26:46 -04:00
-v, --version Print version information and quit
2016-07-15 19:52:59 -04:00
```
2015-06-21 16:41:38 -04:00
Options with [] may be specified multiple times.
2017-02-07 18:42:48 -05:00
## Description
`dockerd` is the persistent process that manages containers. Docker
2016-04-28 02:55:22 -04:00
uses different binaries for the daemon and client. To run the daemon you
type `dockerd` .
2015-06-21 16:41:38 -04:00
2022-01-11 06:21:11 -05:00
To run the daemon with debug output, use `dockerd --debug` or add `"debug": true`
to [the `daemon.json` file ](#daemon-configuration-file ).
2017-02-14 19:07:50 -05:00
2024-08-16 05:02:10 -04:00
> [!NOTE]
2020-04-19 11:08:37 -04:00
> **Enabling experimental features**
2023-12-13 09:16:56 -05:00
>
2020-04-19 11:08:37 -04:00
> Enable experimental features by starting `dockerd` with the `--experimental`
> flag or adding `"experimental": true` to the `daemon.json` file.
2015-06-21 16:41:38 -04:00
2018-01-12 12:30:31 -05:00
### Environment variables
2024-01-11 07:55:10 -05:00
The following list of environment variables are supported by the `dockerd` daemon.
Some of these environment variables are supported both by the Docker Daemon and
2024-08-11 10:43:21 -04:00
the `docker` CLI. Refer to [Environment variables ](https://docs.docker.com/reference/cli/docker/#environment-variables )
2024-05-31 07:04:52 -04:00
to learn about environment variables supported by the `docker` CLI.
2018-01-12 12:30:31 -05:00
2024-02-13 07:40:53 -05:00
| Variable | Description |
| :------------------ | :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
2024-04-12 05:10:58 -04:00
| `DOCKER_CERT_PATH` | Location of your authentication keys. This variable is used both by the [`docker` CLI ](https://docs.docker.com/reference/cli/docker/ ) and the `dockerd` daemon. |
2024-02-13 07:40:53 -05:00
| `DOCKER_DRIVER` | The storage driver to use. |
| `DOCKER_RAMDISK` | If set this disables `pivot_root` . |
2024-04-12 05:10:58 -04:00
| `DOCKER_TLS_VERIFY` | When set Docker uses TLS and verifies the remote. This variable is used both by the [`docker` CLI ](https://docs.docker.com/reference/cli/docker/ ) and the `dockerd` daemon. |
2024-02-13 07:40:53 -05:00
| `DOCKER_TMPDIR` | Location for temporary files created by the daemon. |
| `HTTP_PROXY` | Proxy URL for HTTP requests unless overridden by NoProxy. See the [Go specification ](https://pkg.go.dev/golang.org/x/net/http/httpproxy#Config ) for details. |
| `HTTPS_PROXY` | Proxy URL for HTTPS requests unless overridden by NoProxy. See the [Go specification ](https://pkg.go.dev/golang.org/x/net/http/httpproxy#Config ) for details. |
| `MOBY_DISABLE_PIGZ` | Disables the use of [`unpigz` ](https://linux.die.net/man/1/pigz ) to decompress layers in parallel when pulling images, even if it is installed. |
| `NO_PROXY` | Comma-separated values specifying hosts that should be excluded from proxying. See the [Go specification ](https://pkg.go.dev/golang.org/x/net/http/httpproxy#Config ) for details. |
2018-01-12 12:30:31 -05:00
2017-02-07 18:42:48 -05:00
## Examples
2022-04-02 08:07:51 -04:00
### Proxy configuration
2024-08-16 05:02:10 -04:00
> [!NOTE]
2022-04-02 08:07:51 -04:00
> Refer to the [Docker Desktop manual](https://docs.docker.com/desktop/networking/#httphttps-proxy-support)
> if you are running [Docker Desktop](https://docs.docker.com/desktop/).
If you are behind an HTTP proxy server, for example in corporate settings,
you may have to configure the Docker daemon to use the proxy server for
operations such as pulling and pushing images. The daemon can be configured
in three ways:
1. Using environment variables (`HTTP_PROXY`, `HTTPS_PROXY` , and `NO_PROXY` ).
2023-12-13 09:16:56 -05:00
2. Using the `http-proxy` , `https-proxy` , and `no-proxy` fields in the
[daemon configuration file ](#daemon-configuration-file ) (Docker Engine version 23.0 or later).
2022-04-02 08:07:51 -04:00
3. Using the `--http-proxy` , `--https-proxy` , and `--no-proxy` command-line
2023-12-13 09:16:56 -05:00
options. (Docker Engine version 23.0 or later).
2022-04-02 08:07:51 -04:00
The command-line and configuration file options take precedence over environment
2024-08-11 10:43:21 -04:00
variables. Refer to [control and configure Docker with systemd ](https://docs.docker.com/engine/daemon/proxy/ )
2022-04-02 08:07:51 -04:00
to set these environment variables on a host using `systemd` .
2017-02-07 18:42:48 -05:00
### Daemon socket option
2015-06-21 16:41:38 -04:00
2020-05-25 05:07:10 -04:00
The Docker daemon can listen for [Docker Engine API ](https://docs.docker.com/engine/api/ )
2015-06-21 16:41:38 -04:00
requests via three different types of Socket: `unix` , `tcp` , and `fd` .
By default, a `unix` domain socket (or IPC socket) is created at
`/var/run/docker.sock` , requiring either `root` permission, or `docker` group
membership.
2023-12-13 09:16:56 -05:00
If you need to access the Docker daemon remotely, you need to enable the tcp
Socket. When using a TCP socket, the Docker daemon provides un-encrypted and
un-authenticated direct access to the Docker daemon by default. You should secure
the daemon either using the [built in HTTPS encrypted socket ](https://docs.docker.com/engine/security/protect-access/ ),
or by putting a secure web proxy in front of it. You can listen on port `2375` on all
2015-06-21 16:41:38 -04:00
network interfaces with `-H tcp://0.0.0.0:2375` , or on a particular network
interface using its IP address: `-H tcp://192.168.59.103:2375` . It is
conventional to use port `2375` for un-encrypted, and port `2376` for encrypted
communication with the daemon.
2024-08-16 05:02:10 -04:00
> [!NOTE]
2020-04-19 11:08:37 -04:00
> If you're using an HTTPS encrypted socket, keep in mind that only
2023-12-13 09:16:56 -05:00
> TLS version 1.0 and higher is supported. Protocols SSLv3 and below are not
> supported for security reasons.
2015-06-21 16:41:38 -04:00
2023-12-13 09:16:56 -05:00
On systemd based systems, you can communicate with the daemon via
[systemd socket activation ](https://0pointer.de/blog/projects/socket-activation.html ),
with `dockerd -H fd://` . Using `fd://` works for most setups, but
2016-04-28 02:55:22 -04:00
you can also specify individual sockets: `dockerd -H fd://3` . If the
2023-12-13 09:16:56 -05:00
specified socket activated files aren't found, the daemon exits. You can
find examples of using systemd socket activation with Docker and systemd in the
2015-06-21 16:41:38 -04:00
[Docker source tree ](https://github.com/docker/docker/tree/master/contrib/init/systemd/ ).
You can configure the Docker daemon to listen to multiple sockets at the same
time using multiple `-H` options:
2023-12-13 09:16:56 -05:00
The example below runs the daemon listening on the default Unix socket, and
2021-08-21 08:54:14 -04:00
on 2 specific IP addresses on this host:
2017-02-07 18:42:48 -05:00
2021-08-21 08:54:14 -04:00
```console
2016-09-16 11:22:58 -04:00
$ sudo dockerd -H unix:///var/run/docker.sock -H tcp://192.168.59.106 -H tcp://10.10.10.2
```
2015-06-21 16:41:38 -04:00
2023-12-13 09:16:56 -05:00
The Docker client honors the `DOCKER_HOST` environment variable to set the
2017-02-07 18:42:48 -05:00
`-H` flag for the client. Use **one** of the following commands:
2015-06-21 16:41:38 -04:00
2021-08-21 08:54:14 -04:00
```console
2016-09-16 11:22:58 -04:00
$ docker -H tcp://0.0.0.0:2375 ps
2017-02-07 18:42:48 -05:00
```
2021-08-21 08:54:14 -04:00
```console
2016-09-16 11:22:58 -04:00
$ export DOCKER_HOST="tcp://0.0.0.0:2375"
2017-02-07 18:42:48 -05:00
2016-09-16 11:22:58 -04:00
$ docker ps
```
2015-06-21 16:41:38 -04:00
Setting the `DOCKER_TLS_VERIFY` environment variable to any value other than
the empty string is equivalent to setting the `--tlsverify` flag. The following
are equivalent:
2021-08-21 08:54:14 -04:00
```console
2016-09-16 11:22:58 -04:00
$ docker --tlsverify ps
# or
$ export DOCKER_TLS_VERIFY=1
$ docker ps
```
2015-06-21 16:41:38 -04:00
2023-12-13 09:16:56 -05:00
The Docker client honors the `HTTP_PROXY` , `HTTPS_PROXY` , and `NO_PROXY`
2015-06-21 16:41:38 -04:00
environment variables (or the lowercase versions thereof). `HTTPS_PROXY` takes
precedence over `HTTP_PROXY` .
2020-10-26 13:30:01 -04:00
The Docker client supports connecting to a remote daemon via SSH:
2018-02-19 04:31:29 -05:00
2021-08-21 08:54:14 -04:00
```console
2023-03-04 07:53:25 -05:00
$ docker -H ssh://me@example.com:22/var/run/docker.sock ps
2018-02-19 04:31:29 -05:00
$ docker -H ssh://me@example.com:22 ps
$ docker -H ssh://me@example.com ps
$ docker -H ssh://example.com ps
```
To use SSH connection, you need to set up `ssh` so that it can reach the
2018-10-25 03:02:26 -04:00
remote host with public key authentication. Password authentication is not
supported. If your key is protected with passphrase, you need to set up
`ssh-agent` .
2017-02-07 18:42:48 -05:00
#### Bind Docker to another host/port or a Unix socket
2016-06-07 20:42:00 -04:00
2024-08-16 05:02:10 -04:00
> [!WARNING]
2023-12-13 09:16:56 -05:00
> Changing the default `docker` daemon binding to a TCP port or Unix `docker`
> user group introduces security risks, as it may allow non-root users to gain
> root access on the host. Make sure you control access to `docker`. If you are
> binding to a TCP port, anyone with access to that port has full Docker
> access; so it's not advisable on an open network.
{ .warning }
With `-H` it's possible to make the Docker daemon to listen on a specific IP
and port. By default, it listens on `unix:///var/run/docker.sock` to allow
only local connections by the root user. You could set it to `0.0.0.0:2375` or
a specific host IP to give access to everybody, but that isn't recommended
because someone could gain root access to the host where the daemon is running.
2016-06-07 20:42:00 -04:00
Similarly, the Docker client can use `-H` to connect to a custom port.
2023-12-13 09:16:56 -05:00
The Docker client defaults to connecting to `unix:///var/run/docker.sock`
2016-06-07 20:42:00 -04:00
on Linux, and `tcp://127.0.0.1:2376` on Windows.
`-H` accepts host and port assignment in the following format:
2023-12-13 09:16:56 -05:00
```text
tcp://[host]:[port][path] or unix://path
```
2016-06-07 20:42:00 -04:00
For example:
- `tcp://` -> TCP connection to `127.0.0.1` on either port `2376` when TLS encryption
is on, or port `2375` when communication is in plain text.
- `tcp://host:2375` -> TCP connection on
host:2375
- `tcp://host:2375/path` -> TCP connection on
host:2375 and prepend path to all requests
- `unix://path/to/socket` -> Unix socket located
at `path/to/socket`
2023-12-13 09:16:56 -05:00
`-H` , when empty, defaults to the same value as
2016-06-07 20:42:00 -04:00
when no `-H` was passed in.
2016-09-16 11:22:58 -04:00
`-H` also accepts short form for TCP bindings: `host:` or `host:port` or `:port`
2016-06-07 20:42:00 -04:00
Run Docker in daemon mode:
2021-08-21 08:54:14 -04:00
```console
2016-09-16 11:22:58 -04:00
$ sudo < path to > /dockerd -H 0.0.0.0:5555 &
```
2016-06-07 20:42:00 -04:00
Download an `ubuntu` image:
2021-08-21 08:54:14 -04:00
```console
2016-09-16 11:22:58 -04:00
$ docker -H :5555 pull ubuntu
```
2016-06-07 20:42:00 -04:00
You can use multiple `-H` , for example, if you want to listen on both
TCP and a Unix socket
2021-08-21 08:54:14 -04:00
```console
$ sudo dockerd -H tcp://127.0.0.1:2375 -H unix:///var/run/docker.sock &
2016-09-16 11:22:58 -04:00
# Download an ubuntu image, use default Unix socket
$ docker pull ubuntu
# OR use the TCP port
$ docker -H tcp://127.0.0.1:2375 pull ubuntu
```
2016-06-07 20:42:00 -04:00
2017-02-07 18:42:48 -05:00
### Daemon storage-driver
2015-06-21 16:41:38 -04:00
2017-08-15 13:02:33 -04:00
On Linux, the Docker daemon has support for several different image layer storage
2023-05-18 19:42:52 -04:00
drivers: `overlay2` , `fuse-overlayfs` , `btrfs` , and `zfs` .
2015-06-21 16:41:38 -04:00
2023-02-10 01:26:02 -05:00
`overlay2` is the preferred storage driver for all currently supported Linux distributions,
and is selected by default. Unless users have a strong reason to prefer another storage driver,
`overlay2` should be used.
2016-06-13 14:06:47 -04:00
2024-08-11 10:43:21 -04:00
You can find out more about storage drivers and how to select one in [Select a storage driver ](https://docs.docker.com/engine/storage/drivers/select-storage-driver/ ).
2020-06-24 06:09:15 -04:00
2022-03-01 06:46:49 -05:00
On Windows, the Docker daemon only supports the `windowsfilter` storage driver.
2017-08-15 13:02:33 -04:00
2017-02-07 18:42:48 -05:00
### Options per storage driver
2015-06-21 16:41:38 -04:00
Particular storage-driver can be configured with options specified with
2023-05-18 19:42:52 -04:00
`--storage-opt` flags. Options for `zfs` start with `zfs` , and options for
`btrfs` start with `btrfs` .
2017-07-12 10:38:47 -04:00
2016-03-23 21:14:38 -04:00
#### ZFS options
2015-06-21 16:41:38 -04:00
2017-02-07 18:42:48 -05:00
##### `zfs.fsname`
2015-06-21 16:41:38 -04:00
2023-12-13 09:16:56 -05:00
Specifies the ZFS filesystem that the daemon should use to create its datasets.
By default, the ZFS filesystem in `/var/lib/docker` is used.
2015-06-21 16:41:38 -04:00
2017-02-07 18:42:48 -05:00
###### Example
2015-06-21 16:41:38 -04:00
2021-08-21 08:54:14 -04:00
```console
2017-02-07 18:42:48 -05:00
$ sudo dockerd -s zfs --storage-opt zfs.fsname=zroot/docker
```
2015-06-21 16:41:38 -04:00
2016-03-23 21:14:38 -04:00
#### Btrfs options
2017-02-07 18:42:48 -05:00
##### `btrfs.min_space`
2016-03-23 21:14:38 -04:00
2017-02-07 18:42:48 -05:00
Specifies the minimum size to use when creating the subvolume which is used
for containers. If user uses disk quota for btrfs when creating or running
2023-12-13 09:16:56 -05:00
a container with ** --storage-opt size** option, Docker should ensure the
**size** can't be smaller than **btrfs.min_space** .
2016-03-23 21:14:38 -04:00
2017-02-07 18:42:48 -05:00
###### Example
2016-09-16 11:22:58 -04:00
2021-08-21 08:54:14 -04:00
```console
2017-02-07 18:42:48 -05:00
$ sudo dockerd -s btrfs --storage-opt btrfs.min_space=10G
```
2016-03-23 21:14:38 -04:00
2016-07-11 19:48:08 -04:00
#### Overlay2 options
2017-06-20 16:53:09 -04:00
##### `overlay2.size`
Sets the default max size of the container. It is supported only when the
2023-12-13 09:16:56 -05:00
backing filesystem is `xfs` and mounted with `pquota` mount option. Under these
conditions the user can pass any size less than the backing filesystem size.
2017-06-20 16:53:09 -04:00
###### Example
2021-08-21 08:54:14 -04:00
```console
2017-06-20 16:53:09 -04:00
$ sudo dockerd -s overlay2 --storage-opt overlay2.size=1G
```
2017-08-15 13:02:33 -04:00
#### Windowsfilter options
##### `size`
Specifies the size to use when creating the sandbox which is used for containers.
Defaults to 20G.
###### Example
2019-05-13 19:37:30 -04:00
```powershell
2017-08-15 13:02:33 -04:00
C:\> dockerd --storage-opt size=40G
```
2023-06-12 16:20:53 -04:00
### Runtime options
2015-06-30 20:33:04 -04:00
2016-03-18 15:43:17 -04:00
The Docker daemon relies on a
2016-08-17 12:38:34 -04:00
[OCI ](https://github.com/opencontainers/runtime-spec ) compliant runtime
2016-03-18 15:43:17 -04:00
(invoked via the `containerd` daemon) as its interface to the Linux
kernel `namespaces` , `cgroups` , and `SELinux` .
2015-06-21 16:41:38 -04:00
2023-06-12 16:20:53 -04:00
#### Configure container runtimes
By default, the Docker daemon uses runc as a container runtime.
You can configure the daemon to add additional runtimes.
containerd shims installed on `PATH` can be used directly, without the need
to edit the daemon's configuration. For example, if you install the Kata
Containers shim (`containerd-shim-kata-v2`) on `PATH` , then you can select that
runtime with `docker run` without having to edit the daemon's configuration:
```console
$ docker run --runtime io.containerd.kata.v2
```
Container runtimes that don't implement containerd shims, or containerd shims
installed outside of `PATH` , must be registered with the daemon, either via the
configuration file or using the `--add-runtime` command line flag.
For examples on how to use other container runtimes, see
2024-08-11 10:43:21 -04:00
[Alternative container runtimes ](https://docs.docker.com/engine/daemon/alternative-runtimes/ )
2023-06-12 16:20:53 -04:00
##### Configure runtimes using `daemon.json`
To register and configure container runtimes using the daemon's configuration
file, add the runtimes as entries under `runtimes` :
```json
{
"runtimes": {
"< runtime > ": {}
}
}
```
The key of the entry (`< runtime > ` in the previous example) represents the name
of the runtime. This is the name that you reference when you run a container,
using `docker run --runtime <runtime>` .
The runtime entry contains an object specifying the configuration for your
runtime. The properties of the object depends on what kind of runtime you're
looking to register:
- If the runtime implements its own containerd shim, the object shall contain
a `runtimeType` field and an optional `options` field.
```json
{
"runtimes": {
"< runtime > ": {
"runtimeType": "< name-or-path > ",
"options": {}
}
}
}
```
See [Configure shims ](#configure-containerd-shims ).
- If the runtime is designed to be a drop-in replacement for runc,
the object contains a `path` field, and an optional `runtimeArgs` field.
```json
{
"runtimes": {
"< runtime > ": {
"path": "/path/to/bin",
"runtimeArgs": ["...args"]
}
}
}
```
See [Configure runc drop-in replacements ](#configure-runc-drop-in-replacements ).
After changing the runtimes configuration in the configuration file,
you must reload or restart the daemon for changes to take effect:
2016-08-29 04:00:52 -04:00
2021-08-21 08:54:14 -04:00
```console
2023-06-12 16:20:53 -04:00
$ sudo systemctl reload dockerd
```
##### Configure containerd shims
If the runtime that you want to register implements a containerd shim,
or if you want to register a runtime which uses the runc shim,
use the following format for the runtime entry:
```json
{
"runtimes": {
"< runtime > ": {
"runtimeType": "< name-or-path > ",
"options": {}
}
}
}
2016-08-29 04:00:52 -04:00
```
2023-06-12 16:20:53 -04:00
`runtimeType` refers to either:
- A fully qualified name of a containerd shim.
2016-05-23 17:49:50 -04:00
2023-06-12 16:20:53 -04:00
The fully qualified name of a shim is the same as the `runtime_type` used to
register the runtime in containerd's CRI configuration.
For example, `io.containerd.runsc.v1` .
- The path of a containerd shim binary.
This option is useful if you installed the containerd shim binary outside of
`PATH` .
`options` is optional. It lets you specify the runtime configuration that you
want to use for the shim. The configuration parameters that you can specify in
`options` depends on the runtime you're registering. For most shims,
the supported configuration options are `TypeUrl` and `ConfigPath` .
For example:
2016-10-19 13:25:45 -04:00
2016-05-23 17:49:50 -04:00
```json
2016-12-17 09:01:59 -05:00
{
2020-11-06 14:52:06 -05:00
"runtimes": {
2023-06-12 16:20:53 -04:00
"gvisor": {
"runtimeType": "io.containerd.runsc.v1",
"options": {
"TypeUrl": "io.containerd.runsc.v1.options",
2024-05-17 05:35:22 -04:00
"ConfigPath": "/etc/containerd/runsc.toml"
2023-06-12 16:20:53 -04:00
}
}
}
}
```
You can configure multiple runtimes using the same runtimeType. For example:
```json
{
"runtimes": {
"gvisor-foo": {
"runtimeType": "io.containerd.runsc.v1",
"options": {
"TypeUrl": "io.containerd.runsc.v1.options",
"ConfigPath": "/etc/containerd/runsc-foo.toml"
}
2020-11-06 14:52:06 -05:00
},
2023-06-12 16:20:53 -04:00
"gvisor-bar": {
"runtimeType": "io.containerd.runsc.v1",
"options": {
"TypeUrl": "io.containerd.runsc.v1.options",
"ConfigPath": "/etc/containerd/runsc-bar.toml"
}
}
}
}
```
The `options` field takes a special set of configuration parameters when used
with `"runtimeType": "io.containerd.runc.v2"` . For more information about runc
parameters, refer to the runc configuration section in
[CRI Plugin Config Guide ](https://github.com/containerd/containerd/blob/v1.7.2/docs/cri/config.md#full-configuration ).
##### Configure runc drop-in replacements
If the runtime that you want to register can act as a drop-in replacement for
runc, you can register the runtime either using the daemon configuration file,
or using the `--add-runtime` flag for the `dockerd` cli.
When you use the configuration file, the entry uses the following format:
```json
{
"runtimes": {
"< runtime > ": {
"path": "/path/to/binary",
"runtimeArgs": ["...args"]
}
}
}
```
Where `path` is either the absolute path to the runtime executable, or the name
of an executable installed on `PATH` :
```json
{
"runtimes": {
2020-11-06 14:52:06 -05:00
"runc": {
"path": "runc"
}
}
2016-10-19 13:25:45 -04:00
}
2016-05-23 17:49:50 -04:00
```
2023-06-12 16:20:53 -04:00
And `runtimeArgs` lets you optionally pass additional arguments to the runtime.
Entries with this format use the containerd runc shim to invoke a custom
runtime binary.
When you use the `--add-runtime` CLI flag, use the following format:
2016-05-23 17:49:50 -04:00
2021-08-21 08:54:14 -04:00
```console
2023-06-12 16:20:53 -04:00
$ sudo dockerd --add-runtime < runtime > =< path >
2016-09-16 11:22:58 -04:00
```
2016-05-23 17:49:50 -04:00
2023-06-12 16:20:53 -04:00
Defining runtime arguments via the command line is not supported.
For an example configuration for a runc drop-in replacment, see
2024-08-11 10:43:21 -04:00
[Alternative container runtimes > youki ](https://docs.docker.com/engine/daemon/alternative-runtimes/#youki )
2023-06-12 16:20:53 -04:00
##### Configure the default container runtime
2016-05-23 17:49:50 -04:00
2023-06-12 16:20:53 -04:00
You can specify either the name of a fully qualified containerd runtime shim,
or the name of a registered runtime. You can specify the default runtime either
using the daemon configuration file, or using the `--default-runtime` flag for
the `dockerd` cli.
2015-06-21 16:41:38 -04:00
2023-06-12 16:20:53 -04:00
When you use the configuration file, the entry uses the following format:
```json
{
"default-runtime": "io.containerd.runsc.v1"
}
```
When you use the `--default-runtime` CLI flag, use the following format:
```console
$ dockerd --default-runtime io.containerd.runsc.v1
```
2015-06-21 16:41:38 -04:00
2023-06-12 16:20:53 -04:00
#### Run containerd standalone
By default, the Docker daemon automatically starts `containerd` . If you want to
control `containerd` startup, manually start `containerd` and pass the path to
the `containerd` socket using the `--containerd` flag. For example:
```console
$ sudo dockerd --containerd /run/containerd/containerd.sock
```
#### Configure cgroup driver
You can configure how the runtime should manage container cgroups, using the
`--exec-opt native.cgroupdriver` CLI flag.
You can only specify `cgroupfs` or `systemd` . If you specify
2016-03-24 12:18:03 -04:00
`systemd` and it is not available, the system errors out. If you omit the
2020-06-24 06:09:15 -04:00
`native.cgroupdriver` option,` cgroupfs` is used on cgroup v1 hosts, `systemd`
is used on cgroup v2 hosts with systemd available.
2015-06-21 16:41:38 -04:00
2016-03-24 12:18:03 -04:00
This example sets the `cgroupdriver` to `systemd` :
2016-03-18 15:43:17 -04:00
2021-08-21 08:54:14 -04:00
```console
2016-09-16 11:22:58 -04:00
$ sudo dockerd --exec-opt native.cgroupdriver=systemd
```
2015-06-21 16:41:38 -04:00
Setting this option applies to all containers the daemon launches.
2023-06-12 16:20:53 -04:00
#### Configure container isolation technology (Windows)
For Windows containers, you can specify the default container isolation
technology to use, using the `--exec-opt isolation` flag.
The following example makes `hyperv` the default isolation technology:
2015-11-09 04:11:10 -05:00
2016-12-26 09:27:56 -05:00
```console
> dockerd --exec-opt isolation=hyperv
2016-09-16 11:22:58 -04:00
```
2015-11-09 04:11:10 -05:00
2023-06-12 16:20:53 -04:00
If no isolation value is specified on daemon start, on Windows client,
the default is `hyperv` , and on Windows server, the default is `process` .
2015-11-09 04:11:10 -05:00
2017-10-04 12:09:12 -04:00
### Daemon DNS options
2015-06-21 16:41:38 -04:00
2016-09-16 11:22:58 -04:00
To set the DNS server for all Docker containers, use:
2021-08-21 08:54:14 -04:00
```console
2016-09-16 11:22:58 -04:00
$ sudo dockerd --dns 8.8.8.8
```
To set the DNS search domain for all Docker containers, use:
2021-08-21 08:54:14 -04:00
```console
2016-09-16 11:22:58 -04:00
$ sudo dockerd --dns-search example.com
```
2015-06-21 16:41:38 -04:00
2023-12-13 09:16:56 -05:00
### Allow push of non-distributable artifacts
2017-05-09 17:00:31 -04:00
Some images (e.g., Windows base images) contain artifacts whose distribution is
restricted by license. When these images are pushed to a registry, restricted
artifacts are not included.
To override this behavior for specific registries, use the
`--allow-nondistributable-artifacts` option in one of the following forms:
* `--allow-nondistributable-artifacts myregistry:5000` tells the Docker daemon
2023-12-13 09:16:56 -05:00
to push non-distributable artifacts to myregistry:5000.
2017-05-09 17:00:31 -04:00
* `--allow-nondistributable-artifacts 10.1.0.0/16` tells the Docker daemon to
2023-12-13 09:16:56 -05:00
push non-distributable artifacts to all registries whose resolved IP address
2017-05-09 17:00:31 -04:00
is within the subnet described by the CIDR syntax.
This option can be used multiple times.
2023-12-13 09:16:56 -05:00
This option is useful when pushing images containing non-distributable artifacts
2017-05-09 17:00:31 -04:00
to a registry on an air-gapped network so hosts on that network can pull the
images without connecting to another server.
2024-08-16 05:02:10 -04:00
> [!WARNING]
2023-12-13 09:16:56 -05:00
> Non-distributable artifacts typically have restrictions on how
2017-05-09 17:00:31 -04:00
> and where they can be distributed and shared. Only use this feature to push
> artifacts to private registries and ensure that you are in compliance with
2023-12-13 09:16:56 -05:00
> any terms that cover redistributing non-distributable artifacts.
{ .warning }
2017-05-09 17:00:31 -04:00
2017-10-04 12:09:12 -04:00
### Insecure registries
2015-06-21 16:41:38 -04:00
2023-12-13 09:16:56 -05:00
In this section, "registry" refers to a private registry, and `myregistry:5000`
is a placeholder example of a private registry.
2015-06-21 16:41:38 -04:00
2023-12-13 09:16:56 -05:00
Docker considers a private registry either secure or insecure.
2015-06-21 16:41:38 -04:00
A secure registry uses TLS and a copy of its CA certificate is placed on the
Docker host at `/etc/docker/certs.d/myregistry:5000/ca.crt` . An insecure
registry is either not using TLS (i.e., listening on plain text HTTP), or is
using TLS with a CA certificate not known by the Docker daemon. The latter can
2023-12-13 09:16:56 -05:00
happen when the certificate wasn't found under
2015-06-21 16:41:38 -04:00
`/etc/docker/certs.d/myregistry:5000/` , or if the certificate verification
failed (i.e., wrong CA).
2023-12-13 09:16:56 -05:00
By default, Docker assumes all registries to be secure, except for local registries.
Communicating with an insecure registry isn't possible
2015-06-21 16:41:38 -04:00
if Docker assumes that registry is secure. In order to communicate with an
insecure registry, the Docker daemon requires `--insecure-registry` in one of
the following two forms:
* `--insecure-registry myregistry:5000` tells the Docker daemon that
myregistry:5000 should be considered insecure.
* `--insecure-registry 10.1.0.0/16` tells the Docker daemon that all registries
whose domain resolve to an IP address is part of the subnet described by the
CIDR syntax, should be considered insecure.
The flag can be used multiple times to allow multiple registries to be marked
as insecure.
2023-12-13 09:16:56 -05:00
If an insecure registry isn't marked as insecure, `docker pull` ,
`docker push` , and `docker search` result in error messages, prompting
2015-06-21 16:41:38 -04:00
the user to either secure or pass the `--insecure-registry` flag to the Docker
daemon as described above.
Local registries, whose IP address falls in the 127.0.0.0/8 range, are
2023-12-13 09:16:56 -05:00
automatically marked as insecure as of Docker 1.3.2. It isn't recommended to
2015-06-21 16:41:38 -04:00
rely on this, as it may change in the future.
2015-09-04 10:28:35 -04:00
Enabling `--insecure-registry` , i.e., allowing un-encrypted and/or untrusted
2023-12-13 09:16:56 -05:00
communication, can be useful when running a local registry. However,
because its use creates security vulnerabilities it should only be enabled for
testing purposes. For increased security, users should add their CA to their
2015-09-04 10:28:35 -04:00
system's list of trusted CAs instead of enabling `--insecure-registry` .
2017-10-04 12:09:12 -04:00
#### Legacy Registries
2015-09-25 16:49:50 -04:00
2020-10-26 13:30:01 -04:00
Operations against registries supporting only the legacy v1 protocol are no longer
2023-12-13 09:16:56 -05:00
supported. Specifically, the daemon doesn't attempt to push, pull or sign in
2020-10-26 13:30:01 -04:00
to v1 registries. The exception to this is `search` which can still be performed
on v1 registries.
2017-06-11 08:47:23 -04:00
2017-10-04 12:09:12 -04:00
### Running a Docker daemon behind an HTTPS_PROXY
2015-06-21 16:41:38 -04:00
2023-12-13 09:16:56 -05:00
When running inside a LAN that uses an `HTTPS` proxy, the proxy's certificates
replace Docker Hub's certificates. These certificates must be added to your
Docker host's configuration:
2015-06-21 16:41:38 -04:00
1. Install the `ca-certificates` package for your distribution
2. Ask your network admin for the proxy's CA certificate and append them to
`/etc/pki/tls/certs/ca-bundle.crt`
2016-04-28 02:55:22 -04:00
3. Then start your Docker daemon with `HTTPS_PROXY=http://username:password@proxy:port/ dockerd` .
2015-06-21 16:41:38 -04:00
The `username:` and `password@` are optional - and are only needed if your
proxy is set up to require authentication.
2023-12-13 09:16:56 -05:00
This only adds the proxy and authentication to the Docker daemon's requests.
To use the proxy when building images and running containers, see
2024-08-11 10:43:21 -04:00
[Configure Docker to use a proxy server ](https://docs.docker.com/engine/cli/proxy/ )
2015-06-21 16:41:38 -04:00
2017-10-04 12:09:12 -04:00
### Default `ulimit` settings
2015-06-21 16:41:38 -04:00
2023-12-13 09:16:56 -05:00
The `--default-ulimit` flag lets you set the default `ulimit` options to use for
2015-06-21 16:41:38 -04:00
all containers. It takes the same options as `--ulimit` for `docker run` . If
2023-12-13 09:16:56 -05:00
these defaults aren't set, `ulimit` settings are inherited from the Docker daemon.
Any `--ulimit` options passed to `docker run` override the daemon defaults.
2015-06-21 16:41:38 -04:00
2023-12-13 09:16:56 -05:00
Be careful setting `nproc` with the `ulimit` flag, as `nproc` is designed by Linux to
set the maximum number of processes available to a user, not to a container.
2024-02-13 07:40:53 -05:00
For details, see [`docker run` reference ](https://docs.docker.com/reference/cli/docker/container/run/#ulimit ).
2015-06-28 10:40:53 -04:00
2017-10-04 12:09:12 -04:00
### Access authorization
2015-11-04 08:49:53 -05:00
2015-12-08 07:54:33 -05:00
Docker's access authorization can be extended by authorization plugins that your
organization can purchase or build themselves. You can install one or more
authorization plugins when you start the Docker `daemon` using the
2016-01-12 19:38:18 -05:00
`--authorization-plugin=PLUGIN_ID` option.
2015-11-04 08:49:53 -05:00
2021-08-21 08:54:14 -04:00
```console
2016-09-16 11:22:58 -04:00
$ sudo dockerd --authorization-plugin=plugin1 --authorization-plugin=plugin2,...
2015-12-08 07:54:33 -05:00
```
The `PLUGIN_ID` value is either the plugin's name or a path to its specification
file. The plugin's implementation determines whether you can specify a name or
path. Consult with your Docker administrator to get information about the
plugins available to you.
2017-05-01 09:27:42 -04:00
Once a plugin is installed, requests made to the `daemon` through the
command line or Docker's Engine API are allowed or denied by the plugin.
If you have multiple plugins installed, each plugin, in order, must
allow the request for it to complete.
2015-12-08 07:54:33 -05:00
2021-05-12 03:31:50 -04:00
For information about how to create an authorization plugin, refer to the
2024-02-13 07:40:53 -05:00
[authorization plugin ](https://docs.docker.com/engine/extend/plugins_authorization/ ) section.
2015-11-04 08:49:53 -05:00
2017-10-04 12:09:12 -04:00
### Daemon user namespace options
2016-01-08 10:07:46 -05:00
2017-06-22 18:09:14 -04:00
The Linux kernel
2021-10-14 18:04:36 -04:00
[user namespace support ](https://man7.org/linux/man-pages/man7/user_namespaces.7.html )
2017-06-22 18:09:14 -04:00
provides additional security by enabling a process, and therefore a container,
to have a unique range of user and group IDs which are outside the traditional
2023-12-13 09:16:56 -05:00
user and group range utilized by the host system. One of the most important
security improvements is that, by default, container processes running as the
`root` user have expected administrative privileges it expects (with some restrictions)
inside the container, but are effectively mapped to an unprivileged `uid` on
2017-06-22 18:09:14 -04:00
the host.
For details about how to use this feature, as well as limitations, see
[Isolate containers with a user namespace ](https://docs.docker.com/engine/security/userns-remap/ ).
2016-01-08 10:07:46 -05:00
2023-07-03 10:34:55 -04:00
### Configure host gateway IP
The Docker daemon supports a special `host-gateway` value for the `--add-host`
flag for the `docker run` and `docker build` commands. This value resolves to
the host's gateway IP and lets containers connect to services running on the
host.
By default, `host-gateway` resolves to the IP address of the default bridge.
You can configure this to resolve to a different IP using the `--host-gateway-ip`
flag for the dockerd command line interface, or the `host-gateway-ip` key in
the daemon configuration file.
```console
2024-01-23 08:12:33 -05:00
$ cat > /etc/docker/daemon.json
{ "host-gateway-ip": "192.0.2.0" }
$ sudo systemctl restart docker
2023-07-03 10:34:55 -04:00
$ docker run -it --add-host host.docker.internal:host-gateway \
busybox ping host.docker.internal
PING host.docker.internal (192.0.2.0): 56 data bytes
```
2024-01-18 07:24:23 -05:00
### Enable CDI devices
2024-08-16 05:02:10 -04:00
> [!NOTE]
2024-01-18 07:24:23 -05:00
> This is experimental feature and as such doesn't represent a stable API.
>
> This feature isn't enabled by default. To this feature, set `features.cdi` to
> `true` in the `daemon.json` configuration file.
Container Device Interface (CDI) is a
[standardized ](https://github.com/cncf-tags/container-device-interface/blob/main/SPEC.md )
mechanism for container runtimes to create containers which are able to
interact with third party devices.
The Docker daemon supports running containers with CDI devices if the requested
device specifications are available on the filesystem of the daemon.
The default specification directors are:
- `/etc/cdi/` for static CDI Specs
- `/var/run/cdi` for generated CDI Specs
Alternatively, you can set custom locations for CDI specifications using the
`cdi-spec-dirs` option in the `daemon.json` configuration file, or the
`--cdi-spec-dir` flag for the `dockerd` CLI.
```json
{
"features": {
"cdi": true
},
"cdi-spec-dirs": ["/etc/cdi/", "/var/run/cdi"]
}
```
When CDI is enabled for a daemon, you can view the configured CDI specification
directories using the `docker info` command.
2024-09-16 07:16:13 -04:00
#### <a name="log-format"></a> Daemon logging format
The `--log-format` option or "log-format" option in the [daemon configuration file ](#daemon-configuration-file )
lets you set the format for logs produced by the daemon. The logging format should
only be configured either through the `--log-format` command line option or
through the "log-format" field in the configuration file; using both
the command-line option and the "log-format" field in the configuration
file produces an error. If this option is not set, the default is "text".
The following example configures the daemon through the `--log-format` command
line option to use `json` formatted logs;
```console
$ dockerd --log-format=json
# ...
{"level":"info","msg":"API listen on /var/run/docker.sock","time":"2024-09-16T11:06:08.558145428Z"}
```
The following example shows a `daemon.json` configuration file with the
"log-format" set;
```json
{
"log-format": "json"
}
```
2017-02-07 18:42:48 -05:00
### Miscellaneous options
2015-06-21 16:41:38 -04:00
IP masquerading uses address translation to allow containers without a public
2023-12-13 09:16:56 -05:00
IP to talk to other machines on the internet. This may interfere with some
network topologies, and can be disabled with `--ip-masq=false` .
2015-06-21 16:41:38 -04:00
2023-12-13 09:16:56 -05:00
Docker supports soft links for the Docker data directory (`/var/lib/docker`) and
2015-06-21 16:41:38 -04:00
for `/var/lib/docker/tmp` . The `DOCKER_TMPDIR` and the data directory can be
set like this:
2021-05-12 03:31:50 -04:00
```console
$ export DOCKER_TMPDIR=/mnt/disk2/tmp
2023-12-13 09:16:56 -05:00
$ sudo -E dockerd --data-root /var/lib/docker -H unix://
2021-05-12 03:31:50 -04:00
````
2015-12-08 07:54:33 -05:00
2017-02-07 18:42:48 -05:00
#### Default cgroup parent
2015-12-08 07:54:33 -05:00
2023-12-13 09:16:56 -05:00
The `--cgroup-parent` option lets you set the default cgroup parent
for containers. If this option isn't set, it defaults to `/docker` for
the cgroupfs driver, and `system.slice` for the systemd cgroup driver.
2015-12-07 12:55:33 -05:00
If the cgroup has a leading forward slash (`/`), the cgroup is created
under the root cgroup, otherwise the cgroup is created under the daemon
cgroup.
Assuming the daemon is running in cgroup `daemoncgroup` ,
`--cgroup-parent=/foobar` creates a cgroup in
2016-02-11 18:21:52 -05:00
`/sys/fs/cgroup/memory/foobar` , whereas using `--cgroup-parent=foobar`
2015-12-07 12:55:33 -05:00
creates the cgroup in `/sys/fs/cgroup/memory/daemoncgroup/foobar`
2023-12-13 09:16:56 -05:00
The systemd cgroup driver has different rules for `--cgroup-parent` . systemd
2016-03-01 05:24:27 -05:00
represents hierarchy by slice and the name of the slice encodes the location in
the tree. So `--cgroup-parent` for systemd cgroups should be a slice name. A
name can consist of a dash-separated series of names, which describes the path
to the slice from the root slice. For example, `--cgroup-parent=user-a-b.slice`
means the memory cgroup for the container is created in
`/sys/fs/cgroup/memory/user.slice/user-a.slice/user-a-b.slice/docker-<id>.scope` .
2015-12-07 12:55:33 -05:00
This setting can also be set per container, using the `--cgroup-parent`
option on `docker create` and `docker run` , and takes precedence over
the `--cgroup-parent` option on the daemon.
2015-12-10 18:35:10 -05:00
2017-02-07 18:42:48 -05:00
#### Daemon metrics
2016-10-28 13:28:39 -04:00
2023-12-13 09:16:56 -05:00
The `--metrics-addr` option takes a TCP address to serve the metrics API.
2016-11-15 14:45:20 -05:00
This feature is still experimental, therefore, the daemon must be running in experimental
2016-10-28 13:28:39 -04:00
mode for this feature to work.
2018-12-21 03:04:21 -05:00
To serve the metrics API on `localhost:9323` you would specify `--metrics-addr 127.0.0.1:9323` ,
allowing you to make requests on the API at `127.0.0.1:9323/metrics` to receive metrics in the
2016-10-28 13:28:39 -04:00
[prometheus ](https://prometheus.io/docs/instrumenting/exposition_formats/ ) format.
2018-12-21 03:04:21 -05:00
Port `9323` is the [default port associated with Docker
metrics](https://github.com/prometheus/prometheus/wiki/Default-port-allocations)
2023-12-13 09:16:56 -05:00
to avoid collisions with other Prometheus exporters and services.
2016-10-28 13:28:39 -04:00
2023-12-13 09:16:56 -05:00
If you are running a Prometheus server you can add this address to your scrape configs
to have Prometheus collect metrics on Docker. For more information, see
2024-08-11 10:43:21 -04:00
[Collect Docker metrics with Prometheus ](https://docs.docker.com/engine/daemon/prometheus/ ).
2016-10-28 13:28:39 -04:00
2023-12-13 09:16:56 -05:00
#### Node generic resources
2017-11-08 12:13:11 -05:00
The `--node-generic-resources` option takes a list of key-value
pair (`key=value`) that allows you to advertise user defined resources
2023-12-13 09:16:56 -05:00
in a Swarm cluster.
2017-11-08 12:13:11 -05:00
The current expected use case is to advertise NVIDIA GPUs so that services
requesting `NVIDIA-GPU=[0-16]` can land on a node that has enough GPUs for
the task to run.
Example of usage:
2023-12-13 09:16:56 -05:00
2017-11-08 12:13:11 -05:00
```json
{
2020-11-06 14:52:06 -05:00
"node-generic-resources": [
"NVIDIA-GPU=UUID1",
"NVIDIA-GPU=UUID2"
]
2017-11-08 12:13:11 -05:00
}
```
2024-09-16 05:28:41 -04:00
### <a name="feature"></a> Enable feature in the daemon (--feature)
The `--feature` option lets you enable or disable a feature in the daemon.
This option corresponds with the "features" field in the [daemon.json configuration file ](#daemon-configuration-file ).
Features should only be configured either through the `--feature` command line
option or through the "features" field in the configuration file; using both
the command-line option and the "features" field in the configuration
file produces an error. The feature option can be specified multiple times
to configure multiple features. The `--feature` option accepts a name and
optional boolean value. When omitting the value, the default is `true` .
The following example runs the daemon with the `cdi` and `containerd-snapshotter`
features enabled. The `cdi` option is provided with a value;
```console
$ dockerd --feature cdi=true --feature containerd-snapshotter
```
The following example is the equivalent using the `daemon.json` configuration
file;
```json
{
"features": {
"cdi": true,
"containerd-snapshotter": true
}
}
```
2017-10-04 12:09:12 -04:00
### Daemon configuration file
2015-12-10 18:35:10 -05:00
The `--config-file` option allows you to set any configuration option
for the daemon in a JSON format. This file uses the same flag names as keys,
except for flags that allow several entries, where it uses the plural
2016-06-17 00:41:58 -04:00
of the flag name, e.g., `labels` for the `label` flag.
2015-12-10 18:35:10 -05:00
The options set in the configuration file must not conflict with options set
2023-12-13 09:16:56 -05:00
using flags. The Docker daemon fails to start if an option is duplicated between
the file and the flags, regardless of their value. This is intentional, and avoids
2015-12-10 18:35:10 -05:00
silently ignore changes introduced in configuration reloads.
For example, the daemon fails to start if you set daemon labels
2016-07-19 00:40:07 -04:00
in the configuration file and also set daemon labels via the `--label` flag.
2015-12-10 18:35:10 -05:00
Options that are not present in the file are ignored when the daemon starts.
2016-06-17 00:41:58 -04:00
2021-05-25 10:26:41 -04:00
The `--validate` option allows to validate a configuration file without
starting the Docker daemon. A non-zero exit code is returned for invalid
configuration files.
```console
$ dockerd --validate --config-file=/tmp/valid-config.json
configuration OK
$ echo $?
0
$ dockerd --validate --config-file /tmp/invalid-config.json
unable to configure the Docker daemon with file /tmp/invalid-config.json: the following directives don't match any configuration option: unknown-option
$ echo $?
1
```
2017-02-07 18:42:48 -05:00
##### On Linux
2016-06-17 00:41:58 -04:00
2016-07-19 00:40:07 -04:00
The default location of the configuration file on Linux is
2023-12-13 09:16:56 -05:00
`/etc/docker/daemon.json` . Use the `--config-file` flag to specify a
non-default location.
2016-06-17 00:41:58 -04:00
2023-12-13 09:16:56 -05:00
The following is a full example of the allowed configuration options on Linux:
2015-12-10 18:35:10 -05:00
```json
{
2020-11-06 14:52:06 -05:00
"allow-nondistributable-artifacts": [],
2020-05-11 11:32:52 -04:00
"authorization-plugins": [],
2020-11-06 14:52:06 -05:00
"bip": "",
"bridge": "",
2024-01-16 14:19:06 -05:00
"builder": {
"gc": {
"enabled": true,
"defaultKeepStorage": "10GB",
"policy": [
{ "keepStorage": "10GB", "filter": ["unused-for=2200h"] },
{ "keepStorage": "50GB", "filter": ["unused-for=3300h"] },
{ "keepStorage": "100GB", "all": true }
]
}
},
2020-11-06 14:52:06 -05:00
"cgroup-parent": "",
2020-11-06 15:34:10 -05:00
"containerd": "/run/containerd/containerd.sock",
"containerd-namespace": "docker",
2024-02-21 06:29:31 -05:00
"containerd-plugins-namespace": "docker-plugins",
2020-05-11 11:32:52 -04:00
"data-root": "",
2020-11-06 14:52:06 -05:00
"debug": true,
"default-address-pools": [
{
2021-09-11 16:52:44 -04:00
"base": "172.30.0.0/16",
2020-11-06 14:52:06 -05:00
"size": 24
},
{
2021-09-11 16:52:44 -04:00
"base": "172.31.0.0/16",
2020-11-06 14:52:06 -05:00
"size": 24
}
],
2020-05-11 11:32:52 -04:00
"default-cgroupns-mode": "private",
2020-11-06 14:52:06 -05:00
"default-gateway": "",
"default-gateway-v6": "",
2023-11-03 09:20:54 -04:00
"default-network-opts": {},
2020-11-06 14:52:06 -05:00
"default-runtime": "runc",
"default-shm-size": "64M",
"default-ulimits": {
"nofile": {
"Hard": 64000,
"Name": "nofile",
"Soft": 64000
}
},
2020-05-11 11:32:52 -04:00
"dns": [],
"dns-opts": [],
"dns-search": [],
"exec-opts": [],
"exec-root": "",
"experimental": false,
2024-09-16 05:28:41 -04:00
"features": {
"cdi": true,
"containerd-snapshotter": true
},
2020-11-06 14:52:06 -05:00
"fixed-cidr": "",
"fixed-cidr-v6": "",
"group": "",
2024-01-23 08:12:33 -05:00
"host-gateway-ip": "",
2020-11-06 14:52:06 -05:00
"hosts": [],
2023-05-19 11:21:34 -04:00
"proxies": {
"http-proxy": "http://proxy.example.com:80",
"https-proxy": "https://proxy.example.com:443",
2024-02-21 06:29:31 -05:00
"no-proxy": "*.test.example.com,.example.org"
2023-05-19 11:21:34 -04:00
},
2020-11-06 14:52:06 -05:00
"icc": false,
"init": false,
"init-path": "/usr/libexec/docker-init",
"insecure-registries": [],
"ip": "0.0.0.0",
"ip-forward": false,
"ip-masq": false,
"iptables": false,
2020-11-18 15:59:16 -05:00
"ip6tables": false,
2020-11-06 14:52:06 -05:00
"ipv6": false,
2020-05-11 11:32:52 -04:00
"labels": [],
"live-restore": true,
"log-driver": "json-file",
2024-09-16 07:16:13 -04:00
"log-format": "text",
2020-11-06 14:52:06 -05:00
"log-level": "",
2020-05-11 11:32:52 -04:00
"log-opts": {
2021-04-17 09:13:20 -04:00
"cache-disabled": "false",
"cache-max-file": "5",
"cache-max-size": "20m",
"cache-compress": "true",
2020-11-06 14:52:06 -05:00
"env": "os,customer",
2020-05-11 11:32:52 -04:00
"labels": "somelabel",
2020-11-06 14:52:06 -05:00
"max-file": "5",
"max-size": "10m"
2020-05-11 11:32:52 -04:00
},
"max-concurrent-downloads": 3,
"max-concurrent-uploads": 5,
"max-download-attempts": 5,
2020-11-06 14:52:06 -05:00
"mtu": 0,
2020-05-11 11:32:52 -04:00
"no-new-privileges": false,
2020-11-06 14:52:06 -05:00
"node-generic-resources": [
"NVIDIA-GPU=UUID1",
"NVIDIA-GPU=UUID2"
],
2023-04-12 12:45:20 -04:00
"oom-score-adjust": 0,
2020-11-06 14:52:06 -05:00
"pidfile": "",
"raw-logs": false,
"registry-mirrors": [],
2020-05-11 11:32:52 -04:00
"runtimes": {
"cc-runtime": {
"path": "/usr/bin/cc-runtime"
},
"custom": {
"path": "/usr/local/bin/my-runc-replacement",
"runtimeArgs": [
"--debug"
]
}
},
2020-11-06 14:52:06 -05:00
"seccomp-profile": "",
"selinux-enabled": false,
"shutdown-timeout": 15,
"storage-driver": "",
"storage-opts": [],
"swarm-default-advertise-addr": "",
"tls": true,
"tlscacert": "",
"tlscert": "",
"tlskey": "",
"tlsverify": true,
"userland-proxy": false,
"userland-proxy-path": "/usr/libexec/docker-proxy",
"userns-remap": ""
2015-12-10 18:35:10 -05:00
}
```
2024-08-16 05:02:10 -04:00
> [!NOTE]
2023-12-13 09:16:56 -05:00
> You can't set options in `daemon.json` that have already been set on
2017-02-23 07:49:00 -05:00
> daemon startup as a flag.
2023-12-13 09:16:56 -05:00
> On systems that use systemd to start the Docker daemon, `-H` is already set, so
> you can't use the `hosts` key in `daemon.json` to add listening addresses.
2024-08-11 10:43:21 -04:00
> See [custom Docker daemon options](https://docs.docker.com/engine/daemon/proxy/#systemd-unit-file)
2023-12-13 09:16:56 -05:00
> for an example on how to configure the daemon using systemd drop-in files.
2017-02-23 07:49:00 -05:00
2017-02-07 18:42:48 -05:00
##### On Windows
2016-06-17 00:41:58 -04:00
The default location of the configuration file on Windows is
2023-12-13 09:16:56 -05:00
`%programdata%\docker\config\daemon.json` . Use the `--config-file` flag
to specify a non-default location.
2016-06-17 00:41:58 -04:00
2023-12-13 09:16:56 -05:00
The following is a full example of the allowed configuration options on Windows:
2016-06-17 00:41:58 -04:00
```json
{
2020-11-06 14:52:06 -05:00
"allow-nondistributable-artifacts": [],
2020-05-11 11:32:52 -04:00
"authorization-plugins": [],
2020-11-06 14:52:06 -05:00
"bridge": "",
2020-11-06 15:34:10 -05:00
"containerd": "\\\\.\\pipe\\containerd-containerd",
"containerd-namespace": "docker",
2024-02-21 06:29:31 -05:00
"containerd-plugins-namespace": "docker-plugins",
2020-05-11 11:32:52 -04:00
"data-root": "",
2020-11-06 14:52:06 -05:00
"debug": true,
2023-11-03 09:20:54 -04:00
"default-network-opts": {},
2021-09-23 13:53:46 -04:00
"default-runtime": "",
2020-11-06 14:52:06 -05:00
"default-ulimits": {},
2020-05-11 11:32:52 -04:00
"dns": [],
"dns-opts": [],
"dns-search": [],
"exec-opts": [],
"experimental": false,
2020-11-06 14:52:06 -05:00
"features": {},
"fixed-cidr": "",
"group": "",
2024-01-23 08:12:33 -05:00
"host-gateway-ip": "",
2020-11-06 14:52:06 -05:00
"hosts": [],
"insecure-registries": [],
2020-05-11 11:32:52 -04:00
"labels": [],
"log-driver": "",
2024-09-16 07:16:13 -04:00
"log-format": "text",
2020-11-06 14:52:06 -05:00
"log-level": "",
2020-05-11 11:32:52 -04:00
"max-concurrent-downloads": 3,
"max-concurrent-uploads": 5,
"max-download-attempts": 5,
2020-11-06 14:52:06 -05:00
"mtu": 0,
"pidfile": "",
"raw-logs": false,
"registry-mirrors": [],
2020-05-11 11:32:52 -04:00
"shutdown-timeout": 15,
2020-11-06 14:52:06 -05:00
"storage-driver": "",
"storage-opts": [],
"swarm-default-advertise-addr": "",
2020-05-11 11:32:52 -04:00
"tlscacert": "",
"tlscert": "",
"tlskey": "",
2020-11-06 14:52:06 -05:00
"tlsverify": true
2016-06-17 00:41:58 -04:00
}
```
2023-12-13 09:16:56 -05:00
The `default-runtime` option is by default unset, in which case dockerd automatically detects the runtime.
This detection is based on if the `containerd` flag is set.
2021-09-23 13:53:46 -04:00
Accepted values:
- `com.docker.hcsshim.v1` - This is the built-in runtime that Docker has used since Windows supported was first added and uses the v1 HCS API's in Windows.
- `io.containerd.runhcs.v1` - This is uses the containerd `runhcs` shim to run the container and uses the v2 HCS API's in Windows.
2018-08-27 18:52:50 -04:00
#### Feature options
2023-12-13 09:16:56 -05:00
The optional field `features` in `daemon.json` lets you enable or disable specific
daemon features.
```json
{
"features": {
"some-feature": true,
"some-disabled-feature-enabled-by-default": false
}
}
```
The list of feature options include:
- `containerd-snapshotter` : when set to `true` , the daemon uses containerd
snapshotters instead of the classic storage drivers for storing image and
container data. For more information, see
2024-08-11 10:43:21 -04:00
[containerd storage ](https://docs.docker.com/engine/storage/containerd/ ).
2024-03-26 12:26:45 -04:00
- `windows-dns-proxy` : when set to `true` , the daemon's internal DNS resolver
will forward requests to external servers. Without this, most applications
running in the container will still be able to use secondary DNS servers
configured in the container itself, but `nslookup` won't be able to resolve
external names. The current default is `false` , it will change to `true` in
a future release. This option is only allowed on Windows.
2018-08-27 18:52:50 -04:00
2024-08-16 05:02:10 -04:00
> [!WARNING]
2024-04-19 07:32:28 -04:00
> The `windows-dns-proxy` feature flag will be removed in a future release.
2017-02-07 18:42:48 -05:00
#### Configuration reload behavior
2015-12-10 18:35:10 -05:00
Some options can be reconfigured when the daemon is running without requiring
2023-12-13 09:16:56 -05:00
to restart the process. The daemon uses the `SIGHUP` signal in Linux to reload,
and a global event in Windows with the key `Global\docker-daemon-config-$PID` .
You can modify the options in the configuration file, but the daemon still
checks for conflicting settings with the specified CLI flags. The daemon fails
to reconfigure itself if there are conflicts, but it won't stop execution.
2015-12-10 18:35:10 -05:00
The list of currently supported options that can be reconfigured is this:
2023-12-13 09:16:56 -05:00
| Option | Description |
| ---------------------------------- | ----------------------------------------------------------------------------------------------------------- |
| `debug` | Toggles debug mode of the daemon. |
| `labels` | Replaces the daemon labels with a new set of labels. |
2024-08-11 10:43:21 -04:00
| `live-restore` | Toggles [live restore ](https://docs.docker.com/engine/containers/live-restore/ ). |
2023-12-13 09:16:56 -05:00
| `max-concurrent-downloads` | Configures the max concurrent downloads for each pull. |
| `max-concurrent-uploads` | Configures the max concurrent uploads for each push. |
| `max-download-attempts` | Configures the max download attempts for each pull. |
| `default-runtime` | Configures the runtime to be used if not is specified at container creation. |
| `runtimes` | Configures the list of available OCI runtimes that can be used to run containers. |
| `authorization-plugin` | Specifies the authorization plugins to use. |
| `allow-nondistributable-artifacts` | Specifies a list of registries to which the daemon will push non-distributable artifacts. |
| `insecure-registries` | Specifies a list of registries that the daemon should consider insecure. |
| `registry-mirrors` | Specifies a list of registry mirrors. |
| `shutdown-timeout` | Configures the daemon's existing configuration timeout with a new timeout for shutting down all containers. |
| `features` | Enables or disables specific features. |
2016-02-17 20:08:11 -05:00
2017-02-07 18:42:48 -05:00
### Run multiple daemons
2016-05-16 06:41:07 -04:00
2024-08-16 05:02:10 -04:00
> [!NOTE]
2023-12-13 09:16:56 -05:00
> Running multiple daemons on a single host is considered experimental.
> You may encounter unsolved problems, and things may not work as expected in some cases.
2016-05-16 06:41:07 -04:00
This section describes how to run multiple Docker daemons on a single host. To
2023-12-13 09:16:56 -05:00
run multiple daemons, you must configure each daemon so that it doesn't
2016-05-16 06:41:07 -04:00
conflict with other daemons on the same host. You can set these options either
by providing them as flags, or by using a [daemon configuration file ](#daemon-configuration-file ).
The following daemon options must be configured for each daemon:
2023-12-13 09:16:56 -05:00
```text
2016-05-16 06:41:07 -04:00
-b, --bridge= Attach containers to a network bridge
--exec-root=/var/run/docker Root of the Docker execdriver
2016-11-22 01:17:24 -05:00
--data-root=/var/lib/docker Root of persisted Docker data
2016-05-16 06:41:07 -04:00
-p, --pidfile=/var/run/docker.pid Path to use for daemon PID file
-H, --host=[] Daemon socket(s) to connect to
2016-07-07 17:22:12 -04:00
--iptables=true Enable addition of iptables rules
2016-05-16 06:41:07 -04:00
--config-file=/etc/docker/daemon.json Daemon configuration file
--tlscacert="~/.docker/ca.pem" Trust certs signed only by this CA
--tlscert="~/.docker/cert.pem" Path to TLS certificate file
--tlskey="~/.docker/key.pem" Path to TLS key file
```
When your daemons use different values for these flags, you can run them on the same host without any problems.
2023-12-13 09:16:56 -05:00
It is important that you understand the meaning of these options and to use them correctly.
- The `-b, --bridge=` flag is set to `docker0` as default bridge network.
It is created automatically when you install Docker.
If you aren't using the default, you must create and configure the bridge manually, or set it to 'none': `--bridge=none`
- `--exec-root` is the path where the container state is stored.
The default value is `/var/run/docker` .
Specify the path for your running daemon here.
2016-11-22 01:17:24 -05:00
- `--data-root` is the path where persisted data such as images, volumes, and
2023-12-13 09:16:56 -05:00
cluster state are stored. The default value is `/var/lib/docker` . To avoid any
conflict with other daemons, set this parameter separately for each daemon.
- `-p, --pidfile=/var/run/docker.pid` is the path where the process ID of the daemon is stored.
Specify the path for your PID file here.
- `--host=[]` specifies where the Docker daemon listens for client connections.
If unspecified, it defaults to `/var/run/docker.sock` .
- `--iptables=false` prevents the Docker daemon from adding iptables rules. If
multiple daemons manage iptables rules, they may overwrite rules set by another
daemon. Be aware that disabling this option requires you to manually add
iptables rules to expose container ports. If you prevent Docker from adding
iptables rules, Docker also doesn't add IP masquerading rules, even if you set
`--ip-masq` to `true` . Without IP masquerading rules, Docker containers can't
connect to external hosts or the internet when using network other than default bridge.
- `--config-file=/etc/docker/daemon.json` is the path where configuration file is stored.
You can use it instead of daemon flags. Specify the path for each daemon.
2016-05-16 06:41:07 -04:00
- `--tls*` Docker daemon supports `--tlsverify` mode that enforces encrypted and authenticated remote connections.
2023-12-13 09:16:56 -05:00
The `--tls*` options enable use of specific certificates for individual daemons.
2016-05-16 06:41:07 -04:00
Example script for a separate “bootstrap” instance of the Docker daemon without network:
2021-05-12 03:31:50 -04:00
```console
2016-09-16 11:22:58 -04:00
$ sudo dockerd \
2016-05-16 06:41:07 -04:00
-H unix:///var/run/docker-bootstrap.sock \
-p /var/run/docker-bootstrap.pid \
--iptables=false \
--ip-masq=false \
--bridge=none \
2016-11-22 01:17:24 -05:00
--data-root=/var/lib/docker-bootstrap \
2016-05-16 06:41:07 -04:00
--exec-root=/var/run/docker-bootstrap
```
2023-11-03 09:20:54 -04:00
### Default network options
The `default-network-opts` key in the `daemon.json` configuration file, and the
equivalent `--default-network-opt` CLI flag, let you specify default values for
driver network driver options for new networks.
The following example shows how to configure options for the `bridge` driver
using the `daemon.json` file.
```json
{
"default-network-opts": {
"bridge": {
"com.docker.network.bridge.host_binding_ipv4": "127.0.0.1",
2024-03-05 08:27:26 -05:00
"com.docker.network.driver.mtu": "1234"
2023-11-03 09:20:54 -04:00
}
}
}
```
This example uses the `bridge` network driver. Refer to the
2024-08-11 10:43:21 -04:00
[bridge network driver page ](https://docs.docker.com/engine/network/drivers/bridge/#options )
2023-11-03 09:20:54 -04:00
for an overview of available driver options.
After changing the configuration and restarting the daemon, new networks that
you create use these option configurations as defaults.
```console
$ docker network create mynet
$ docker network inspect mynet --format "{{json .Options}}"
2024-03-05 08:27:26 -05:00
{"com.docker.network.bridge.host_binding_ipv4":"127.0.0.1","com.docker.network.driver.mtu":"1234"}
2023-11-03 09:20:54 -04:00
```
Note that changing this daemon configuration doesn't affect pre-existing
networks.
Using the `--default-network-opt` CLI flag is useful for testing and debugging
purposes, but you should prefer using the `daemon.json` file for persistent
daemon configuration. The CLI flag expects a value with the following format:
`driver=opt=value` , for example:
```console
$ sudo dockerd \
--default-network-opt bridge=com.docker.network.bridge.host_binding_ipv4=127.0.0.1 \
2024-03-05 08:27:26 -05:00
--default-network-opt bridge=com.docker.network.driver.mtu=1234
2023-11-03 09:20:54 -04:00
```