2017-08-29 00:19:25 +03:00
# Bootstrapping the etcd Cluster
2019-09-14 21:41:56 +03:00
Kubernetes components are stateless and store cluster state in [etcd ](https://github.com/etcd-io/etcd ). In this lab you will bootstrap a three node etcd cluster and configure it for high availability and secure remote access.
2017-08-29 00:19:25 +03:00
## Prerequisites
2023-12-22 00:40:04 +03:00
The commands in this lab must be run on each controller instance: `controller-0` , `controller-1` , and `controller-2` . Login to each controller instance:
2017-08-29 00:19:25 +03:00
2023-12-22 00:40:04 +03:00
```gcloud```
2017-08-29 00:19:25 +03:00
```
gcloud compute ssh controller-0
```
2023-12-22 00:40:04 +03:00
```az```
```
az ssh vm --name controller-0 --local-user azureuser
```
OR
```
ssh -i $HOME/.ssh/k8sthehardway azureuser@$(az vm show -d --name controller-0 --query "publicIps" -o tsv)
```
2018-05-12 19:54:18 +03:00
### Running commands in parallel with tmux
[tmux ](https://github.com/tmux/tmux/wiki ) can be used to run commands on multiple compute instances at the same time. See the [Running commands in parallel with tmux ](01-prerequisites.md#running-commands-in-parallel-with-tmux ) section in the Prerequisites lab.
2017-08-29 00:19:25 +03:00
## Bootstrapping an etcd Cluster Member
### Download and Install the etcd Binaries
2019-09-14 21:41:56 +03:00
Download the official etcd release binaries from the [etcd ](https://github.com/etcd-io/etcd ) GitHub project:
2017-08-29 00:19:25 +03:00
```
wget -q --show-progress --https-only --timestamping \
2021-05-02 08:33:46 +03:00
"https://github.com/etcd-io/etcd/releases/download/v3.4.15/etcd-v3.4.15-linux-amd64.tar.gz"
2017-08-29 00:19:25 +03:00
```
Extract and install the `etcd` server and the `etcdctl` command line utility:
```
2023-12-22 00:40:04 +03:00
tar -xvf etcd-v3.4.15-linux-amd64.tar.gz
sudo mv etcd-v3.4.15-linux-amd64/etcd* /usr/local/bin/
2017-08-29 00:19:25 +03:00
```
### Configure the etcd Server
```
2023-12-22 00:40:04 +03:00
sudo mkdir -p /etc/etcd /var/lib/etcd
sudo chmod 700 /var/lib/etcd
sudo cp ca.pem kubernetes-key.pem kubernetes.pem /etc/etcd/
2017-08-29 00:19:25 +03:00
```
The instance internal IP address will be used to serve client requests and communicate with etcd cluster peers. Retrieve the internal IP address for the current compute instance:
2023-12-22 00:40:04 +03:00
```gcloud```
2017-08-29 00:19:25 +03:00
```
INTERNAL_IP=$(curl -s -H "Metadata-Flavor: Google" \
http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/ip)
```
2023-12-22 00:40:04 +03:00
```az```
```
2024-01-29 18:22:57 +03:00
INTERNAL_IP=$(curl -s -H Metadata:true --noproxy "*" "http://169.254.169.254/metadata/instance/network/interface/0/ipv4/ipAddress/0/privateIpAddress?api-version=2021-02-01& format=text")
2023-12-22 00:40:04 +03:00
```
2017-08-29 00:19:25 +03:00
Each etcd member must have a unique name within an etcd cluster. Set the etcd name to match the hostname of the current compute instance:
```
ETCD_NAME=$(hostname -s)
```
Create the `etcd.service` systemd unit file:
```
2018-05-12 19:54:18 +03:00
cat < < EOF | sudo tee / etc / systemd / system / etcd . service
2017-08-29 00:19:25 +03:00
[Unit]
Description=etcd
Documentation=https://github.com/coreos
[Service]
2019-09-14 21:41:56 +03:00
Type=notify
2017-08-29 00:19:25 +03:00
ExecStart=/usr/local/bin/etcd \\
--name ${ETCD_NAME} \\
--cert-file=/etc/etcd/kubernetes.pem \\
--key-file=/etc/etcd/kubernetes-key.pem \\
--peer-cert-file=/etc/etcd/kubernetes.pem \\
--peer-key-file=/etc/etcd/kubernetes-key.pem \\
--trusted-ca-file=/etc/etcd/ca.pem \\
--peer-trusted-ca-file=/etc/etcd/ca.pem \\
--peer-client-cert-auth \\
--client-cert-auth \\
--initial-advertise-peer-urls https://${INTERNAL_IP}:2380 \\
--listen-peer-urls https://${INTERNAL_IP}:2380 \\
2018-05-12 19:54:18 +03:00
--listen-client-urls https://${INTERNAL_IP}:2379,https://127.0.0.1:2379 \\
2017-08-29 00:19:25 +03:00
--advertise-client-urls https://${INTERNAL_IP}:2379 \\
--initial-cluster-token etcd-cluster-0 \\
--initial-cluster controller-0=https://10.240.0.10:2380,controller-1=https://10.240.0.11:2380,controller-2=https://10.240.0.12:2380 \\
--initial-cluster-state new \\
--data-dir=/var/lib/etcd
Restart=on-failure
RestartSec=5
[Install]
WantedBy=multi-user.target
EOF
```
### Start the etcd Server
```
2023-12-22 00:40:04 +03:00
sudo systemctl daemon-reload
sudo systemctl enable etcd
sudo systemctl start etcd
2017-08-29 00:19:25 +03:00
```
> Remember to run the above commands on each controller node: `controller-0`, `controller-1`, and `controller-2`.
## Verification
List the etcd cluster members:
```
2018-05-12 19:54:18 +03:00
sudo ETCDCTL_API=3 etcdctl member list \
--endpoints=https://127.0.0.1:2379 \
--cacert=/etc/etcd/ca.pem \
--cert=/etc/etcd/kubernetes.pem \
--key=/etc/etcd/kubernetes-key.pem
2017-08-29 00:19:25 +03:00
```
> output
```
2020-07-18 10:24:55 +03:00
3a57933972cb5131, started, controller-2, https://10.240.0.12:2380, https://10.240.0.12:2379, false
f98dc20bce6225a0, started, controller-0, https://10.240.0.10:2380, https://10.240.0.10:2379, false
ffed16798470cab5, started, controller-1, https://10.240.0.11:2380, https://10.240.0.11:2379, false
2017-08-29 00:19:25 +03:00
```
Next: [Bootstrapping the Kubernetes Control Plane ](08-bootstrapping-kubernetes-controllers.md )