mirrors
/
kubernetes-the-hard-way
mirror of https://github.com/kelseyhightower/kubernetes-the-hard-way
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

Add basic VM configuration in prerequisites

pull/582/head
Nemo 2020-06-20 11:47:14 +02:00
parent ccc7fe7a02
commit 6b9a2a42e6
1 changed files with 242 additions and 21 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

263
docs/01-prerequisites.md
View File

@ -1,54 +1,275 @@
# Prerequisites
## Google Cloud Platform
## Proxmox Hypervisor
This tutorial leverages the [Google Cloud Platform](https://cloud.google.com/) to streamline provisioning of the compute infrastructure required to bootstrap a Kubernetes cluster from the ground up. [Sign up](https://cloud.google.com/free/) for $300 in free credits.
This tutorial is intended to be performed with a [Proxmox](https://proxmox.com/en/) hypervisor, but you can also use it with ESXi, KVM, Virtualbox or other hypervisor.
[Estimated cost](https://cloud.google.com/products/calculator/#id=55663256-c384-449c-9306-e39893e23afb) to run this tutorial: $0.23 per hour ($5.46 per day).
> The compute resources required for this tutorial is 26GB of RAM and 100GB HDD (or SSD).
> The compute resources required for this tutorial exceed the Google Cloud Platform free tier.
List of the VM used in this tutorial :
## Google Cloud Platform SDK
|Name|Role|vCPU|RAM|Storage (thin)|IP|OS|
|--|--|--|--|--|--|--|
|controller-0|controller|2|4GB|40GB|192.168.8.10/24|Ubuntu|
|controller-1|controller|2|4GB|40GB|192.168.8.11/24|Ubuntu|
|controller-2|controller|2|4GB|40GB|192.168.8.12/24|Ubuntu|
|worker-0|worker|2|4GB|40GB|192.168.8.20/24|Ubuntu|
|worker-1|worker|2|4GB|40GB|192.168.8.21/24|Ubuntu|
|worker-2|worker|2|4GB|40GB|192.168.8.22/24|Ubuntu|
|gateway-01|Reverse Proxy, client tools, gateway|2|4GB|40GB|192.168.8.22/24|Debian|
### Install the Google Cloud SDK
On the Proxmox hypervisor, I just added the `k8s-` prefix in the VM names.
Follow the Google Cloud SDK [documentation](https://cloud.google.com/sdk/) to install and configure the `gcloud` command line utility.
![proxmox vm list](images/proxmox-vm-list.PNG)
Verify the Google Cloud SDK version is 262.0.0 or higher:
## Prepare the environment
### Hypervisor network
For this tutorial, you need 2 networks on your Proxmox hypervisor :
* a public network bridge (`vmbr0` in the following screenshot).
* a private Kubernetes network bridge (`vmbr8` in the following screenshot).
![proxmox network](images/proxmox-network.PNG)
All the Kubernetes nodes (workers and controllers) only need one network interface linked to the private Kubernetes network (`vmbr8`).
![proxmox vm hardware](images/proxmox-vm-hardware.PNG)
The reverse proxy / client tools / gateway VM need to have 2 network interfaces, one linked to the private Kubernetes network (`vmbr8`) and the other linked to the public network (`vmbr0`).
![proxmox vm hardware](images/proxmox-vm-hardware-gw.PNG)
### Network architecture
This diagram represents the network design:
![architecture network](images/architecture-network.PNG)
> If you want, you can define the configuration for the IPv6 stack.
### Gateway VM installation
> The basic VM installation process is not the purpose of this tutorial.
> Because it's just a tutorial, the IPv6 stack is not configured, but you can configure it if you want.
This VM is used as a NAT gateway for the private Kubernetes network, as a reverse proxy and as a client tools.
This means all the client steps like certificates generation will be done on this VM (in the next part of this tutorial).
You have to:
* Install the latest [amd64 Debian netinst image](https://www.debian.org/CD/netinst/) on this VM.
* Configure the network interfaces (see the network architecture). Example of `/etc/network/interfaces` file if ens18 is your public interface and ens19 is your private interface (you need to replace `PUBLIC_IP_ADDRESS`, `MASK` and `PUBLIC_IP_GATEWAY` with you values):
```bash
gcloud version
source /etc/network/interfaces.d/*
# The loopback network interface
auto lo
iface lo inet loopback
# The public network interface
auto ens18
allow-hotplug ens18
iface ens18 inet static
address PUBLIC_IP_ADDRESS/MASK
gateway PUBLIC_IP_GATEWAY
dns-nameservers 9.9.9.9
# The private network interface
auto ens19
allow-hotplug ens19
iface ens19 inet static
address 192.168.8.1/24
dns-nameservers 9.9.9.9
```
### Set a Default Compute Region and Zone
> If you want, you can define the configuration for the IPv6 stack.
This tutorial assumes a default compute region and zone have been configured.
If you are using the `gcloud` command-line tool for the first time `init` is the easiest way to do this:
* Define the VM hostname:
```bash
gcloud init
hostnamectl set-hostname gateway-01
```
Then be sure to authorize gcloud to access the Cloud Platform with your Google user credentials:
* Update the packages list and update the system:
```bash
gcloud auth login
sudo apt-get update && sudo apt-get upgrade -y
```
Next set a default compute region and compute zone:
* Install SSH, vim, tmux, NTP and iptables-persistent:
```bash
gcloud config set compute/region us-west1
sudo apt-get install ssh vim tmux ntp iptables-persistent -y
```
Set a default compute zone:
* Enable and start the SSH and NTP services:
```bash
gcloud config set compute/zone us-west1-c
sudo systemctl enable ntp
sudo systemctl start ntp
sudo systemctl enable ssh
sudo systemctl start ssh
```
> Use the `gcloud compute zones list` command to view additional regions and zones.
* Enable IP routing:
```bash
echo 'net.ipv4.ip_forward=1' >> /etc/sysctl.conf
echo '1' > /proc/sys/net/ipv4/ip_forward
```
> If you want, you can define the configuration for the IPv6 stack.
* Configure the iptables firewall (allow some ports and configure NAT). Example of `/etc/iptables/rules.v4` file if ens18 is your public interface and ens19 is your private interface:
```bash
# Generated by xtables-save v1.8.2 on Fri Jun 5 16:45:02 2020
*nat
-A POSTROUTING -o ens18 -j MASQUERADE
COMMIT
*filter
-A INPUT -i lo -j ACCEPT
# allow ssh, so that we do not lock ourselves
-A INPUT -i ens18 -p tcp -m tcp --dport 22 -j ACCEPT
-A INPUT -i ens18 -p tcp -m tcp --dport 80 -j ACCEPT
-A INPUT -i ens18 -p tcp -m tcp --dport 443 -j ACCEPT
-A INPUT -i ens18 -p icmp -j ACCEPT
# allow incoming traffic to the outgoing connections,
# et al for clients from the private network
-A INPUT -m state --state RELATED,ESTABLISHED -j ACCEPT
# prohibit everything else incoming
-A INPUT -i ens18 -j DROP
COMMIT
# Completed on Fri Jun 5 16:45:02 2020
```
> If you want, you can define the configuration for the IPv6 stack.
* If you want to restore iptables rules:
```bash
iptables-restore < /etc/iptables/rules.v4
```
* Configure /etc/hosts file. Example for controller-0 (need to replace `PUBLIC_GW_IP`):
```bash
127.0.0.1 localhost
PUBLIC_GW_IP gateway-01.external gateway-01
# The following lines are desirable for IPv6 capable hosts
::1 localhost ip6-localhost ip6-loopback
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
192.168.8.10 controller-0
192.168.8.11 controller-1
192.168.8.12 controller-2
192.168.8.20 worker-0
192.168.8.21 worker-1
192.168.8.22 worker-2
```
* To confirm the network configuration, reboot the VM and check the active IP addresses:
```bash
sudo reboot
```
### Kubernetes nodes VM installation
> The basic VM installation process is not the purpose of this tutorial.
> Because it's just a tutorial, the IPv6 stack is not configured, but you can configure it if you want.
These VM are used as Kubernetes node (controllers or workers).
The basic VM configuration process is the same of the 6 VM (you can also configure one, clone it and change IP address and hostname for each clone).
You have to:
* Install the [Ubuntu 18.04.4 LTS (Bionic Beaver) Server install image](https://releases.ubuntu.com/18.04/) on this VM.
* Configure the network interface (see the network architecture). Example of `/etc/netplan/00-installer-config.yaml` file if ens18 is the name of your private network interface (you need to change the IP address depending on the installed server):
```bash
# This is the network config written by 'subiquity'
network:
ethernets:
ens18:
addresses:
- 192.168.8.10/24
gateway4: 192.168.8.1
nameservers:
addresses:
- 9.9.9.9
version: 2
```
> If you want, you can define the configuration for the IPv6 stack.
* Define the VM hostname (example for controller-0):
```bash
hostnamectl set-hostname controller-0
```
* Update the packages list and update the system:
```bash
sudo apt-get update && sudo apt-get upgrade -y
```
* Install SSH and NTP:
```bash
sudo apt-get install ssh ntp -y
```
* Enable and start the SSH and NTP services:
```bash
sudo systemctl enable ntp
sudo systemctl start ntp
sudo systemctl enable ssh
sudo systemctl start ssh
```
* Configure /etc/hosts file. Example for controller-0 (need to replace `PUBLIC_GW_IP` and adapt this sample config on each VM):
```bash
127.0.0.1 localhost
127.0.1.1 controller-0
# The following lines are desirable for IPv6 capable hosts
::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
PUBLIC_GW_IP gateway-01.external
192.168.8.1 gateway-01
192.168.8.11 controller-1
192.168.8.12 controller-2
192.168.8.20 worker-0
192.168.8.21 worker-1
192.168.8.22 worker-2
```
* To confirm the network configuration, reboot the VM and check the active IP addresses:
```bash
sudo reboot
```
## Running Commands in Parallel with tmux