okami101/blog
2
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 46 Wiki Activity

wip kube

Browse Source
This commit is contained in:
Adrien Beaudouin
2023-05-13 19:53:04 +02:00
parent 3efaf3000f
commit f36f484940
2 changed files with 48 additions and 32 deletions
Download Patch File Download Diff File Expand all files Collapse all files

72
content/posts/10-build-your-kubernetes-cluster/index.md
View File

@@ -14,12 +14,12 @@ Build your self-hosted Kubernetes cluster and be free from any SaaS solutions by
This guide is mainly intended for any developers or some SRE who want a Kubernetes cluster that respect following conditions : This guide is mainly intended for any developers or some SRE who want a Kubernetes cluster that respect following conditions :
1. On-Premise management (The Hard Way), no managed Kubernetes provider 1. On-Premise management (The Hard Way), no managed Kubernetes provider, will use `K3s` as lightweight solution
2. Follow the GitOps principles 2. Follow the **GitOps** principles
3. High availability with cloud Load Balancer and resilient storage and DB 3. **High availability** with cloud Load Balancer and resilient storage and DB
4. Fully monitored 4. Fully **monitored**
5. Complete CI/CD pipeline 5. Complete **CI/CD pipeline**
6. Not too much expensive (from $30 to $70 /month depending on your needs) 6. Not too much expensive (from €30 to €70 /month depending on your needs)
### You may don't need Kubernetes ### You may don't need Kubernetes
@@ -43,60 +43,74 @@ Please let me know in below comments if you have other better suggestions !
## Cluster Architecture 🏘️ ## Cluster Architecture 🏘️
Note as this cluster will be intended for developer user with complete self-hosted CI/CD solution. So for a good cluster architecture starting point, we can imagine the following nodes : Here are the nodes that we'll need for a complete self-hosted kubernetes cluster :
| server | description | | server | description |
| --------------- | ----------------------------------------------------------------------------------------------------- | | --------------- | ------------------------------------------------------------------------------------------------------ |
| `controller-0x` | The control planes nodes, use at least 3 or any greater odd number (when etcd) for HA kube API server | | `controller-0x` | The control planes nodes, use at least 3 or any greater odd number (when etcd) for HA kube API server |
| `worker-0x` | Workers for your production/staging apps, at least 3 for running Longhorn for resilient storage | | `worker-0x` | Workers for your production/staging apps, at least 3 for running Longhorn for resilient storage |
| `data-0x` | Data nodes for any DB / critical statefulset pods | | `data-0x` | Dedicated nodes for any DB / critical statefulset pods, recommended if you won't use managed databases |
| `monitor-0x` | Workers dedicated to monitoring | | `monitor-0x` | Workers dedicated for monitoring, optional |
| `runner-0x` | Workers dedicated to CI/CD pipelines execution | | `runner-0x` | Workers dedicated for CI/CD pipelines execution, optional |
Basic target complete HA architecture for a basic app that needs replicated storage (with Longhorn) and DB (PostgreSQL) :
```mermaid ```mermaid
flowchart TD flowchart TD
lb((Load Balancer)) lb((Load Balancer))
subgraph worker-01 subgraph worker-01
traefik-01([Traefik]) traefik-01([Traefik])
apps-01[Apps] app-01[App]
longhorn-01[/Longhorn/] longhorn-01[/Longhorn/]
traefik-01 --> apps-01 traefik-01 --> app-01
longhorn-01 --> apps-01 longhorn-01 --> app-01
end end
subgraph worker-02 subgraph worker-02
traefik-02([Traefik]) traefik-02([Traefik])
apps-02[Apps] app-02[App]
longhorn-02[/Longhorn/] longhorn-02[/Longhorn/]
traefik-02 --> apps-02 traefik-02 --> app-02
longhorn-02 --> apps-02 longhorn-02 --> app-02
end end
subgraph worker-03 subgraph worker-03
traefik-03([Traefik]) traefik-03([Traefik])
apps-03[Apps] app-03[App]
longhorn-03[/Longhorn/] longhorn-03[/Longhorn/]
traefik-03 --> apps-03 traefik-03 --> app-03
longhorn-03 --> apps-03 longhorn-03 --> app-03
end end
lb --> traefik-01 lb --> traefik-01
lb --> traefik-02 lb --> traefik-02
lb --> traefik-03 lb --> traefik-03
subgraph data-01 subgraph data [data-0x]
direction LR
postgresql[(PostgreSQL Primary)] postgresql[(PostgreSQL Primary)]
end
subgraph data-02
postgresql-replica[(PostgreSQL Replica)] postgresql-replica[(PostgreSQL Replica)]
end end
apps-01 --> postgresql app-01 --> data
apps-02 --> postgresql app-02 --> data
apps-03 --> postgresql app-03 --> data
postgresql --> postgresql-replica postgresql --> postgresql-replica
``` ```
## Cheap solution with Hetzner VPS 🖥️ ## Cheap solution with Hetzner VPS 🖥️
| Server Name | Type | Quantity | Unit Price |
| ------------ | -------- | ------------------------------- | ---------- |
| | **LB1** | | 5.39 |
| `manager-0x` | **CX21** | 1 or 3 for HA cluster | 0.5 + 4.85 |
| `worker-0x` | **CX21** | 3 minimum required for Longhorn | 0.5 + 4.85 |
| `data-0x` | **CX21** | 2 for HA database | 0.5 + 4.85 |
| `monitor-0x` | **CX21** | 1 can be enough | 0.5 + 4.85 |
| `runner-0x` | **CX21** | 1 for start | 0.5 + 4.85 |
(5.39+**10**\*(0.5+4.85))*1.2 = **€70.67** / month
This is of course for a complete HA cluster, for a minimal working cluster, you can easily get down to **4 nodes**, i.e. **€32.15**. You can even get rid of Load Balancer and simply use basic DNS round-robin.
## Let’s party 🎉 ## Let’s party 🎉
Enough talk, [let's go Charles !]({{< ref "/posts/11-build-your-kubernetes-cluster-part-2" >}}). Enough talk, [let's go Charles !]({{< ref "/posts/11-build-your-kubernetes-cluster-part-2" >}}).

8
content/posts/11-build-your-kubernetes-cluster-part-2/index.md
View File

@@ -10,9 +10,11 @@ draft: true
Build your self-hosted Kubernetes cluster and be free from any SaaS solutions by following this opinionated guide 🎉 Build your self-hosted Kubernetes cluster and be free from any SaaS solutions by following this opinionated guide 🎉
{{< /lead >}} {{< /lead >}}
1. Terraform ## Terraform
2. K3S usage
3. Hetzner CSI drivers ## K3s usage
## Hetzner CSI drivers
## 1st check ✅ ## 1st check ✅