<arch.design/>
Principles/Kubernetes Orchestration
InfrastructureInfrastructureadvanced2014k8spodsdeploymentsscheduling

Kubernetes Orchestration

Automate the deployment, scaling, and self-healing of containerised applications across a cluster of nodes.

5/5
Operates at: Infrastructure level

Deployment platform — Kubernetes, Docker, cloud config

Interactive visualization

Live
Control Plane
API Server · Scheduler · etcd
manages →
Node 1Ready
v1
v1
2 running ·
Node 2Ready
v1
v1
2 running ·
Node 3Ready
v1
1 running ·
Running (v1)
Running (v2)
Pending
Terminating
Failed

How it works

Kubernetes (K8s), open-sourced by Google from its internal Borg system, is the de-facto container orchestration platform. It schedules containers onto cluster nodes, manages their lifecycle, and ensures desired state is maintained.

Core objects: Pod (smallest deployable unit — one or more containers), Deployment (desired replica count + rolling update strategy), Service (stable network endpoint for a set of Pods), Ingress (HTTP routing). The control plane (API Server, Scheduler, Controller Manager, etcd) continuously reconciles actual state toward desired state.

Why it matters

Managing containers manually at scale is impossible. Kubernetes automates scheduling, self-healing, scaling, and rolling deployments — it's the operating system for cloud-native applications.

When to use

  • Running multiple containerised services that need to scale
  • Requiring automatic failover and self-healing
  • Multi-tenant platform serving multiple teams

When NOT to use

  • Simple single-container apps — use managed services (Cloud Run, Fargate)
  • Small teams without DevOps capacity to operate a cluster

Trade-offs

+

Automatic self-healing and scaling

High operational complexity — YAML sprawl, RBAC, networking

+

Declarative desired-state model

Steep learning curve for operators and developers

+

Ecosystem richness (Helm, Operators, service meshes)

Overkill for small workloads

In production

Airbnb

K8s runs their entire service fleet; hundreds of engineers deploy independently

Pinterest

Migrated to K8s to improve resource utilisation by 20-30%

Industry adoption

5/5Ubiquitous — used at virtually every scale-focused company.

Related principles