Skip to content

Advanced Disciplines

DaemonSets and the Ministry of Every Node

DaemonSets are the cluster’s distributed nervous tissue. When they fail, every node feels it.

Text

Authored as doctrine; evaluated as operations.

Doctrine

A DaemonSet is a mandate: this component must exist on every node. That makes it powerful and dangerous.

Kubblai doctrine: node-wide agents must be minimal, observable, and upgraded with extreme discipline.

Common uses (and why they’re risky)

CNI, log shippers, metrics agents, runtime security sensors—these are critical, but they multiply blast radius.

  • A broken DaemonSet can overload nodes or break networking cluster-wide.
  • DaemonSets interact with host resources: disk, CPU, kernel, and network.
  • Upgrades must be staged; rollback must be immediate.

Upgrade strategy

Use surge/rolling strategies carefully. Test on a small node pool. Watch node health and system logs. Abort early.

Treat DaemonSet changes as platform releases, not application deploys.

Operational discipline

Instrument per-node resource usage. Monitor agent crash loops. Correlate with node instability and kubelet health.

The first sign of trouble is often ‘it’s slow everywhere.’