Skip to content

operator: re-measure resource sizing at scale; the equations under-size large clusters #839

Open

Description

@ayuskauskas

Problem

The operator's sizing guidance, docs/operations/resources-at-scale.md and the chart's default resource calculation from estimatedNodeCount and estimatedPackageCount (chart/templates/deployment.yaml), is validated only up to 1k nodes. It no longer describes how the operator uses memory:

Proposal

Redo the sizing investigation on top of #797, at several cluster sizes including at least one past 2k nodes, varying pod count and retained Jobs (jobTtlSucceeded) along with node and package count. The opt-in pprof endpoint in #795 would make the profiling repeatable. From the results:

  • Update the equations and the validated range in resources-at-scale.md.
  • Update the chart calculation to match. Add a pod-count input if the data shows it is needed.
  • Decide whether the chart should derive GOMEMLIMIT from the memory limit.

Follows #797 and #796.

Activity

  1. added theissue type on Oct 14, 2026
  2. added
    needs-triageAwaiting initial triage by a maintainer
    component/operatorSkyhook operator (controller-manager)
    and removed
    needs-triageAwaiting initial triage by a maintainer
    on Oct 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    component/operatorSkyhook operator (controller-manager)

    Type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions