Skip to content

fix: resolve pipeline-perf-test-basic CI failures (#2511)#2605

Closed
jmacd wants to merge 1 commit intoopen-telemetry:mainfrom
jmacd:jmacd/perf_fix
Closed

fix: resolve pipeline-perf-test-basic CI failures (#2511)#2605
jmacd wants to merge 1 commit intoopen-telemetry:mainfrom
jmacd:jmacd/perf_fix

Conversation

@jmacd
Copy link
Copy Markdown
Contributor

@jmacd jmacd commented Apr 8, 2026

Change Summary

Fix two distinct failures in the pipeline-perf-test-basic CI job:

to main.rs, but the Dockerfile did not copy this file into the build context.
Add the missing COPY line.

  1. DrainDeadlineReached on ubuntu-latest: The basic validation job was running the same 100k signals/sec config as dedicated 64-core hardware. On shared CI runners (4 vCPUs), the pipeline cannot drain ~2.5M queued signals within the 60s timeout. Create a lightweight 1k signals/sec config for correctness validation and use it for the basic job.

What issue does this PR close?

Fixes #2511
if we're lucky

How are these changes tested?

🤞

Are there any user-facing changes?

No

Fix two distinct failures in the pipeline-perf-test-basic CI job:

   to main.rs, but the Dockerfile did not copy this file into the build context.
   Add the missing COPY line.

2. DrainDeadlineReached on ubuntu-latest: The basic validation job was running
   the same 100k signals/sec config as dedicated 64-core hardware. On shared
   CI runners (4 vCPUs), the pipeline cannot drain ~2.5M queued signals within
   the 60s timeout. Create a lightweight 1k signals/sec config for correctness
   validation and use it for the basic job.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@jmacd jmacd requested a review from a team as a code owner April 8, 2026 18:49
@github-actions github-actions bot added rust Pull requests that update Rust code ci-repo Repository maintenance, build, GH workflows, repo cleanup, or other chores labels Apr 8, 2026
@codecov
Copy link
Copy Markdown

codecov bot commented Apr 8, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 88.45%. Comparing base (68e472c) to head (fdd6728).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2605      +/-   ##
==========================================
+ Coverage   88.42%   88.45%   +0.02%     
==========================================
  Files         620      620              
  Lines      228395   228395              
==========================================
+ Hits       201961   202017      +56     
+ Misses      25910    25854      -56     
  Partials      524      524              
Components Coverage Δ
otap-dataflow 90.31% <ø> (+0.03%) ⬆️
query_abstraction 80.61% <ø> (ø)
query_engine 90.74% <ø> (ø)
syslog_cef_receivers ∅ <ø> (∅)
otel-arrow-go 52.45% <ø> (ø)
quiver 92.27% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

run: |
cd tools/pipeline_perf_test
python orchestrator/run_orchestrator.py --config test_suites/integration/continuous/100klrps-docker.yaml
python orchestrator/run_orchestrator.py --config test_suites/integration/continuous/1klrps-docker.yaml
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

when performance label is added, this one is run on the lab machine, so we'd want to conditionally pick based on the label or not.

@cijothomas
Copy link
Copy Markdown
Member

#2515 is needed to fix entire perf test suites - all of them stuck in shutdown failure.

@jmacd
Copy link
Copy Markdown
Contributor Author

jmacd commented Apr 8, 2026

In favor of #2511

@jmacd jmacd closed this Apr 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci-repo Repository maintenance, build, GH workflows, repo cleanup, or other chores rust Pull requests that update Rust code

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

pipeline-perf-test-basic unit test is failing

2 participants