Skip to content

[v25.2.x] rptest: Enable fast uploads in datalake test#28498

Merged
piyushredpanda merged 1 commit into
redpanda-data:v25.2.xfrom
vbotbuildovich:backport-pr-28492-v25.2.x-721
Jan 17, 2026
Merged

[v25.2.x] rptest: Enable fast uploads in datalake test#28498
piyushredpanda merged 1 commit into
redpanda-data:v25.2.xfrom
vbotbuildovich:backport-pr-28492-v25.2.x-721

Conversation

@vbotbuildovich
Copy link
Copy Markdown
Collaborator

@vbotbuildovich vbotbuildovich commented Nov 12, 2025

Backport of PR #28492

@Lazin @vbotbuildovich
rptest: Enable fast uploads in datalake test
d2c0c69 
The test expects uplads to happen in 10 minutes. The problem is that it
create different number of partitions in docker and on a dedicated
machine (100 vs 1000). With 1000 partitions the chance that one
partition will receive not enough data to roll a segment is relatively
high.

The fix is to force uploads and to increase the amount of data on a
dedicated node.

Signed-off-by: Evgeny Lazin <4lazin@gmail.com>
(cherry picked from commit e8e0a17)
@vbotbuildovich vbotbuildovich added this to the v25.2.x-next milestone Nov 12, 2025
@vbotbuildovich vbotbuildovich added the kind/backport PRs targeting a stable branch label Nov 12, 2025
@vbotbuildovich vbotbuildovich requested a review from Lazin November 12, 2025 18:22
@vbotbuildovich
Copy link
Copy Markdown
Collaborator Author

vbotbuildovich commented Nov 12, 2025

CI test results

test results on build#76149
test_class test_method test_arguments test_kind job_url test_status passed reason test_history
MaintenanceTest test_maintenance_sticky {"use_rpk": true} integration https://buildkite.com/redpanda/redpanda/builds/76149#019a7969-41ee-4a35-82cb-c16be1a33075 FLAKY 19/21 upstream reliability is '100.0'. current run reliability is '90.47619047619048'. drift is 9.52381 and the allowed drift is set to 50. The test should PASS https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=MaintenanceTest&test_method=test_maintenance_sticky
RandomNodeOperationsTest test_node_operations {"cloud_storage_type": 1, "compaction_mode": "chunked_sliding_window", "enable_failures": false, "mixed_versions": true, "with_iceberg": false} integration https://buildkite.com/redpanda/redpanda/builds/76149#019a7963-4440-4951-b6cb-f2c28cf05ce6 FLAKY 18/21 upstream reliability is '100.0'. current run reliability is '85.71428571428571'. drift is 14.28571 and the allowed drift is set to 50. The test should PASS https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=RandomNodeOperationsTest&test_method=test_node_operations
RandomNodeOperationsTest test_node_operations {"cloud_storage_type": 1, "compaction_mode": "chunked_sliding_window", "enable_failures": true, "mixed_versions": true, "with_iceberg": false} integration https://buildkite.com/redpanda/redpanda/builds/76149#019a7963-443c-4bf2-8c3f-b2d0025e9338 FLAKY 20/21 upstream reliability is '100.0'. current run reliability is '95.23809523809523'. drift is 4.7619 and the allowed drift is set to 50. The test should PASS https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=RandomNodeOperationsTest&test_method=test_node_operations

@piyushredpanda piyushredpanda merged commit 5b5803c into redpanda-data:v25.2.x Jan 17, 2026
17 checks passed
@tyson-redpanda tyson-redpanda modified the milestones: v25.2.x-next, v25.2.14 Jan 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@piyushredpanda piyushredpanda piyushredpanda approved these changes

@Lazin Lazin Awaiting requested review from Lazin

Assignees

No one assigned

Labels

kind/backport PRs targeting a stable branch

Projects

None yet

Milestone

v25.2.14

Development

Successfully merging this pull request may close these issues.

4 participants

@vbotbuildovich @piyushredpanda @tyson-redpanda @Lazin