dt/tests: bump IBM/sarama and franz-go for Kafka 4.x test alignment#30451
Open
nguyen-andrew wants to merge 2 commits into
Open
dt/tests: bump IBM/sarama and franz-go for Kafka 4.x test alignment#30451nguyen-andrew wants to merge 2 commits into
nguyen-andrew wants to merge 2 commits into
Conversation
Member
Author
|
/ci-repeat 1 |
Aligns the two IBM/sarama pin sites in the test infra:
- tests/go/sarama/produce_test/go.mod (the produce_test binary)
- tests/docker/ducktape-deps/sarama-examples (clone-and-build
script for the example binaries used by SaramaTest)
These must move together: SaramaTest and SaramaProduceTest exercise
the same Sarama codebase via different harnesses, so skew between
the pins risks silent compat-coverage gaps.
The sibling produce_legacy_version_test/ stays on Shopify/sarama
v1.38.1 by design. That older version omits max_timestamp on produce
batches, and SaramaLegacyProduceTest relies on that omission to
exercise the kafka_produce_batch_validation code path.
Member
Author
|
Force push to rebase on dev. |
Aligns with kgo-verifier's franz-go/kadm/kmsg pinning at v1.20.x, v1.17.1, and v1.12.0 respectively. go mod tidy raised the Go directive 1.21.1 → 1.24.0 to match the toolchain (also matching kgo-verifier).
Member
Author
|
/ci-repeat 1 |
7 tasks
Contributor
There was a problem hiding this comment.
Pull request overview
Updates Go-based test clients used in Redpanda’s dt/ducktape test environment to versions aligned with Kafka 4.x compatibility testing (ENG-1185), including corresponding module/sum updates.
Changes:
- Bump
github.com/twmb/franz-go(and related indirect deps) fortransform-verifier, and update itsgo.modGo version directive. - Bump
github.com/IBM/saramafor theproduce_testGo module. - Update the ducktape docker dependency script to clone/build Sarama examples from the matching Sarama tag.
Reviewed changes
Copilot reviewed 3 out of 4 changed files in this pull request and generated no comments.
| File | Description |
|---|---|
| tests/go/transform-verifier/go.mod | Updates Go module directive and bumps franz-go + related dependencies used by transform-verifier. |
| tests/go/transform-verifier/go.sum | Refreshes dependency checksums to match the updated transform-verifier module graph. |
| tests/go/sarama/produce_test/go.mod | Bumps the Sarama dependency version for the Sarama-based produce test client. |
| tests/docker/ducktape-deps/sarama-examples | Updates the Sarama git tag used to build example binaries in the ducktape deps image. |
ivotron
approved these changes
May 14, 2026
Member
ivotron
left a comment
There was a problem hiding this comment.
lgtm assuming ducktape tests are green. so no backport required?
Member
Author
|
@ivotron I don't think we need to backport this |
dotnwat
approved these changes
May 14, 2026
Collaborator
CI test resultstest results on build#84483
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Bumps two Go test clients to versions aligned with Kafka 4.latest,
continuing the ENG-1185 effort.
IBM/sarama: v1.45.1 → v1.48.0
The pin lives in two places that have to move together:
tests/go/sarama/produce_test/go.mod(theproduce_testbinarydriven by
SaramaProduceTest).tests/docker/ducktape-deps/sarama-examples(the clone-and-buildscript for the four example binaries driven by
SaramaTest).The sibling
tests/go/sarama/produce_legacy_version_test/stays onShopify/sarama v1.38.1by design. That older version omitsmax_timestampon produce batches, andSaramaLegacyProduceTestrelies on that omission to exercise the
kafka_produce_batch_validationcode path. Bumping it would silently no-op the test.
franz-go: v1.15.1 → v1.20.7 in transform-verifier
Bumps
tests/go/transform-verifier/go.modfrom v1.15.1 to v1.20.7.go mod tidyraised the Go directive 1.21.1 → 1.24.0 to match thetoolchain.
Fixes CORE-16243
& CORE-16244.
Backports Required
Release Notes