Skip to content

WIP: chore: create script to submit AI conformance results to cncf/k8s-ai-conformance#18106

Open
justinsb wants to merge 2 commits intokubernetes:masterfrom
justinsb:submit_ai_conformance
Open

WIP: chore: create script to submit AI conformance results to cncf/k8s-ai-conformance#18106
justinsb wants to merge 2 commits intokubernetes:masterfrom
justinsb:submit_ai_conformance

Conversation

@justinsb
Copy link
Copy Markdown
Member

No description provided.

@k8s-ci-robot k8s-ci-robot added do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Mar 20, 2026
@k8s-ci-robot
Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign rifelpet for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@justinsb justinsb force-pushed the submit_ai_conformance branch from a6034a0 to 82db265 Compare March 20, 2026 20:27
@justinsb justinsb force-pushed the submit_ai_conformance branch from 82db265 to 01f6793 Compare March 20, 2026 20:36
f"Test evidence is included directly in this PR as markdown files under "
f"`v{kube_minor}/{KOPS_DIR_NAME}/tests/`.\n\n"
f"The tests were run automatically by the "
f"[e2e-kops-ai-conformance](https://prow.k8s.io/view/gs/{GCS_BUCKET}/logs/{JOB_NAME}/{build_id}) Prow job.\n\n"
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm wondering about this. The job is not meant to stay forever so will lose those logs. I don't have a concrete solution beside a dedicated bucket for conformance reporting.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What I'm trying is to upload the artifacts into the conformance repo (i.e. include them in the PR cncf/k8s-ai-conformance#77 ). We'll see what they say!


def create_pr(tmpdir, submit_dir, kube_minor, kube_version, platform_version, build_id):
"""Clone the conformance repo, commit the submission, and open a PR."""
github_user = os.environ.get("GITHUB_USER", os.environ.get("USER", ""))
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe use gh api user --jq '.login'?

@k8s-ci-robot
Copy link
Copy Markdown
Contributor

@justinsb: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
pull-kops-e2e-k8s-aws-calico 01f6793 link true /test pull-kops-e2e-k8s-aws-calico

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants