Skip to content

FIX: feed TAP the objective score, not an auxiliary one - #3104

Merged
Richard Lundeen (richlundeen) merged 2 commits into
microsoft:mainfrom
u7k4rs6:fix/tap-objective-score-feedback
Oct 11, 2026
Merged

Richard Lundeen (richlundeen) merged 2 commits into
microsoft:mainfrom
u7k4rs6:fix/tap-objective-score-feedback

Conversation

@u7k4rs6

Copy link
Copy Markdown
Contributor

Fixes #3103.

_get_response_score_async now picks the score whose scorer_class_identifier matches the node's objective scorer, and returns "unavailable" if there isn't one, same as when there are no scores.

Same repro on this branch feeds 0.2. Test: with an aux score stored first, the node returns the objective score, and with only an aux score it returns "unavailable". It fails on main. tests/unit/executor/attack/multi_turn: 434 passed.

Skip unidentified scores when selecting objective feedback and cover all combinations of legacy, auxiliary, and objective scores.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: a0bb1555-a9fd-458e-8701-de4f2fe159f1
@richlundeen
Richard Lundeen (richlundeen) added this pull request to the merge queue Oct 11, 2026
Merged via the queue into microsoft:main with commit 65205e5 Oct 11, 2026
60 of 82 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

BUG: TAP feeds the adversarial chat an auxiliary score instead of the objective score

3 participants