Skip to content

Add MBPP evaluator#2439

Open
natke wants to merge 16 commits into
mainfrom
feature/add-mbpp-evaluator
Open

Add MBPP evaluator#2439
natke wants to merge 16 commits into
mainfrom
feature/add-mbpp-evaluator

Merge origin/main into feature/add-mbpp-evaluator: keep eos_token_ids…

47bf207
Select commit
Loading
Failed to load commit list.
Azure Pipelines / Olive CI succeeded May 12, 2026 in 46m 18s

Build #20260512.3 succeeded

Details

Tests

  • Failed: 0 (0.00%)
  • Passed: 4,651 (92.10%)
  • Other: 399 (7.90%)
  • Total: 5,050
Code coverage

  • 17481 of 26832 line covered (65.15%)