Issues

• Disaggregate every suite by language and group with a max-gap floor

  enhancementfeature
  ChelseaKR/plumbline#69 · Filter by author ChelseaKR opened on Sep 6, 2026
  1

• Calibrate the model judge against human labels and fail closed below a floor

  enhancementfeature
  ChelseaKR/plumbline#66 · Filter by author ChelseaKR opened on Sep 6, 2026
  1

• Add sentence-level passage attribution for answers drawn from several passages

  enhancementfeature
  ChelseaKR/plumbline#62 · Filter by author ChelseaKR opened on Sep 6, 2026
  1

• Make refusal and denial lexicons declarable per language with required coverage

  enhancementfeature
  ChelseaKR/plumbline#61 · Filter by author ChelseaKR opened on Sep 6, 2026
  1

• The GitHub Action has never been exercised from an external consuming repository

  roadmap
  ChelseaKR/plumbline#57 · Filter by author ChelseaKR opened on Sep 5, 2026
  1

• Publish to PyPI as plumbline-eval — needs a human to register the trusted publisher

  roadmap
  ChelseaKR/plumbline#56 · Filter by author ChelseaKR opened on Sep 5, 2026
  1