Skip to content

Release 2.0.3: opt-in transparent sub-page scoring for dataset v2.02 - #296

Merged
hexapode merged 2 commits into
mainfrom
release/v2.0.3
Nov 16, 2026
Merged

hexapode merged 2 commits into
mainfrom
release/v2.0.3

Conversation

@hexapode

@hexapode hexapode commented Nov 16, 2026 •

Copy link
Copy Markdown
Member

What changed

Prepare CLI 2.0.3. Datasets can opt into metadata.sub_page_handling: "transparent-v1"; text and formatting scoring then ignore only <sub_page> container tags on both sides. Old datasets retain existing behavior. Dataset v2.02 requires this version; compare scores using the same dataset and CLI revisions.

Why

Providers do not need to reproduce GT-only embedded-page wrappers. Without this handling, otherwise identical text loses 5–10 points. Header/footer matching from merged #294 is unchanged. Release notes also cover the intervening form-scoring and Metric Lab changes.

Testing

4,159 parser-metric tests passed, 1 skipped. New regression cases cover nested wrappers, retained footer content, wrappers in provider output, legacy default behavior, and rejection of unknown contracts. Ruff checks pass. Three new opt-in cases fail without the fix and pass with it; the legacy case stays green. Replay: 508 text GT self-checks, 592 header/footer assertions, and six wrapper-omission checks all pass. Table-only eligibility remains unchanged.

@hexapode
hexapode merged commit 4cb2d74 into main Nov 16, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant