Skip to content

Add eval harness for docs integration guides#4714

Open
bgrenon wants to merge 4 commits intomainfrom
bgrenon-neon-guides-test-harness
Open

Add eval harness for docs integration guides#4714
bgrenon wants to merge 4 commits intomainfrom
bgrenon-neon-guides-test-harness

Conversation

@bgrenon
Copy link
Copy Markdown
Collaborator

@bgrenon bgrenon commented Apr 2, 2026

Automated test harness that measures whether framework integration guides are effective enough for an AI agent to follow from zero to a working Neon connection. Uses ephemeral Docker containers, neon.new databases, and an LLM evaluator with a structured rubric.

Includes a /eval-guide slash command for Claude Code.

See readme:
evals/docs-guides/README.md

Co-authored-by: Isaac

Automated test harness that measures whether framework integration
guides are effective enough for an AI agent to follow from zero to
a working Neon connection. Uses ephemeral Docker containers, neon.new
databases, and an LLM evaluator with a structured rubric.

Includes a /eval-guide slash command for Claude Code.

Co-authored-by: Isaac
@vercel
Copy link
Copy Markdown

vercel Bot commented Apr 2, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
neon-next Ready Ready Preview, Comment Apr 6, 2026 1:22pm

Request Review

@bgrenon bgrenon requested a review from danieltprice April 2, 2026 20:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants