Skip to content

Add blog post announcing the Agent LLM Traces dataset (10K agent runs, 6 domains) - #22

Open
elronbandel wants to merge 5 commits into
mainfrom
blog/agent-llm-traces
Open

Add blog post announcing the Agent LLM Traces dataset (10K agent runs, 6 domains)#22
elronbandel wants to merge 5 commits into
mainfrom
blog/agent-llm-traces

Conversation

@elronbandel

Copy link
Copy Markdown
Contributor

Adds a new blog post announcing the Exgentic Agent LLM Traces dataset release.

What's in it

  • New post source: blogs/agent-llm-traces-v2/blog.md (slug agent-llm-traces-v2, dated 2026-07-01, ~8 min read).
  • Blog card added to the home page (index.html).

The post

An understated launch in the house research-blog voice. Spine: agents are moving into real work, and this is the first large, uniform, public record of what they actually do — 10K real runs across five leading models and six domains (software engineering, deep research, personal-task automation, customer service, technical support), every model call preserved in one open format (OpenTelemetry GenAI conventions).

Includes a composition table, an honest "what it doesn't cover" section, and links to the dataset, the full corpus, and the methodology.

Notes

  • The built blog/ output is gitignored and produced by CI, so only the source and the index.html card are committed.
  • All figures/numbers are taken from the published dataset card (token averages independently corroborated against the local data).

Announces the Exgentic Agent LLM Traces dataset release (10K real agent
runs across six domains, one standard format). Adds the blog source and
the blog card on the home page.
@elronbandel elronbandel changed the title Blog: What Frontier Agents Actually Do Add blog post announcing the Agent LLM Traces dataset (10K agent runs, 6 domains) Jul 1, 2026
elronbandel and others added 4 commits July 1, 2026 19:34
- Add "A closer look" section with three tables: benchmark complexity,
  per-model token cost, and per-agent prefix retention
- Add "Inference benchmarking: an ongoing example" section covering
  inference-perf (kubernetes-sigs/inference-perf) and its OTel trace replay
- Add load-testing bullet to "What you can do with it"
- Fix "sessions" → "runs" throughout
- Add inference-perf source link

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants