atevals
core-ability evals for atproto agent tooling (pdsx, atproto docs MCP)
Star
Fork
Watch

Commits on main
docs: use absolute tangled urls for repo links
committed
readme: drop the file map and file names
committed
readme: rewrite to say what atevals is, how to run it and why it is shaped this way
committed
evals: package the python harness as atevals and fence off the zig spike
committed
evals: record the core write task results
committed
evals: record the pdsx 0.1.11 + public docs MCP core results
committed
evals: record the deployed pdsx query fix in core results
committed
evals: add a guarded 0.1.10 baseline and record first core results
committed
evals: document the core-ability task runner
committed
evals: add the five core-ability tasks graded against the live network
committed
docs: reopen where the identity and provenance capabilities live
committed
docs: record the purpose-built identity + provenance MCP decision
committed
docs: propose five core atproto abilities for the evals
committed
evals: split docs references into required and optional points
committed
evals: add docs task grading answers and atproto.com citations
committed
Correct search routing diagnosis and document unchanged eval failure
committed
evals: add bounded Watson retrieval with hidden ground truth
committed
evals: add native Zig lifecycle runner, OTel export, and CI artifacts
committed
evals: port native MCP integration to Zig 0.17
committed
evals: verify native Zig MCP transport and span capture
committed
evals: add isolated PDSX CRUD runner and independent verification
committed