eval/bench · pac · Tangled

This repository has no description

pac eval bench

4 files

Ryan Gibb · eval/bench/summary.py gives each geometric mean of pac over the tool a 95% bootstrap interval, 10,000 seeded resamples of the queries, in its tables and in bench.csv · 1mo ago

eval/bench.sh times pac in each order against each tool, the 09-23 harness ported to queries.txt, --order, Cargo.toml roots, npm's query words and readings, with PIN and a Debian cold pass

eval/bench.sh times pac in each order against each tool, the 09-23 harness ported to queries.txt, --order, Cargo.toml roots, npm's query words and readings, with PIN and a Debian cold pass

eval/bench/stratify.py draws the benchmark set from a finished run, seeded, K queries from each tenth by the size of pac's answer, the regression set left out

eval/bench/summary.py gives each geometric mean of pac over the tool a 95% bootstrap interval, 10,000 seeded resamples of the queries, in its tables and in bench.csv