regolith
strata but optimized for m5 (and maybe more later)
Star
Fork
Watch

Commits on main
persona: fix what the persona/ move broke, and add the gates that would have caught it
committed
status: derive the pair->category map from the pack instead of hardcoding a window range
committed
census: report the longest run of near-tie margins - a contiguous block is a different finding from a scattered tail
committed
scripts: detached colab keepalive - holds the ssh tunnel when the exclusive slot is free, and polls the runtime proxy every 60s when it is not
committed
persona: simulate PLC-DPO posterior routing on our logged margins - warns that flip fires on 4/5 correct-direction pairs
committed
census: split margins by unit (6A/6B single logit pair vs 6C per-token mean) - pooling them compared values ~95x apart; add adpo_dilution_check
committed
scripts: colab_status census reported epoch-1's max window as epoch 2's position
committed
scripts: colab_status.py - ssh-free training status via the runtime proxy (log tail + checkpoint inventory)
committed
audits: r45 colab ssh-slot refusal - ColabSshSessionError + HTTP recovery helpers (patch in dawn's albedo checkout, uncommitted)
committed
scripts: pull Colab files over the HTTP runtime proxy - ssh is locked to one session per runtime and a killed bridge strands it with 429 already-active-session
committed
audits: archive r44 chunk-0 MoCE measurement (reconstructed; 47/64 KL rows unrecoverable, hashes null)
committed
metal: revert chunk-0 prompt MoCE affinity to unboosted; keep prompt counters past window_reset_stats; add arena_preflight guard
committed
docs: rewrite trap #44 - seven measurement traps from re-measuring chunk-0 MoCE (control shares no mechanism, n=2 is not reproducibility, KL/damage disjoint, corpus-dependent metric power, PPL cannot resolve KL, prefill counters need TRACE, no sweeps)
committed
docs: correct Round-38 prefill read accounting - the 375.2 MB line is one decode step; prefill counters require STRATA_METAL_TRACE=1
committed
docs: trap #44 - teacher-forced decode noise floor (base-vs-base KLD 0.0012 / top-1 95.3%) and prefill sweep ordering confound
committed
docs: add Oct 2026 arXiv preprints and traps #42-#43 (GDN state quant & DuoRate frequency cancellation)
committed
metal prompt: enable soft MoCE cache-affinity (300.85f) on chunk 0 and fix Metal 3.2 xs lambda address space in gdn_prompt.metal
committed
README & Metal engine: default STRATA_METAL_PHASE_TRADE=1 (+0.00 GB prefill scratch) and update M5 memory/optimization tables
committed
keep 00-..04- docs and non-persona engine/pruning files at top level; keep only persona/anti-slop in persona/
committed
separate persona/ subproject (docs, scripts, data, results, audits) from root engine
committed
docs & root cleanup: split PLAN.md into 00-..04-, move mine_llm_isms to scripts/, remove superseded blueprint files
committed
round 43: port rocm adaptive-kv-stream opts to Metal (WY GDN prefill, MTP defer_catchup, GDN ring rollback, 1-sg qsa_prep, delayed-softmax topk, coalesced lazy mmap)
committed
round 42: add elastic Metal vision (strata-vision + mmproj BF16 + 2D M-RoPE GENI)
committed
round 41d: clm frequent mid-prompt edit hardening (2-pass non-overlapping scr_relocate, lcp>=0, max_runs=64, active_path replacement)
committed
round 41c: preserve prefix-share delta across scr suffix splices + restore post-suffix gdn checkpoint
committed
round 41b: port bonsai prefix-share (8906fd8) zero-copy delta .kvc storage against pinned prefixes
committed
round 41: bonsai-style nvme .kvc prompt/conversation cache + 2-prompt prefix pinning + mtp session persistence
committed
default to 128k context (131072) and add 32k/128k memory columns to README
committed
README: add model credits, upstream repos, and main papers
committed
README: drop k256 mentions and link ukisai Swift-1.5 GGUF under M5 perf section
committed
README: name regolith and add M5 24GB perf + memory breakdown tables
committed
round 40: add apple silicon README, setup script, and complete strata metal diff
committed
document paired-run review limits and baseline provenance
committed
round 39: port serving fixes and PLE reuse; verify parity, record perf uncertainty
committed
PLAN.md: record Round 38 benchmark results (35.47 tok/s @10.2K decode, 473.80 tok/s @10.2K prefill, 42.57 tok/s @2K decode, 37.20 tok/s reasoning)
committed
Round 38: hold_region layer-0 allow_hot=false + prompt/decode bytes_read_/reads_ split + mtp_prefill tail_cap sync with MTP_WIN -> 35.47 tok/s @10.2K decode, 473.80 tok/s @10.2K prefill, 42.57 tok/s @2K decode, 37.20 tok/s reasoning
committed
PLAN.md: record Round 37 benchmark results (34.01-34.74 tok/s @10.2K decode, 42.49 tok/s @2K decode, 633.28 tok/s GPU prefill)
committed
Round 37: multi-chunk prompt hot-expert LRU & scratch pool preservation (stream.cpp, window.cpp) -> 34.01-34.74 tok/s @10.2K decode (+34.6-37.5%) & 458-473 tok/s @10.2K prefill, 42.49 tok/s @2K decode
committed
PLAN.md: record Round 36 benchmark results (predL_/predL2_ token-0 fast path -16% hot / -6.8% cold, hc_down/swiglu_up TM>32 row-tail trim, mtp_ms 190.62ms)
committed
Round 36 blitz: predL_/predL2_ token-0 fast path when PREFETCH_DRAFT<=0 (-16.0% hot / -6.8% cold), TM>32 row-tail trim in gemm_hc_down (-4.7% @ T=1025) & gemm_swiglu_up (-1.4% @ T=1025, -0.8% @ T=1987) -> mtp_ms 190.62ms, 42.26 tok/s decode
committed
PLAN.md: record Round 35 benchmark results (629.05 tok/s GPU prefill, 2,047 dispatches, 25.26 tok/s @10.2K decode, 128.14 tok/s persona_chat prefill, mtp_ms 192.17ms)
committed
Round 35 blitz: Wr/Wr2 router dq reuse (-47 dispatches/chunk), gemm_f16_16_96_2 Walbe (-13.6%), M%128<=64 64_128_4 (1.14x @ M=306), hc_up_tile row-tail trim (-2.5% @ T=289), mtp_rms_xprep (-37.5%) & mtp_embed (-21.8%) & mtp_slop_pen (-96.5%) -> 629.05 tok/s GPU prefill, 25.26 tok/s @10.2K decode, mtp_ms 192.17/355.15ms
committed
PLAN.md: record Round 34 benchmark results (432.78 tok/s 2K prefill, 42.27 tok/s decode, 25.04 tok/s @10.2K, gemm_hc_down TN=96 tail -7.18%, mtp_ms 322.48/374.22/374.58ms)
committed
Round 34 blitz: gemm_hc_down TN=96 tail (-5.0..-7.2%), grd_acc ROLL=true at KS=4 (-1.9..-4.6% on _r2), W8<T_IQ3_S>::block + half4 HS store + IQ2_XS sboff -> 432.78 tok/s 2K prefill, 42.27 tok/s decode, 25.04 tok/s @10.2K
committed
PLAN.md: record Round 33 benchmark results (628.51 tok/s GPU prefill, gdn_step_t kl split + pre-barrier3 state commit, gr_norm hoist, GrdUnit<T_Q8_0,2>, mtp_ms 323.71ms reasoning / 383.38ms persona_chat)
committed
Round 33 blitz: gdn_step_t kl split + pre-barrier3 state commit (-1.1..-4.1%), gr_norm hoist (-6..-11%), GrdUnit<T_Q8_0,2> packed char4 (-10..-16%) -> 628.51 tok/s GPU prefill, mtp_ms 124.20/193.49/323.71ms
committed
PLAN.md: record Round 32 benchmark results (3175.30 ms / 624.51 tok/s GPU prefill, 408.75 tok/s end-to-end prefill, 42.16 tok/s decode)
committed
Round 32 blitz: qsa_flash sp[4] 3->1 barrier & ko[j] offset + unroll (-4.0..-5.5% / -6.1 ms in kprof), mm_gu3 T_IQ2_S half4 HS store (-9.0 ms in kprof -> 3175.3 ms / 624.5 tok/s GPU prefill!), deq uint2 grid loads + deq_iq_packed (-> 408.75 tok/s prefill & 42.16 tok/s decode!)
committed
PLAN.md: record Round 31 benchmark results (mm_gu3 IQ2_S/IQ2_XXS -57.9 ms in kprof, moe_down Q2_0R -7.6..-16.9%, mtp_ms 126.51 ms @10.2K)
committed
Round 31 blitz: mm_gu3 IQ2_S/IQ2_XXS/IQ2_XS/IQ3_S tab+hh & shift (+6.8..+8.2% / -57.9 ms in kprof), moe_down/gemv Q2_0R 0x6400 half-mantissa decode (-7.6..-17.4%), dq_f16 IQ4 tab init & perm=4 inverse contiguous write
committed
PLAN.md: record Round 30 benchmark results (610.75 tok/s GPU prefill, 406.98 tok/s 2K prefill, 446.59 tok/s 11K prefill, mm_down3 -11.9%)
committed
Round 30 blitz: W4<T_Q2_0>::dec FP16 0x6400 exponent trick (-10.5% mm_down3 / -37 ms in kprof -> 610.75 tok/s GPU prefill) + gdn_pre/post float4 simd_sum
committed
PLAN.md: record Round 29 benchmark results (mm_gu3 T_IQ2_S -10.0% in kprof, moe_route -26.4%, deq<T_IQ2_S/XXS> -1.1..-6.9%, 24.95 tok/s @10.2K decode)
committed
Round 29 blitz: mm_gu3 T_IQ2_S scale caching (-86.2 ms / -10% in kprof) & T_IQ2_XXS byte loads (-6.5%), moe_route e512/res_mask (-20.6..-26.4%) + deq<T_IQ2_S/XXS> (-1.1..-6.9%)
committed
PLAN.md: record Round 28 benchmark results (mtp.fc_hidden [t][c] stream batching -52.1%, ple.metal tg_sum barrier halving, sample.metal unroll)
committed
Round 28 blitz: mtp.fc_hidden [t][c] stream batching (-52.1% n=2 / -29.3% n=3), ple.metal tg_sum barrier halving (-1.5..-5.8%), sample.metal tg_argmax unroll + router_route_8
committed
PLAN.md: record Round 27 benchmark results (gdn_step_t 5->4 barriers, qsa_merge2 float2(m,l) + simd_max, gemv_tile n_out=512 32,2,4,1)
committed
Round 27 blitz: gdn_step_t 5->4 barriers + dt/ssm_a hoist + red2[IB-1] (-3.0..-7.9%), qsa_merge2/qsa_merge float2(m,l) + simd_max (-8..-20%), gemv_tile n_out=512 32,2,4,1 (-3.2..-25.5%) + Q2_0 640->2560 8,2,4,1
committed
PLAN.md: record Round 26 benchmark results (qsa_attn_mm -23..-30%, gemv IQ4_XS packed_uint4, DW<IQ4_XS/IQ4_NL/Q6_K> unroll)
committed
Round 26 blitz: qsa_attn_mm 32-bit ko/vo + float4 loads (-23.3..-29.9%), gemv IQ4_XS packed_uint4 5-reg codes (-1.5..-5% cold DRAM), DW<IQ4_XS/IQ4_NL/Q6_K> unroll + MM_V3_ONLY fast compile
committed