Public manuscripts and preprints. Each entry links to the paper, released code, datasets or artifact bundles, and the project page with the problem framing and supporting artifacts.
manuscripts and preprints
2026
-
arXivSolver-Hard Is Not Model-Hard: A Hardness-Controlled Diagnostic for LLM Constraint ReasoningarXiv preprint arXiv:2607.17047, 2026
abstract
This scoped diagnostic tests whether solver hardness predicts LLM SAT/UNSAT verdict accuracy after near-matching clause density. Glucose shows a strong expander-over-ladder cost separation, and five additional CDCL solvers preserve the large-bin direction, but the three included LLMs do not transfer that ordering consistently; the endpoint is verdict accuracy, not certificate solving.
-
arXivWhen Top-1 Fails: Calibrating LoRA Monitors for Masked Diffusion LMsarXiv preprint arXiv:2606.24119, 2026
abstract
This paper audits a transferred top-1-frequency collapse warning for LoRA fine-tuning of masked diffusion language models. In the reported cohorts, the top-1 warning fires broadly while observed collapse is zero at the audited horizons, motivating family-local monitoring with max LoRA gradient norm instead.
-
arXivWeight Decay Regimes in Grokking Transformers: Cheap Online DiagnosticsarXiv preprint arXiv:2605.20441, 2026
abstract
This solo-author preprint studies cheap online diagnostics for grokking phase regimes in transformers. The public artifact includes a Python package, aggregate JSONs, provenance manifests, figure artifacts, Lean 4 checks, and a Hugging Face dataset.
-
arXivWhen Does Removing LayerNorm Help? Activation Bounding as a Regime-Dependent Implicit RegularizerarXiv preprint arXiv:2604.23434, 2026
abstract
This empirical study examines when replacing LayerNorm with activation bounding helps or hurts transformer training. The released artifact bundle includes configs, result manifests, validation scripts, aggregate JSONs, and a public Hugging Face artifact dataset.