Back to papers
October 8, 2026cs.LG
Rounding in Preconditioner Space: Redesigning 4-bit AdamW Optimizer-State Quantization
Hanyang Li, Shao Tang, Daniel Thomas Braithwaite, Gregory Dexter, Leonardo Neves, Aman Gupta, Hiroto Udagawa, Abhishek Shivanna, Daniel Silva, Rohan Ramanath
Categories
cs.LG