Multiverse reports accuracy recovery for a smaller, 4-bit GPT-OSS model

In an August-dated paper, Multiverse Computing reports that a GPT-OSS model reduced from 120 billion to 60 billion parameters, then quantized to the 4-bit MXFP4 format, matched or beat its recovered 16-bit checkpoint on seven of nine benchmarks. The company estimates that the model needs roughly one-quarter as much memory for its weights as that checkpoint.

The comparison matters: the 16-bit reference is an intermediate version of the smaller model, not the original 120B model. Multiverse separately reports reaching the original model’s performance on LiveCodeBench, a coding benchmark. That narrower result should not be confused with the seven-of-nine claim.

The paper’s recipe, Quantization-Aware Healing, changes how the compressed model recovers lost capability. Multiverse first reduces the model’s parameter count and restores some capability through training before applying 4-bit quantization. For the subsequent recovery stage, QAH trains the smaller model to reproduce the original model’s output distribution, rather than imitate the already-compressed checkpoint or learn from hard target labels.

Here, “original” does not mean “higher precision.” The authors say the original GPT-OSS teacher already has weights largely stored in MXFP4. Their argument is about learning from an uncompressed model, not simply consulting one with more bits per weight. They describe QAH as a practical combination of established techniques—distillation and quantization-aware training—rather than a new algorithmic primitive.

There is also a distinction for anyone downloading Hypernova-60B, the open-weight model produced using this recipe. Multiverse says that release received additional training beyond the pipeline evaluated in the paper. The reported benchmark results are therefore the company’s measurements of the experimental pipeline, not the published scores of the downloadable checkpoint.