Haku Lab

Tag

inference

← all experiments

2026Ternary 27B · 7.17 GB · 40 tok/s on A10

Running a ternary 27B on a single A10

A 27B model whose weights are all −1, 0 or +1 — what it takes to run, and how fast it goes.

Read →
2026Diffusion draft · AR verifier

Diffusion-draft speculative decoding: an eight-prompt probe

A diffusion model drafts, an autoregressive model verifies. Acceptance measured on eight prompts.

Read →