Haku Lab

Tag

GPU

← all experiments

2026Ternary 27B · 7.17 GB · 40 tok/s on A10

Running a ternary 27B on a single A10

A 27B model whose weights are all −1, 0 or +1 — what it takes to run, and how fast it goes.

Read →
2026T5-small 60M · ANE + GPU · on-device

An experiment to format dictation in under 100 milliseconds

A 60M-parameter T5, distilled from a larger model, that cleans up raw speech on-device — split across the Neural Engine and the GPU.

Read →