Haku Lab

Tag

on-device

← all experiments

2026Ternary 27B · agent battery · 21 traps

Does the 27B Bonsai actually deliver 27B?

Prism shipped a 27B that fits a laptop. We put it through a battery of agentic traps to see if it reasons like its size.

Read →
2026Ternary 27B · 7.17 GB · 40 tok/s on A10

Running a ternary 27B on a single A10

A 27B model whose weights are all −1, 0 or +1 — what it takes to run, and how fast it goes.

Read →
2026LFM2.5-230M · LoRA · end-of-turn

Fine-tuning a 230M model to know when you've stopped talking

A from-scratch 5M-parameter classifier plateaued at 30% recall on real speech. A LoRA fine-tune of a 230M pretrained model, on the same data, didn't.

Read →
2026EmbeddingGemma-300M · ANE · code search

Indexing code by parsing it, not chunking it

Haku's code search reads each language's syntax tree, indexes real symbols, and embeds them on the Neural Engine — running inside the terminal, nothing leaving the Mac.

Read →
2026Tiny specialist · structured

Resolving natural-language dates with a tiny specialist model

Division of labour — a 14M model maps language to structure; ordinary code does the arithmetic

Read →
20269M ternary encoder · ANE · on-device

A 9M ternary encoder for accessibility-tree elements

One layer of the filter between raw accessibility data and the agent — element routing, on the Neural Engine.

Read →
2026T5-small 60M · ANE + GPU · on-device

An experiment to format dictation in under 100 milliseconds

A 60M-parameter T5, distilled from a larger model, that cleans up raw speech on-device — split across the Neural Engine and the GPU.

Read →
2026Diffusion LoRA · frozen base

Grammar correction with a diffusion LoRA on a frozen model

A small adapter turns a frozen left-to-right model into a one-pass, both-directions corrector.

Read →
2026Qwen3-TTS 0.6B · on-device · audio

An experiment to cut down TTS latency

Making a text-to-speech model decode in one pass instead of sixteen, so it runs fast on-device. With audio you can play.

Read & listen →
2026MOSS-TTS-Nano · parallel decode

Parallel decoding of audio tokens in a text-to-speech model

Decoding 16 residual codebooks in one pass instead of sixteen. On-device.

Read →
202625M · structured · tool-calls

Structured tool-calls from a 25M model

How small can a model be and still learn a structured capability?

Read →
2026Ternary · on-device · field log

A few months of ternary experiments

Where ternary {−1, 0, +1} weights are the right tool for small, on-device models — and where they aren't.

Read →