Haku Lab

Tag

on-device

← all experiments

2026EmbeddingGemma-300M · ANE · code search

Indexing code by parsing it, not chunking it

Haku's code search reads each language's syntax tree, indexes real symbols, and embeds them on the Neural Engine — running inside the terminal, nothing leaving the Mac.

Read →
20269M ternary encoder · ANE · on-device

A 9M ternary encoder for accessibility-tree elements

One layer of the filter between raw accessibility data and the agent — element routing, on the Neural Engine.

Read →
2026Tiny specialist · structured

Resolving natural-language dates with a tiny specialist model

Division of labour — a 14M model maps language to structure; ordinary code does the arithmetic

Read →
2026T5-small 60M · ANE + GPU · on-device

An experiment to format dictation in under 100 milliseconds

A 60M-parameter T5, distilled from a larger model, that cleans up raw speech on-device — split across the Neural Engine and the GPU.

Read →
2026Diffusion LoRA · frozen base

Grammar correction with a diffusion LoRA on a frozen model

A small adapter turns a frozen left-to-right model into a one-pass, both-directions corrector.

Read →
2026Qwen3-TTS 0.6B · on-device · audio

An experiment to cut down TTS latency

Making a text-to-speech model decode in one pass instead of sixteen, so it runs fast on-device. With audio you can play.

Read & listen →
2026MOSS-TTS-Nano · parallel decode

Parallel decoding of audio tokens in a text-to-speech model

Decoding 16 residual codebooks in one pass instead of sixteen. On-device.

Read →
202625M · structured · tool-calls

Structured tool-calls from a 25M model

How small can a model be and still learn a structured capability?

Read →
2026Ternary · on-device · field log

A few months of ternary experiments

Where ternary {−1, 0, +1} weights are the right tool for small, on-device models — and where they aren't.

Read →