Haku Lab

Tag

ANE

← all experiments

2026EmbeddingGemma-300M · ANE · code search

Indexing code by parsing it, not chunking it

Haku's code search reads each language's syntax tree, indexes real symbols, and embeds them on the Neural Engine — running inside the terminal, nothing leaving the Mac.

Read →
20269M ternary encoder · ANE · on-device

A 9M ternary encoder for accessibility-tree elements

One layer of the filter between raw accessibility data and the agent — element routing, on the Neural Engine.

Read →
2026T5-small 60M · ANE + GPU · on-device

An experiment to format dictation in under 100 milliseconds

A 60M-parameter T5, distilled from a larger model, that cleans up raw speech on-device — split across the Neural Engine and the GPU.

Read →
2026Ternary · on-device · field log

A few months of ternary experiments

Where ternary {−1, 0, +1} weights are the right tool for small, on-device models — and where they aren't.

Read →