Haku Lab

Tag

LoRA

← all experiments · all tags

2026Ternary · slice adapters · LoRA · ANE

Slice adapters vs LoRA on a ternary model

Retrain one slice of a ternary model's feed-forward channels in place, instead of adding a LoRA side path. Compared on four ternary models, timed on the M1 Neural Engine.

Read →
2026LFM2.5-230M · LoRA · end-of-turn

Fine-tuning a 230M model to know when you've stopped talking

A from-scratch 5M-parameter classifier plateaued at 30% recall on real speech. A LoRA fine-tune of a 230M pretrained model, on the same data, didn't.

Read →
2026Diffusion LoRA · frozen base

Grammar correction with a diffusion LoRA on a frozen model

A small adapter turns a frozen left-to-right model into a one-pass, both-directions corrector.

Read →
2026Qwen3-TTS 0.6B · on-device · audio

An experiment to cut down TTS latency

Making a text-to-speech model decode in one pass instead of sixteen, so it runs fast on-device. With audio you can play.

Read & listen →