Distilling the Leviathan: TranslateGemma for local deployment

Published March 4, 2026

The interesting artifact is not TranslateGemma-4B. It is the 1B student that keeps most of the translation score after the teacher has done its work. The 4B model becomes training infrastructure; the smaller model is what ships.

The question is not how large the teacher was. The question is how much of its translation behavior survives compression on the same task.

Teacher and student

In a practical distillation stack, the larger model generates targets, corrections, and edge cases. The smaller model learns the translation slice from that curated data instead of relearning the whole internet. The teacher does the expensive exploration once. The student learns the slice we actually want to deploy.

Local execution changes the operating constraints. Privacy stays closer to the data, repeated calls are cheaper to serve, and latency stops depending on a remote request path.

Why local deployment matters

A local translator matters when it can run where the text already is: browser, desktop, edge box, private workflow. Then privacy risk drops, latency becomes part of the product, and the remote service stops being the default path.

TranslateGemma as the concrete case

Gamma is bounded enough to evaluate. Its translation distillation line trains a 1B Gemma student from a TranslateGemma-4B teacher on one bidirectional EN/ES lane and publishes evaluation bundles for both. The comparison uses the same task and metrics, with the size reduction, remaining external gap, and in-domain gain visible.

• Gamma translation results summary
• Gamma external and in-domain leaderboard
• The current best 1B student in that bundle reaches 33.3780 BLEU / 58.8324 chrF on WMT13 EN/ES 128, versus 34.0474 / 61.0088 for the TranslateGemma-4B teacher.
• On the in-domain clean EN/ES 128 set, another distilled 1B checkpoint reaches 56.2174 BLEU / 72.9556 chrF, above the TranslateGemma-4B baseline at 45.5415 / 70.9157 on that same single bidirectional language set.
• The published browser artifact is Clocksmith/gemma3-1b-rdrr on Hugging Face, with a content-hashed RDRR manifest and shards.

What this artifact actually proves

The evidence supports one claim: on WMT13 EN/ES 128, the 1B student stays close to the 4B teacher on BLEU and chrF; on the in-domain clean EN/ES set, a distilled checkpoint beats the teacher baseline. That makes the larger model useful as a training source even when the shipped model is much smaller.

The teacher still matters. Its job moves upstream: create and sharpen capability before serving time.

Where the claim should stop

The Gamma bundle supports a translation distillation story. It does not prove that laptop-scale models are broadly ready for coding and reasoning. It also does not show a full outcome-based reinforcement learning pipeline.

Distillation plus evaluation is enough here. The bundle shows that a compact local model can preserve much of a larger teacher's utility on a real task. The claim should stop there.

The large model is useful when it produces a smaller specialist that runs near the work. That is the useful shape of the result: use the larger model to make the smaller one better, then ship the smaller one where translation actually happens.