Pocket

Shrink Tiny Aya to run on a phone and it keeps refusing harmful requests in English, but not in Swahili, Yorùbá, Hausa or Igbo.

We ran Tiny Aya Global and Earth as GGUF files from 16-bit down to 2-bit on 120 harmful prompts (MultiJail) and 120 harmless look-alikes (XSTest) per language. The official 4-bit file holds up. At 3-bit, Swahili and Hausa comply more while the model still reads fine. At 2-bit, refusals almost vanish outside English. This page shows every number and every answer.

Content warning: prompts and answers include violence, weapons, sexual exploitation, self-harm and hate.
Loading results…

worse than 16-bit, 95% interval clear of zero   better than 16-bit, interval clear of zero. Changes are paired: same prompts, same language.