Why AI works worse in your language
July 25, 2026 · Artifipedia · Language, Multilingual, Equity Why AI works worse in your language The gap between English and everything else is not about linguistic difficulty. It is about training data share, tokenizer fitting, and where instruction-tuning stopped, and only one of those three is expensive to fix. ShareXLinkedInCopy link A model that was trained overwhelmingly on English can answer in Japanese, translate into Swahili and write code comments in Portuguese without anyone teaching it those languages as separate tasks.
- ▪July 25, 2026 · Artifipedia · Language, Multilingual, Equity Why AI works worse in your language The gap between English and everything else is not about linguistic difficulty.
- ▪It is about training data share, tokenizer fitting, and where instruction-tuning stopped, and only one of those three is expensive to fix.
- ▪ShareXLinkedInCopy link A model that was trained overwhelmingly on English can answer in Japanese, translate into Swahili and write code comments in Portuguese without anyone teaching it those languages as separate tasks.
Opening excerpt (first ~120 words) tap to expand
July 25, 2026 · Artifipedia · Language, Multilingual, Equity Why AI works worse in your language The gap between English and everything else is not about linguistic difficulty. It is about training data share, tokenizer fitting, and where instruction-tuning stopped, and only one of those three is expensive to fix. ShareXLinkedInCopy link A model that was trained overwhelmingly on English can answer in Japanese, translate into Swahili and write code comments in Portuguese without anyone teaching it those languages as separate tasks. That is surprising, and it is real.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at Hacker News - Newest: ""AI" "LLM"".
Discussion
0 commentsMore from Hacker News - Newest: ""AI" "LLM""
