"AI translation" gets used as one phrase, but the technology behind it has gone through three genuinely different approaches, each with its own failure pattern. Knowing which one you're using explains a lot about why it sometimes gets things wrong.
Three generations of machine translation
Rule-based translation
Early systems used hand-written grammar rules and bilingual dictionaries. A word or phrase was looked up and swapped according to fixed rules. Output was often stiff and broke on anything outside the rule set.
Statistical machine translation
Systems like early Google Translate compared huge amounts of bilingual text and learned which phrases tended to align between languages. Better than rule-based systems, but translations were built phrase by phrase, so longer sentences often read as disjointed.
Neural machine translation
Modern systems use neural networks trained on massive bilingual datasets, processing entire sentences (and sometimes paragraphs) as a single unit rather than chopping them into phrases. This is why translations today read more fluidly and handle longer sentences far better than the statistical era.
What "context window" means for translation accuracy
Modern engines translate based on a context window, the amount of surrounding text the model considers at once. A short context window means each sentence gets translated mostly in isolation, missing information from earlier in the paragraph that would resolve ambiguity (like who "he" refers to, or whether a dropped Japanese subject is "I" or "you").
This is why pasting a single isolated sentence into a translator often gives worse results than pasting the full paragraph it came from. More surrounding context generally means a better-informed guess at meaning.
Why translation quality varies by language pair
Engines are trained on whatever bilingual text is available at scale. Language pairs with huge volumes of parallel text, like English-Spanish or English-French, tend to translate more accurately than lower-resource pairs simply because there's more training data to learn from.
Japanese-English sits in an interesting middle position: there's a large volume of training data, but the languages are structurally very different (different word order, no grammatical plural marking, frequent subject omission), so even well-trained systems make characteristic mistakes that wouldn't show up in, say, English-German translation.
Why the same sentence can translate differently each time
Neural models generate text by predicting the most probable next word given everything before it, and many of these systems introduce a small amount of randomness in how that prediction is sampled. That's why running the exact same sentence through a translator twice can occasionally produce slightly different phrasing, even though the underlying meaning stays the same.
What's actually improving year over year
- Longer context handling: modern systems track meaning across more text before translating each part.
- Better handling of low-resource phrasing: idioms and informal speech translate more naturally than five years ago.
- Tone awareness: some systems are starting to better preserve formality level, though this remains one of the weaker areas for Japanese specifically.
See modern translation in action with your own text.
Open the Translator