Skip to content

Limitations

Jump to bottom
neverRare edited this page Jan 19, 2026 · 88 revisions

Human translators are better, always.

ilo Token can recognize the following:

  • Latin text
  • UCSUR text

ilo Token can't do the following:

  • Translate English into Toki Pona; Here's why.
  • Translate compounds as a whole such as translating "tomo tawa" into "vehicle"; Here's why.
  • Understand contexts.
  • Translate Tokiponized proper words into un-Tokiponized words such as translating "Manka" into "Minecraft".
  • Infer original names from cartouches with su-style abbreviation.

The following are unrecognized by ilo Token. The pencil emoji ✏️ means it is a limitation due to being work in progress, and it will be lifted soon.

  • ✏️ "X ala X" constructions (#57)
  • ✏️ Preposition within subject or phrase (#88)
  • ✏️ Combined number glyphs (#34)
  • Linku sandbox words a.k.a. proposed words that are not in active use; Here's why; (Some words are not yet implemented, you can help!)
  • Multiple sentences (At most 2 sentences are allowed); Here's why
  • Long text (>500)
  • Uncommon grammatical features or "nasin"; Here's why
  • Uncommon use of punctuation; Here's why
  • Ungrammatical constructions and beginner mistakes
  • Quotation
  • Preverb with modifiers other than "ala"
  • Preposition with modifiers other than "ala"
  • Sentence with both "li" and "o" (If separated by "la", it is recognized)
  • Multiple "pi" (partly recognized, some constructions are recognized, some aren't)
  • "taso" or "kin" as headword
  • "anu" as content word (setup available)
  • nasin sitelen kalama pi linja lili a.k.a. cartouche tally marks (As soon as UCSUR added this, it will be implemented right away)

There are even more pedantic limitations listed in the source code: src/parser/filter.ts. Some of the limitations might be lifted later.

Disclaimer

ilo Token is not authoritative. Translations must not be considered accurate until verified. Errors doesn't mean the Toki Pona text is invalid. The output translations aren't exhaustive: There can be valid interpretation that ilo Token doesn't cover.

While ilo Token can serve as a dictionary, it is not a substitute for high quality dictionaries such as lipu Linku.

Clone this wiki locally