smile-kotlin/smile.nlp/normalize

normalize

fun String.normalize(): String(source)

Normalizes Unicode text.

  • Apply Unicode normalization form NFKC.
  • Strip, trim, normalize, and compress whitespace.
  • Remove control and formatting characters.
  • Normalize double and single quotes.