SimpleNormalizer

java.lang.Object

smile.nlp.normalizer.SimpleNormalizer

All Implemented Interfaces:: Function<String,String>, UnaryOperator<String>, Normalizer

public class SimpleNormalizer extends Object implements Normalizer

A baseline normalizer for processing Unicode text.

Apply Unicode normalization form NFKC.
Strip, trim, normalize, and compress whitespace.
Remove control and formatting characters.
Normalize dash, double and single quotes.

Method Summary

Modifier and Type

Method

Description

static SimpleNormalizer

getInstance()

Returns the singleton instance.

String

normalize(String text)

Normalize the given string.

Methods inherited from class Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface Function
andThen, compose

Methods inherited from interface Normalizer
apply

Method Details
- getInstance
  
  public static SimpleNormalizer getInstance()
  
  Returns the singleton instance.
  
  Returns:
  
  the singleton instance.
- normalize
  
  public String normalize(String text)
  
  Description copied from interface: Normalizer
  
  Normalize the given string.
  
  Specified by:
  
  normalize in interface Normalizer
  
  Parameters:
  
  text - the text.
  
  Returns:
  
  the normalized text.