BreakIteratorSentenceSplitter

java.lang.Object

smile.nlp.tokenizer.BreakIteratorSentenceSplitter

All Implemented Interfaces:: Function<String,String[]>, SentenceSplitter

public class BreakIteratorSentenceSplitter extends Object implements SentenceSplitter

A sentence splitter based on the java.text.BreakIterator, which supports multiple natural languages (selected by locale setting).

Note: BreakIterator is not thread-safe. Each thread should create its own BreakIteratorSentenceSplitter instance.

Constructor Summary

Constructors

Constructor

Description

BreakIteratorSentenceSplitter()

Constructor for the default locale.

BreakIteratorSentenceSplitter(Locale locale)

Constructor for the given locale.
Method Summary

Modifier and Type

Method

Description

String[]

split(String text)

Splits the text into sentences.

Methods inherited from class Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface Function
andThen, compose

Methods inherited from interface SentenceSplitter
apply

Constructor Details
- BreakIteratorSentenceSplitter
  
  public BreakIteratorSentenceSplitter()
  
  Constructor for the default locale.
- BreakIteratorSentenceSplitter
  
  public BreakIteratorSentenceSplitter(Locale locale)
  
  Constructor for the given locale.
  
  Parameters:
  
  locale - the locale.
Method Details
- split
  
  public String[] split(String text)
  
  Description copied from interface: SentenceSplitter
  
  Splits the text into sentences.
  
  Specified by:
  
  split in interface SentenceSplitter
  
  Parameters:
  
  text - the text.
  
  Returns:
  
  the sentences.