Package org.languagetool.tokenizers.zh

Class ChineseSentenceTokenizer

java.lang.Object

org.languagetool.tokenizers.zh.ChineseSentenceTokenizer

All Implemented Interfaces:

SentenceTokenizer, Tokenizer

public class ChineseSentenceTokenizer
extends Object
implements SentenceTokenizer

Constructor Summary

Constructors

Constructor	Description
ChineseSentenceTokenizer()

Method Summary

Modifier and Type	Method	Description
void	setSingleLineBreaksMarksParagraph(boolean lineBreakParagraphs)	Note: does have no effect for Chinese
boolean	singleLineBreaksMarksPara()	Note: will always return false
List<String>	tokenize(String text)	Tokenize the given string to sentences.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

ChineseSentenceTokenizer

public ChineseSentenceTokenizer()

Method Details

tokenize

public List<String> tokenize(String text)

Description copied from interface: SentenceTokenizer

Tokenize the given string to sentences.

Specified by:

tokenize in interface SentenceTokenizer

Specified by:

tokenize in interface Tokenizer

setSingleLineBreaksMarksParagraph

public void setSingleLineBreaksMarksParagraph(boolean lineBreakParagraphs)

Note: does have no effect for Chinese

Specified by:

setSingleLineBreaksMarksParagraph in interface SentenceTokenizer

Parameters:

lineBreakParagraphs - if true, single line breaks are assumed to end a paragraph, with false, only two ore more consecutive line breaks end a paragraph

singleLineBreaksMarksPara

public boolean singleLineBreaksMarksPara()

Note: will always return false

Specified by:

singleLineBreaksMarksPara in interface SentenceTokenizer