Package org.languagetool.language.tokenizers

Class TagalogWordTokenizer

java.lang.Object

org.languagetool.tokenizers.WordTokenizer

org.languagetool.language.tokenizers.TagalogWordTokenizer

All Implemented Interfaces:

Tokenizer

public class TagalogWordTokenizer
extends WordTokenizer

Since:

2.8

Field Summary

Fields inherited from class org.languagetool.tokenizers.WordTokenizer

REMOVED_EMOJI

Constructor Summary

Constructors

Constructor	Description
TagalogWordTokenizer()

Method Summary

Modifier and Type	Method	Description
String	getTokenizingCharacters()

Methods inherited from class org.languagetool.tokenizers.WordTokenizer

getProtocols, isCurrencyExpression, isEMail, isUrl, joinEMails, joinEMailsAndUrls, joinUrls, replaceEmojis, restoreEmojis, splitCurrencyExpression, tokenize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

TagalogWordTokenizer

public TagalogWordTokenizer()

Method Details

getTokenizingCharacters

public String getTokenizingCharacters()

Overrides:

getTokenizingCharacters in class WordTokenizer

Returns:

The string containing the characters used by the tokenizer to tokenize words.