GermanWordTokenizer

java.lang.Object

org.languagetool.tokenizers.WordTokenizer

org.languagetool.tokenizers.de.GermanWordTokenizer

All Implemented Interfaces:: Tokenizer

public class GermanWordTokenizer extends WordTokenizer

Field Summary

Fields

Modifier and Type

Field

Description

private final String

deTokenizingChars

Fields inherited from class org.languagetool.tokenizers.WordTokenizer
REMOVED_EMOJI
Constructor Summary

Constructors

Constructor

Description

GermanWordTokenizer()
Method Summary

Modifier and Type

Method

Description

String

getTokenizingCharacters()

Methods inherited from class org.languagetool.tokenizers.WordTokenizer
getProtocols, isCurrencyExpression, isEMail, isUrl, joinEMails, joinEMailsAndUrls, joinUrls, replaceEmojis, restoreEmojis, splitCurrencyExpression, tokenize

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details
- deTokenizingChars
  
  private final String deTokenizingChars
Constructor Details
- GermanWordTokenizer
  
  public GermanWordTokenizer()
Method Details
- getTokenizingCharacters
  
  public String getTokenizingCharacters()
  
  Overrides:
  
  getTokenizingCharacters in class WordTokenizer
  
  Returns:
  
  The string containing the characters used by the tokenizer to tokenize words.