GermanCompoundTokenizer

java.lang.Object

org.languagetool.tokenizers.de.GermanCompoundTokenizer

All Implemented Interfaces:: Tokenizer

public class GermanCompoundTokenizer extends Object implements Tokenizer

Split German nouns using the jWordSplitter library.

Nested Class Summary

Nested Classes

Modifier and Type

Class

Description

(package private) static class

GermanCompoundTokenizer.ExtendedGermanWordSplitter
Field Summary

Fields

Modifier and Type

Field

Description

private static final Supplier<GermanCompoundTokenizer>

nonStrictInstance

private static final Supplier<GermanCompoundTokenizer>

strictInstance

private final GermanCompoundTokenizer.ExtendedGermanWordSplitter

wordSplitter
Constructor Summary

Constructors

Constructor

Description

GermanCompoundTokenizer()

GermanCompoundTokenizer(boolean strictMode)
Method Summary

Modifier and Type

Method

Description

static GermanCompoundTokenizer

getNonStrictInstance()

static GermanCompoundTokenizer

getStrictInstance()

static void

main(String[] args)

List<String>

tokenize(String word)

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details
- strictInstance
  
  private static final Supplier<GermanCompoundTokenizer> strictInstance
- nonStrictInstance
  
  private static final Supplier<GermanCompoundTokenizer> nonStrictInstance
- wordSplitter
  
  private final GermanCompoundTokenizer.ExtendedGermanWordSplitter wordSplitter
Constructor Details
- GermanCompoundTokenizer
  
  public GermanCompoundTokenizer() throws IOException
  
  Throws:
  
  IOException
- GermanCompoundTokenizer
  
  public GermanCompoundTokenizer(boolean strictMode) throws IOException
  
  Throws:
  
  IOException
Method Details
- tokenize
  
  public List<String> tokenize(String word)
  
  Specified by:
  
  tokenize in interface Tokenizer
- getStrictInstance
  
  public static GermanCompoundTokenizer getStrictInstance()
- getNonStrictInstance
  
  public static GermanCompoundTokenizer getNonStrictInstance()
- main
  
  public static void main(String[] args) throws IOException
  
  Throws:
  
  IOException