JapaneseWordTokenizer

java.lang.Object

org.languagetool.tokenizers.ja.JapaneseWordTokenizer

All Implemented Interfaces:: Tokenizer

public class JapaneseWordTokenizer extends Object implements Tokenizer

Field Summary

Fields

Modifier and Type

Field

Description

private final net.java.sen.StringTagger

stringTagger
Constructor Summary

Constructors

Constructor

Description

JapaneseWordTokenizer()
Method Summary

Modifier and Type

Method

Description

List<String>

tokenize(String text)

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details
- stringTagger
  
  private final net.java.sen.StringTagger stringTagger
Constructor Details
- JapaneseWordTokenizer
  
  public JapaneseWordTokenizer()
Method Details
- tokenize
  
  public List<String> tokenize(String text)
  
  Specified by:
  
  tokenize in interface Tokenizer