Package org.languagetool

Class LanguageAnnotator

java.lang.Object

org.languagetool.LanguageAnnotator

public class LanguageAnnotator
extends Object

Detect language per token and add that to the analysis.

Since:

4.9

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
(package private) static class	LanguageAnnotator.TokenRangeWithLanguage
(package private) static class	LanguageAnnotator.TokenWithLanguages

Field Summary

Fields

Modifier and Type	Field	Description
private static final int	MIN_TOKENS

Constructor Summary

Constructors

Constructor	Description
LanguageAnnotator()

Method Summary

Modifier and Type	Method	Description
List<FragmentWithLanguage>	detectLanguages(String input, Language mainLang, List<Language> secondLangs)
(package private) List<List<LanguageAnnotator.TokenWithLanguages>>	getTokenRanges(List<LanguageAnnotator.TokenWithLanguages> tokens)
(package private) List<LanguageAnnotator.TokenRangeWithLanguage>	getTokenRangesWithLang(List<List<LanguageAnnotator.TokenWithLanguages>> tokenRanges, Language mainLang, List<Language> secondLangs)
(package private) List<LanguageAnnotator.TokenWithLanguages>	getTokensWithPotentialLanguages(String input, Language mainLang, List<Language> secondLangs)
private Language	getTopLang(Language mainLang, List<Language> secondLangs, List<LanguageAnnotator.TokenWithLanguages> tokens)
private boolean	isBoundary(LanguageAnnotator.TokenWithLanguages token)
private boolean	isQuote(String token)
private static boolean	isWord(String s)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

MIN_TOKENS

private static final int MIN_TOKENS

See Also:

• Constant Field Values

Constructor Details

LanguageAnnotator

public LanguageAnnotator()

Method Details

detectLanguages

public List<FragmentWithLanguage> detectLanguages(String input,
 Language mainLang,
 List<Language> secondLangs)

getTokensWithPotentialLanguages

List<LanguageAnnotator.TokenWithLanguages> getTokensWithPotentialLanguages(String input,
 Language mainLang,
 List<Language> secondLangs)

getTokenRanges

List<List<LanguageAnnotator.TokenWithLanguages>> getTokenRanges(List<LanguageAnnotator.TokenWithLanguages> tokens)

getTokenRangesWithLang

List<LanguageAnnotator.TokenRangeWithLanguage> getTokenRangesWithLang(List<List<LanguageAnnotator.TokenWithLanguages>> tokenRanges,
 Language mainLang,
 List<Language> secondLangs)

getTopLang

private Language getTopLang(Language mainLang,
 List<Language> secondLangs,
 List<LanguageAnnotator.TokenWithLanguages> tokens)

isBoundary

private boolean isBoundary(LanguageAnnotator.TokenWithLanguages token)

isQuote

private boolean isQuote(String token)

isWord

private static boolean isWord(String s)