Package org.languagetool.tagging.disambiguation.uk

Class UkrainianHybridDisambiguator

java.lang.Object

org.languagetool.tagging.disambiguation.AbstractDisambiguator

org.languagetool.tagging.disambiguation.uk.UkrainianHybridDisambiguator

All Implemented Interfaces:

Disambiguator

public class UkrainianHybridDisambiguator
extends AbstractDisambiguator

Hybrid chunker-disambiguator for Ukrainian.

Field Summary

Fields

Modifier and Type	Field	Description
private final Disambiguator	chunker
private static final Pattern	DIGITS_PATTERN
private final Disambiguator	disambiguator
private static final Pattern	IGNORE_IN_PRON_POS
private static final Pattern	INANIM_VKLY
private static final Pattern	INITIAL_REGEX
private static final String	LAST_NAME_TAG
private static final Pattern	LATIN_DIGITS_PATTERN
private static final List<String>	LIKELY_V_KLY
private static final Pattern	PATTERN_1
private static final Pattern	PATTERN_2
private static final Pattern	PATTERN_3
private static final Pattern	PATTERN_4
private static final Pattern	PATTERN_5
private static final Pattern	PLURAL_LNAME_PATTERN
private static final Pattern	PLURAL_NAME
private static final Pattern	PUNCT_AFTER_KLY_PATTERN
private final SimpleDisambiguator	simpleDisambiguator
private static final String	ST_ABBR
private static final Pattern	STATION_NAME_PATTERN
(package private) static final Set<String>	V_MIS_PREPS
(package private) static final Set<String>	V_NON_MIS_PREPS

Constructor Summary

Constructors

Constructor	Description
UkrainianHybridDisambiguator()

Method Summary

Modifier and Type	Method	Description
private boolean	canRemoveVmis(List<AnalyzedToken> analyzedTokens)
private static void	checkForInitialRetag(AnalyzedTokenReadings lastName, List<Integer> initialsIdxs, AnalyzedTokenReadings[] tokens)
final AnalyzedSentence	disambiguate(AnalyzedSentence input)	Calls two disambiguator classes: (1) a chunker; (2) a rule-based disambiguator.
private void	disambiguatePronPos(AnalyzedSentence input)
private void	disambiguateSt(AnalyzedSentence input)
private static AnalyzedTokenReadings	getInitialReadings(AnalyzedTokenReadings initialsReadings, AnalyzedTokenReadings lnameTokens, String initialType)
private static boolean	isInitial(AnalyzedTokenReadings[] tokens, int pos)
private boolean	likelyVklyContext(AnalyzedTokenReadings[] tokens, int i)
AnalyzedSentence	preDisambiguate(AnalyzedSentence input)	If possible, filters out the wrong POS tags.
private void	removeInanimVKly(AnalyzedSentence input)
private void	removeLowerCaseBadForUpperCaseGood(AnalyzedSentence input)
private void	removeLowerCaseHomonymsForAbbreviations(AnalyzedSentence input)
private void	removePluralForNames(AnalyzedSentence input)
private static void	removeTokensWithout(AnalyzedTokenReadings readings, Pattern pattern)
private void	removeVerbImpr(AnalyzedSentence input)
private void	removeVmis(AnalyzedSentence input)
private void	retagFemNames(AnalyzedSentence input)
private void	retagInitials(AnalyzedSentence input)
private void	retagPulralProp(AnalyzedSentence input)
private void	retagUnknownInitials(AnalyzedSentence input)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.languagetool.tagging.disambiguation.Disambiguator

disambiguate

Field Details

LAST_NAME_TAG

private static final String LAST_NAME_TAG

See Also:

• Constant Field Values

INITIAL_REGEX

private static final Pattern INITIAL_REGEX

INANIM_VKLY

private static final Pattern INANIM_VKLY

PLURAL_NAME

private static final Pattern PLURAL_NAME

PLURAL_LNAME_PATTERN

private static final Pattern PLURAL_LNAME_PATTERN

ST_ABBR

private static final String ST_ABBR

See Also:

• Constant Field Values

LATIN_DIGITS_PATTERN

private static final Pattern LATIN_DIGITS_PATTERN

DIGITS_PATTERN

private static final Pattern DIGITS_PATTERN

STATION_NAME_PATTERN

private static final Pattern STATION_NAME_PATTERN

PATTERN_1

private static final Pattern PATTERN_1

PATTERN_2

private static final Pattern PATTERN_2

PATTERN_3

private static final Pattern PATTERN_3

PATTERN_4

private static final Pattern PATTERN_4

PATTERN_5

private static final Pattern PATTERN_5

chunker

private final Disambiguator chunker

disambiguator

private final Disambiguator disambiguator

simpleDisambiguator

private final SimpleDisambiguator simpleDisambiguator

V_MIS_PREPS

static final Set<String> V_MIS_PREPS

V_NON_MIS_PREPS

static final Set<String> V_NON_MIS_PREPS

IGNORE_IN_PRON_POS

private static final Pattern IGNORE_IN_PRON_POS

PUNCT_AFTER_KLY_PATTERN

private static final Pattern PUNCT_AFTER_KLY_PATTERN

LIKELY_V_KLY

private static final List<String> LIKELY_V_KLY

Constructor Details

UkrainianHybridDisambiguator

public UkrainianHybridDisambiguator()

Method Details

disambiguate

public final AnalyzedSentence disambiguate(AnalyzedSentence input)
                                    throws IOException

Calls two disambiguator classes: (1) a chunker; (2) a rule-based disambiguator.

Parameters:

input - The sentence with already tagged words. The words are expected to have multiple tags.

Returns:

Analyzed sentence, where each word has only one (possibly the most correct) tag.

Throws:

IOException

preDisambiguate

public AnalyzedSentence preDisambiguate(AnalyzedSentence input)

Description copied from interface: Disambiguator

If possible, filters out the wrong POS tags. This code will run before disambiguation rules from xml are called. This allows to have some initial disambiguation logic in Java.

Specified by:

preDisambiguate in interface Disambiguator

Overrides:

preDisambiguate in class AbstractDisambiguator

Parameters:

input - The sentence with already tagged words. The words are expected to have multiple tags.

Returns:

Analyzed sentence, where each word has only one (possibly the most correct) tag.

removeVerbImpr

private void removeVerbImpr(AnalyzedSentence input)

retagFemNames

private void retagFemNames(AnalyzedSentence input)

removeVmis

private void removeVmis(AnalyzedSentence input)

canRemoveVmis

private boolean canRemoveVmis(List<AnalyzedToken> analyzedTokens)

disambiguatePronPos

private void disambiguatePronPos(AnalyzedSentence input)

removeLowerCaseBadForUpperCaseGood

private void removeLowerCaseBadForUpperCaseGood(AnalyzedSentence input)

removeLowerCaseHomonymsForAbbreviations

private void removeLowerCaseHomonymsForAbbreviations(AnalyzedSentence input)

removeInanimVKly

private void removeInanimVKly(AnalyzedSentence input)

likelyVklyContext

private boolean likelyVklyContext(AnalyzedTokenReadings[] tokens,
 int i)

removePluralForNames

private void removePluralForNames(AnalyzedSentence input)

retagInitials

private void retagInitials(AnalyzedSentence input)

retagUnknownInitials

private void retagUnknownInitials(AnalyzedSentence input)

checkForInitialRetag

private static void checkForInitialRetag(AnalyzedTokenReadings lastName,
 List<Integer> initialsIdxs,
 AnalyzedTokenReadings[] tokens)

disambiguateSt

private void disambiguateSt(AnalyzedSentence input)

retagPulralProp

private void retagPulralProp(AnalyzedSentence input)

removeTokensWithout

private static void removeTokensWithout(AnalyzedTokenReadings readings,
 Pattern pattern)

getInitialReadings

private static AnalyzedTokenReadings getInitialReadings(AnalyzedTokenReadings initialsReadings,
 AnalyzedTokenReadings lnameTokens,
 String initialType)

isInitial

private static boolean isInitial(AnalyzedTokenReadings[] tokens,
 int pos)