Package org.languagetool.synthesis

Class ManualSynthesizer

java.lang.Object

org.languagetool.synthesis.ManualSynthesizer

public final class ManualSynthesizer
extends Object

A synthesizer that reads the inflected form and POS information from a plain (UTF-8) text file. This makes it possible for the user to edit the text file to let the system know about new words or missing readings in the synthesizer *.dict file.

File Format: fullform baseform postags (tab separated)

See Also:

• ManualTagger
• BaseSynthesizer

Field Summary

Fields

Modifier and Type	Field	Description
private final String[]	data
private static final String	DEFAULT_SEPARATOR
private static final int	ENTRY_SIZE
private final it.unimi.dsi.fastutil.ints.Int2IntMap	map	A map from lemma+POS hashes to encoded lemma+POS+word tuple offsets in data
private static final int	MAX_LENGTH
private static final int	MAX_OFFSET
private static final int	OFFSET_SHIFT
private final Set<String>	possibleTags
private static final String	SUFFIX_MARKER

Constructor Summary

Constructors

Constructor	Description
ManualSynthesizer(InputStream inputStream)

Method Summary

Modifier and Type	Method	Description
private static it.unimi.dsi.fastutil.objects.ObjectOpenHashSet<String>	collectTags(Map<TaggedWord,List<String>> mapping)
private static String	decodeForm(String lemma, String word)
private static String	encodeForm(String lemma, String word)
Set<String>	getPossibleTags()	Retrieve all the possible POS values.
private static it.unimi.dsi.fastutil.ints.Int2ObjectOpenHashMap<List<org.apache.commons.lang3.tuple.Triple<String,String,String>>>	groupByHash(Map<TaggedWord,List<String>> mapping)
private static int	hashCode(String lemma, String posTag)
private static Map<TaggedWord,List<String>>	loadMapping(InputStream inputStream)
List<String>	lookup(String lemma, String posTag)	Look up a word's inflected form as specified by the lemma and POS tag.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

SUFFIX_MARKER

private static final String SUFFIX_MARKER

See Also:

• Constant Field Values

possibleTags

private final Set<String> possibleTags

OFFSET_SHIFT

private static final int OFFSET_SHIFT

See Also:

• Constant Field Values

MAX_LENGTH

private static final int MAX_LENGTH

See Also:

• Constant Field Values

MAX_OFFSET

private static final int MAX_OFFSET

See Also:

• Constant Field Values

ENTRY_SIZE

private static final int ENTRY_SIZE

See Also:

• Constant Field Values

data

private final String[] data

map

private final it.unimi.dsi.fastutil.ints.Int2IntMap map

A map from lemma+POS hashes to encoded lemma+POS+word tuple offsets in data

DEFAULT_SEPARATOR

private static final String DEFAULT_SEPARATOR

See Also:

• Constant Field Values

Constructor Details

ManualSynthesizer

public ManualSynthesizer(InputStream inputStream)
                  throws IOException

Throws:

IOException

Method Details

groupByHash

private static it.unimi.dsi.fastutil.ints.Int2ObjectOpenHashMap<List<org.apache.commons.lang3.tuple.Triple<String,String,String>>> groupByHash(Map<TaggedWord,List<String>> mapping)

encodeForm

private static String encodeForm(String lemma,
 String word)

decodeForm

private static String decodeForm(String lemma,
 String word)

collectTags

private static it.unimi.dsi.fastutil.objects.ObjectOpenHashSet<String> collectTags(Map<TaggedWord,List<String>> mapping)

hashCode

private static int hashCode(String lemma,
 String posTag)

getPossibleTags

public Set<String> getPossibleTags()

Retrieve all the possible POS values.

lookup

@Nullable
public List<String> lookup(String lemma,
 String posTag)

Look up a word's inflected form as specified by the lemma and POS tag.

Parameters:

lemma - the lemma to inflect.

posTag - the required POS tag.

Returns:

a list with all the inflected forms of the specified lemma having the specified POS tag. If no inflected form is found, the function returns null.

loadMapping

private static Map<TaggedWord,List<String>> loadMapping(InputStream inputStream)
                                                 throws IOException

Throws:

IOException