Package org.languagetool.chunking

Class RussianChunker

java.lang.Object

org.languagetool.chunking.RussianChunker

All Implemented Interfaces:

Chunker

@Experimental
public class RussianChunker
extends Object
implements Chunker

A rule-based prototype Russian chunker. Please note that this chunker has not been evaluated as a stand-alone chunker, it has only been used in the context of LanguageTool's error detection rules.

Since:

5.6

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private static class	RussianChunker.AffectedSpans
(package private) static enum	RussianChunker.PhraseType
private static class	RussianChunker.RegularExpressionWithPhraseType
private static class	RussianChunker.Span

Field Summary

Fields

Modifier and Type	Field	Description
private static boolean	debug
private static final TokenExpressionFactory	FACTORY
private static final Set<String>	FILTER_TAGS
private static final List<RussianChunker.RegularExpressionWithPhraseType>	REGEXES1
private static final List<RussianChunker.RegularExpressionWithPhraseType>	REGEXES2
private static final Map<String,String>	SYNTAX_EXPANSION

Constructor Summary

Constructors

Constructor	Description
RussianChunker()

Method Summary

Modifier and Type	Method	Description
void	addChunkTags(List<AnalyzedTokenReadings> tokenReadings)
private void	apply(RussianChunker.RegularExpressionWithPhraseType regex, List<ChunkTaggedToken> tokens)
private void	assignChunksToReadings(List<ChunkTaggedToken> chunkTaggedTokens)
private static RussianChunker.RegularExpressionWithPhraseType	build(String expr, RussianChunker.PhraseType phraseType)
private static RussianChunker.RegularExpressionWithPhraseType	build(String expr, RussianChunker.PhraseType phraseType, boolean overwrite)
private RussianChunker.AffectedSpans	doApplyRegex(RussianChunker.RegularExpressionWithPhraseType regex, List<ChunkTaggedToken> tokens)
(package private) List<ChunkTaggedToken>	getBasicChunks(List<AnalyzedTokenReadings> tokenReadings)
private ChunkTag	getChunkTag(RussianChunker.RegularExpressionWithPhraseType regex, edu.washington.cs.knowitall.regex.Match<ChunkTaggedToken> match, int i)
private String	getDebugString(List<ChunkTaggedToken> tokens)
static boolean	isDebug()	Deprecated. for internal use only
private void	printDebugInfo(RussianChunker.RegularExpressionWithPhraseType regex, RussianChunker.AffectedSpans affectedSpans, String debug)
static void	setDebug(boolean debugMode)	Deprecated. for internal use only

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

FILTER_TAGS

private static final Set<String> FILTER_TAGS

FACTORY

private static final TokenExpressionFactory FACTORY

SYNTAX_EXPANSION

private static final Map<String,String> SYNTAX_EXPANSION

debug

private static boolean debug

REGEXES1

private static final List<RussianChunker.RegularExpressionWithPhraseType> REGEXES1

REGEXES2

private static final List<RussianChunker.RegularExpressionWithPhraseType> REGEXES2

Constructor Details

RussianChunker

public RussianChunker()

Method Details

setDebug

public static void setDebug(boolean debugMode)

Deprecated.

for internal use only

isDebug

public static boolean isDebug()

Deprecated.

for internal use only

build

private static RussianChunker.RegularExpressionWithPhraseType build(String expr,
 RussianChunker.PhraseType phraseType)

build

private static RussianChunker.RegularExpressionWithPhraseType build(String expr,
 RussianChunker.PhraseType phraseType,
 boolean overwrite)

addChunkTags

public void addChunkTags(List<AnalyzedTokenReadings> tokenReadings)

Specified by:

addChunkTags in interface Chunker

Parameters:

tokenReadings - the analyzed tokens of one sentence

getBasicChunks

List<ChunkTaggedToken> getBasicChunks(List<AnalyzedTokenReadings> tokenReadings)

apply

private void apply(RussianChunker.RegularExpressionWithPhraseType regex,
 List<ChunkTaggedToken> tokens)

assignChunksToReadings

private void assignChunksToReadings(List<ChunkTaggedToken> chunkTaggedTokens)

doApplyRegex

private RussianChunker.AffectedSpans doApplyRegex(RussianChunker.RegularExpressionWithPhraseType regex,
 List<ChunkTaggedToken> tokens)

getChunkTag

private ChunkTag getChunkTag(RussianChunker.RegularExpressionWithPhraseType regex,
 edu.washington.cs.knowitall.regex.Match<ChunkTaggedToken> match,
 int i)

printDebugInfo

private void printDebugInfo(RussianChunker.RegularExpressionWithPhraseType regex,
 RussianChunker.AffectedSpans affectedSpans,
 String debug)

getDebugString

private String getDebugString(List<ChunkTaggedToken> tokens)