Package org.languagetool.chunking

Class GermanChunker

java.lang.Object

org.languagetool.chunking.GermanChunker

All Implemented Interfaces:

Chunker

public class GermanChunker
extends Object
implements Chunker

A rule-based German chunker for noun phrases. Please note that this chunker has not been evaluated as a stand-alone chunker, it has only been used and tested in the context of LanguageTool's error detection rules.

Since:

2.9

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private static class	GermanChunker.AffectedSpans
(package private) static enum	GermanChunker.PhraseType
private static class	GermanChunker.RegularExpressionWithPhraseType
private static class	GermanChunker.Span

Field Summary

Fields

Modifier and Type	Field	Description
private static boolean	debug
private static final TokenExpressionFactory	FACTORY
private static final Set<String>	FILTER_TAGS
private static final List<GermanChunker.RegularExpressionWithPhraseType>	REGEXES1
private static final List<GermanChunker.RegularExpressionWithPhraseType>	REGEXES2
private static final Pattern	simpleFormRegexp
private static final Map<String,String>	SYNTAX_EXPANSION
private static final String[][]	undOderBzw

Constructor Summary

Constructors

Constructor	Description
GermanChunker()

Method Summary

Modifier and Type	Method	Description
void	addChunkTags(List<AnalyzedTokenReadings> tokenReadings)
private static Set<String>	allForms(List<AnalyzedTokenReadings> tokens)
private void	apply(GermanChunker.RegularExpressionWithPhraseType regex, List<ChunkTaggedToken> tokens, Set<String> allForms)
private void	assignChunksToReadings(List<ChunkTaggedToken> chunkTaggedTokens)
private static GermanChunker.RegularExpressionWithPhraseType	build(String expr, GermanChunker.PhraseType phraseType)
private static GermanChunker.RegularExpressionWithPhraseType	build(String expr, GermanChunker.PhraseType phraseType, boolean overwrite)
private static GermanChunker.RegularExpressionWithPhraseType	buildExpanded(String expandedExpr, GermanChunker.PhraseType phraseType, boolean overwrite, String[][] formHints)
private static String[][]	calcFormHints(String expandedExpr)
private GermanChunker.AffectedSpans	doApplyRegex(GermanChunker.RegularExpressionWithPhraseType regex, List<ChunkTaggedToken> tokens)
(package private) List<ChunkTaggedToken>	getBasicChunks(List<AnalyzedTokenReadings> tokenReadings)
private List<ChunkTaggedToken>	getBasicChunks(List<AnalyzedTokenReadings> tokenReadings, Set<String> allForms)
private ChunkTag	getChunkTag(GermanChunker.RegularExpressionWithPhraseType regex, edu.washington.cs.knowitall.regex.Match<ChunkTaggedToken> match, int i)
private String	getDebugString(List<ChunkTaggedToken> tokens)
private static boolean	hasAllFormHints(GermanChunker.RegularExpressionWithPhraseType regex, Set<String> allForms)
private static boolean	hasForm(Set<String> allForms, String[] hints)
static boolean	isDebug()	Deprecated. for internal use only
private void	printDebugInfo(GermanChunker.RegularExpressionWithPhraseType regex, GermanChunker.AffectedSpans affectedSpans, String debug)
static void	setDebug(boolean debugMode)	Deprecated. for internal use only

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

FILTER_TAGS

private static final Set<String> FILTER_TAGS

FACTORY

private static final TokenExpressionFactory FACTORY

simpleFormRegexp

private static final Pattern simpleFormRegexp

SYNTAX_EXPANSION

private static final Map<String,String> SYNTAX_EXPANSION

debug

private static boolean debug

undOderBzw

private static final String[][] undOderBzw

REGEXES1

private static final List<GermanChunker.RegularExpressionWithPhraseType> REGEXES1

REGEXES2

private static final List<GermanChunker.RegularExpressionWithPhraseType> REGEXES2

Constructor Details

GermanChunker

public GermanChunker()

Method Details

setDebug

public static void setDebug(boolean debugMode)

Deprecated.

for internal use only

isDebug

public static boolean isDebug()

Deprecated.

for internal use only

build

private static GermanChunker.RegularExpressionWithPhraseType build(String expr,
 GermanChunker.PhraseType phraseType)

build

private static GermanChunker.RegularExpressionWithPhraseType build(String expr,
 GermanChunker.PhraseType phraseType,
 boolean overwrite)

buildExpanded

private static GermanChunker.RegularExpressionWithPhraseType buildExpanded(String expandedExpr,
 GermanChunker.PhraseType phraseType,
 boolean overwrite,
 String[][] formHints)

calcFormHints

private static String[][] calcFormHints(String expandedExpr)

addChunkTags

public void addChunkTags(List<AnalyzedTokenReadings> tokenReadings)

Specified by:

addChunkTags in interface Chunker

Parameters:

tokenReadings - the analyzed tokens of one sentence

getBasicChunks

List<ChunkTaggedToken> getBasicChunks(List<AnalyzedTokenReadings> tokenReadings)

getBasicChunks

private List<ChunkTaggedToken> getBasicChunks(List<AnalyzedTokenReadings> tokenReadings,
 Set<String> allForms)

apply

private void apply(GermanChunker.RegularExpressionWithPhraseType regex,
 List<ChunkTaggedToken> tokens,
 Set<String> allForms)

hasAllFormHints

private static boolean hasAllFormHints(GermanChunker.RegularExpressionWithPhraseType regex,
 Set<String> allForms)

hasForm

private static boolean hasForm(Set<String> allForms,
 String[] hints)

allForms

private static Set<String> allForms(List<AnalyzedTokenReadings> tokens)

assignChunksToReadings

private void assignChunksToReadings(List<ChunkTaggedToken> chunkTaggedTokens)

doApplyRegex

private GermanChunker.AffectedSpans doApplyRegex(GermanChunker.RegularExpressionWithPhraseType regex,
 List<ChunkTaggedToken> tokens)

getChunkTag

private ChunkTag getChunkTag(GermanChunker.RegularExpressionWithPhraseType regex,
 edu.washington.cs.knowitall.regex.Match<ChunkTaggedToken> match,
 int i)

printDebugInfo

private void printDebugInfo(GermanChunker.RegularExpressionWithPhraseType regex,
 GermanChunker.AffectedSpans affectedSpans,
 String debug)

getDebugString

private String getDebugString(List<ChunkTaggedToken> tokens)