org.carrot2.text.preprocessing

Class LanguageModelStemmer

java.lang.Object

org.carrot2.text.preprocessing.LanguageModelStemmer

@Bindable(prefix="LanguageModelStemmer")
public final class LanguageModelStemmer
extends Object

Applies stemming to words and calculates a number of frequency statistics for stems.

This class saves the following results to the PreprocessingContext:

• PreprocessingContext.AllWords.stemIndex
• PreprocessingContext.AllStems.image
• PreprocessingContext.AllStems.mostFrequentOriginalWordIndex
• PreprocessingContext.AllStems.tf
• PreprocessingContext.AllStems.tfByDocument
• PreprocessingContext.AllWords.type is populated with ITokenizer.TF_QUERY_WORD

This class requires that Tokenizer and CaseNormalizer be invoked first.

Constructor Summary

Constructors

Constructor and Description
LanguageModelStemmer()

Method Summary

Methods

Modifier and Type	Method and Description
void	stem(PreprocessingContext context) Performs stemming and saves the results to the context.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LanguageModelStemmer

public LanguageModelStemmer()

Method Detail

stem

public void stem(PreprocessingContext context)

Performs stemming and saves the results to the context.