com.browseengine.bobo.analysis.section
Class SectionTokenStream

java.lang.Object
  org.apache.lucene.util.AttributeSource
      org.apache.lucene.analysis.TokenStream
          org.apache.lucene.analysis.TokenFilter
              com.browseengine.bobo.analysis.section.SectionTokenStream

All Implemented Interfaces:

Closeable

public class SectionTokenStream
extends org.apache.lucene.analysis.TokenFilter

This class augments a token stream by attaching a section id as payloads.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource

org.apache.lucene.util.AttributeSource.AttributeFactory, org.apache.lucene.util.AttributeSource.State

Field Summary

Fields inherited from class org.apache.lucene.analysis.TokenFilter

input

Constructor Summary

SectionTokenStream(org.apache.lucene.analysis.TokenStream tokenStream, int sectionId)

Method Summary

static int	decodeIntPayload(byte[] data, int off, int len)
static int	decodeIntPayload(org.apache.lucene.index.Payload payload)
static org.apache.lucene.index.Payload	encodeIntPayload(int id)
boolean	incrementToken()

Methods inherited from class org.apache.lucene.analysis.TokenFilter

close, end, reset

Methods inherited from class org.apache.lucene.util.AttributeSource

addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

SectionTokenStream

public SectionTokenStream(org.apache.lucene.analysis.TokenStream tokenStream,
                          int sectionId)

Method Detail

incrementToken

public boolean incrementToken()
                       throws IOException

Specified by:

incrementToken in class org.apache.lucene.analysis.TokenStream

Throws:

IOException

encodeIntPayload

public static org.apache.lucene.index.Payload encodeIntPayload(int id)

decodeIntPayload

public static int decodeIntPayload(org.apache.lucene.index.Payload payload)

decodeIntPayload

public static int decodeIntPayload(byte[] data,
                                   int off,
                                   int len)