org.cdlib.xtf.textIndexer

Class StartEndFilter

Object

TokenStream

TokenFilter

StartEndFilter

public class StartEndFilter
extends TokenFilter

Ensures that the tokens at the start and end of the stream are indexed both with and without the special start-of-field/end-of-field markers.

Author:

Martin Haye

Field Summary

Fields

Modifier and Type	Field and Description
private Token	queuedToken Token queued for next()

Fields inherited from class TokenFilter

input

Constructor Summary

Constructors

Constructor and Description
StartEndFilter(TokenStream input) Construct a token stream that fixes the start/end markers.

Method Summary

Modifier and Type	Method and Description
Token	next() Retrieve the next token in the stream.

Methods inherited from class TokenFilter

close

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

queuedToken

private Token queuedToken

Token queued for next()

Constructor Detail

StartEndFilter

public StartEndFilter(TokenStream input)

Construct a token stream that fixes the start/end markers.

Parameters:

input - Input stream of tokens to process

Method Detail

next

public Token next()
           throws IOException

Retrieve the next token in the stream.

Specified by:

next in class TokenStream

Throws:

IOException