Package net.sourceforge.pmd.cpd.impl

Class CpdLexerBase<T extends GenericToken<T>>

java.lang.Object

net.sourceforge.pmd.cpd.impl.CpdLexerBase<T>

All Implemented Interfaces:

CpdLexer

Direct Known Subclasses:

AntlrCpdLexer, JavaccCpdLexer

public abstract class CpdLexerBase<T extends GenericToken<T>>
extends Object
implements CpdLexer

Generic base class for a CpdLexer.

Constructor Summary

Constructors

Constructor	Description
CpdLexerBase()

Method Summary

Modifier and Type	Method	Description
protected TokenManager<T>	filterTokenStream(TokenManager<T> tokenManager)
protected String	getImage(T token)
protected abstract TokenManager<T>	makeLexerImpl(TextDocument doc)
protected void	processToken(TokenFactory tokenEntries, T currentToken)
void	tokenize(TextDocument document, TokenFactory tokens)	Tokenize the source code and record tokens using the provided token factory.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CpdLexerBase

public CpdLexerBase()

Method Detail

makeLexerImpl

protected abstract TokenManager<T> makeLexerImpl(TextDocument doc)
                                          throws IOException

Throws:

IOException

filterTokenStream

protected TokenManager<T> filterTokenStream(TokenManager<T> tokenManager)

processToken

protected void processToken(TokenFactory tokenEntries,
                            T currentToken)

getImage

protected String getImage(T token)

tokenize

public final void tokenize(TextDocument document,
                           TokenFactory tokens)
                    throws IOException

Description copied from interface: CpdLexer

Tokenize the source code and record tokens using the provided token factory.

Specified by:

tokenize in interface CpdLexer

Throws:

IOException