Package net.sourceforge.pmd.cpd.impl

Class AntlrTokenizer

java.lang.Object

net.sourceforge.pmd.cpd.impl.TokenizerBase<AntlrToken>

net.sourceforge.pmd.cpd.impl.AntlrTokenizer

All Implemented Interfaces:

Tokenizer

public abstract class AntlrTokenizer
extends TokenizerBase<AntlrToken>

Generic implementation of a Tokenizer useful to any Antlr grammar.

Constructor Summary

Constructors

Constructor	Description
AntlrTokenizer()

Method Summary

Modifier and Type	Method	Description
protected abstract org.antlr.v4.runtime.Lexer	getLexerForSource(org.antlr.v4.runtime.CharStream charStream)
protected TokenManager<AntlrToken>	makeLexerImpl(TextDocument doc)

Methods inherited from class net.sourceforge.pmd.cpd.impl.TokenizerBase

filterTokenStream, getImage, processToken, tokenize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AntlrTokenizer

public AntlrTokenizer()

Method Detail

makeLexerImpl

protected final TokenManager<AntlrToken> makeLexerImpl(TextDocument doc)
                                                throws IOException

Specified by:

makeLexerImpl in class TokenizerBase<AntlrToken>

Throws:

IOException

getLexerForSource

protected abstract org.antlr.v4.runtime.Lexer getLexerForSource(org.antlr.v4.runtime.CharStream charStream)