Uses of Interface
net.sourceforge.pmd.cpd.Tokenizer
-
Packages that use Tokenizer Package Description net.sourceforge.pmd.cpd Token-based copy-paste detection.net.sourceforge.pmd.cpd.impl Utilities to implement a CPDTokenizer
.net.sourceforge.pmd.lang net.sourceforge.pmd.lang.impl -
-
Uses of Tokenizer in net.sourceforge.pmd.cpd
Classes in net.sourceforge.pmd.cpd that implement Tokenizer Modifier and Type Class Description class
AnyTokenizer
Simple tokenization into words and separators.Methods in net.sourceforge.pmd.cpd that return Tokenizer Modifier and Type Method Description default Tokenizer
CpdCapableLanguage. createCpdTokenizer(LanguagePropertyBundle bundle)
Create a newTokenizer
for this language, given a property bundle with configuration.Methods in net.sourceforge.pmd.cpd with parameters of type Tokenizer Modifier and Type Method Description static void
Tokenizer. tokenize(Tokenizer tokenizer, TextDocument textDocument, Tokens tokens)
Wraps a call totokenize(TextDocument, TokenFactory)
to properly create and close the token factory. -
Uses of Tokenizer in net.sourceforge.pmd.cpd.impl
Classes in net.sourceforge.pmd.cpd.impl that implement Tokenizer Modifier and Type Class Description class
AntlrTokenizer
Generic implementation of aTokenizer
useful to any Antlr grammar.class
JavaCCTokenizer
Base class for aTokenizer
for a language implemented by a JavaCC tokenizer.class
TokenizerBase<T extends GenericToken<T>>
Generic base class for aTokenizer
. -
Uses of Tokenizer in net.sourceforge.pmd.lang
Methods in net.sourceforge.pmd.lang that return Tokenizer Modifier and Type Method Description Tokenizer
PlainTextLanguage. createCpdTokenizer(LanguagePropertyBundle bundle)
-
Uses of Tokenizer in net.sourceforge.pmd.lang.impl
Methods in net.sourceforge.pmd.lang.impl that return Tokenizer Modifier and Type Method Description abstract Tokenizer
CpdOnlyLanguageModuleBase. createCpdTokenizer(LanguagePropertyBundle bundle)
-