Class AbstractTokenizer

  • All Implemented Interfaces:
    Tokenizer

    @Deprecated
    public abstract class AbstractTokenizer
    extends Object
    implements Tokenizer
    Deprecated.
    Use an AnyTokenizer instead, it's basically as powerful.
    Author:
    Zev Blut zb@ubit.com, Romain PELISSE belaran@gmail.com
    • Field Detail

      • stringToken

        protected List<String> stringToken
        Deprecated.
      • ignorableCharacter

        protected List<String> ignorableCharacter
        Deprecated.
      • ignorableStmt

        protected List<String> ignorableStmt
        Deprecated.
      • oneLineCommentChar

        protected char oneLineCommentChar
        Deprecated.
      • spanMultipleLinesString

        protected boolean spanMultipleLinesString
        Deprecated.
      • spanMultipleLinesLineContinuationCharacter

        protected Character spanMultipleLinesLineContinuationCharacter
        Deprecated.
    • Constructor Detail

      • AbstractTokenizer

        public AbstractTokenizer()
        Deprecated.