Class AnyTokenizer

  • All Implemented Interfaces:
    Tokenizer

    public class AnyTokenizer
    extends Object
    implements Tokenizer
    This class does a best-guess try-anything tokenization.
    Author:
    jheintz