CQL::Lexer - a lexical analyzer for CQL
my $lexer = CQL::Lexer->new();
$lexer->tokenize( 'foo and bar' );
my @tokens = $lexer->getTokens();
CQL::Lexer is lexical analyzer for a string of CQL. Once you've got a CQL::Lexer
object you can tokenize a CQL string into CQL::Token objects. Ordinarily
you'll never want to do this yourself since CQL::Parser calls CQL::Lexer for
CQL::Lexer uses Stevan Little's lovely String::Tokenizer in the background, and
does a bit of analysis afterwards to handle some peculiarities of CQL: double
quoted strings, <, <=, etc.
Pass in a string of CQL to tokenize. This initializes the lexer with data so
that you can retrieve tokens.
Returns a list of all the tokens.
Returns the current token.
Returns the next token, or undef if there are more tokens to retrieve from the
Returns the previous token, or undef if there are no tokens prior to the current
Resets the iterator to start reading tokens from the beginning.