Tokenizer

The Tokenizer provides an interface to the PHP tokenizer embedded in the Zend Engine. Using these functions allow you to write your own PHP source analyzing or modification tools without having to deal with the language specification at the lexical level.

For more information on Tokenizer, check us2.php.net/manual/en/ref.tokenizer.php.