Retrieves tokens from source code for use by the Parser
Located in /phpDocumentor/WordParser.inc (line 56)
Class | Description |
---|---|
ObjectWordParser | Like WordParser but designed to handle an array with strings and |
phpDocumentorTWordParser | Like WordParser, but expects an array of tokens from the tokenizer instead of a string. |
Backup to the previous token so that it can be retrieved again in a new context.
Occasionally, a word will be passed to an event handler that should be handled by another event handler. This method allows that to happen.
Unused
Returns the current pointer position, or 1 character after the end of the word
Retrieve source code for the last function/method
Retrieve a token from the token list
The Parser class relies upon this method to retrieve the next token. The $wordseperators array is a collection of strings that delineate tokens for the current parser state. $wordseperators is set by the parser with a call to Parser::configWordParser() every time a new parser state is reached.
For example, while parsing the source code for a class, the word
If the whitespace option has been turned off using setWhitespace(), then no whitespace is returned with tokens
{@ is of course the string containing the PHP code to be parsed, and $pos is the cursor, or current location within the parsed data. }}
Set the internal cursor within the source code
Sets the list of possible separator tokens
Initialize the WordParser
set parser to return or strip whitespace
Documentation generated on Mon, 05 Dec 2011 21:40:31 -0600 by phpDocumentor 1.4.4