◆ decimalCode
◆ doAlphanumeric
append to TokenList rather than replace
◆ doAppend
make strings & put into StringList
◆ doNest
identifiers may include numeric
◆ doString
number of bytes currently used
◆ leftDelims
◆ reserved
| long TokenBlock::reserved[8] |
handle to itl4 resource of current script
◆ sourceLength
| long TokenBlock::sourceLength |
pointer to stream of characters
◆ stringCount
| long TokenBlock::stringCount |
◆ stringLength
| long TokenBlock::stringLength |
pointer to stream of identifiers
◆ stringList
| Ptr TokenBlock::stringList |
number tokens generated by tokenizer
◆ tokenCount
| long TokenBlock::tokenCount |
maximum length of TokenList
◆ tokenLength
| long TokenBlock::tokenLength |
pointer to array of tokens
◆ tokenList
| Ptr TokenBlock::tokenList |
The documentation for this struct was generated from the following file: