Menu

## Tokenizer
in package

Tokenizer.php : 4

### Table of Contents

$map : array<string|int, mixed>
  Token Map for "non-tokens"
parse() : TokenCollection
fillBlanks() : TokenCollection

### Properties

#### $map

Tokenizer.php : 11

Token Map for "non-tokens"

`private array<string|int, mixed> $map = ['(' => 'T_OPEN_BRACKET', ')' => 'T_CLOSE_BRACKET', '[' => 'T_OPEN_SQUARE', ']' => 'T_CLOSE_SQUARE', '{' => 'T_OPEN_CURLY', '}' => 'T_CLOSE_CURLY', ';' => 'T_SEMICOLON', '.' => 'T_DOT', ',' => 'T_COMMA', '=' => 'T_EQUAL', '<' => 'T_LT', '>' => 'T_GT', '+' => 'T_PLUS', '-' => 'T_MINUS', '*' => 'T_MULT', '/' => 'T_DIV', '?' => 'T_QUESTION_MARK', '!' => 'T_EXCLAMATION_MARK', ':' => 'T_COLON', '"' => 'T_DOUBLE_QUOTES', '@' => 'T_AT', '&' => 'T_AMPERSAND', '%' => 'T_PERCENT', '|' => 'T_PIPE', '$' => 'T_DOLLAR', '^' => 'T_CARET', '~' => 'T_TILDE', '`' => 'T_BACKTICK']`

### Methods

#### parse()

Tokenizer.php : 42
`public parse(string $source) : TokenCollection`

##### Parameters

$source : string

##### Return values

TokenCollection —

#### fillBlanks()

Tokenizer.php : 93
`private fillBlanks(TokenCollection $tokens, int $maxLine) : TokenCollection`

##### Parameters

$tokens : TokenCollection
$maxLine : int

##### Return values

TokenCollection —

## Search results