Lines Matching refs:tokenizer
91 static int tokenizer = 0;
285 tokenizer\[ { ltoken.type = TOK_BEGTOK; ltoken.text = yytext;
291 \]tokenizer { ltoken.type = TOK_ENDTOK; ltoken.text = yytext;
324 * tokenizer aliases.
1095 if (tokenizer) {
1638 /* This is actually a tokenizer directive. */
1648 * Another tokenizer directive.
1943 /* This is actually a tokenizer directive. */
1958 /* Tokenizer directives */
1961 tokenizer = 1;
1969 tokenizer = 0;
2057 * print a tokenizer error message
Indexes created Sat Oct 25 16:10:12 GMT 2025