Skip to content

Latest commit

 

History

History
55 lines (55 loc) · 1.54 KB

tokenization.md

File metadata and controls

55 lines (55 loc) · 1.54 KB

Tokenization

Token Type ID Optional Line
int 0 0 - Line no.
char 0 1 - Line no.
bool 0 2 - Line no.
void 0 3 - Line no.
if 11 - - Line no.
else 12 - - Line no.
while 13 - - Line no.
return 27 - - Line no.
struct 45 - - Line no.
sizeof 47 - - Line no.
identifier 2 start length Line no.
constant(int) 3 0 value Line no.
constant(char) 3 1 value Line no.
constant(boolean) 3 2 value Line no.
constant(string) 3 3 start Line no.
null 3 4 0 Line no.
( 14 - - Line no.
) 15 - - Line no.
{ 16 - - Line no.
} 17 - - Line no.
[ 18 - - Line no.
] 19 - - Line no.
. 20 - - Line no.
, 21 - - Line no.
; 22 - - Line no.
: 23 - - Line no.
! 24 - - Line no.
= 1 0 - Line no.
+= 1 1 - Line no.
-= 1 2 - Line no.
/= 1 3 - Line no.
*= 1 4 - Line no.
++ 25 - - Line no.
-- 26 - - Line no.
& 28 - - Line no.
| 29 - - Line no.
== 30 - - Line no.
!= 31 - - Line no.
< 32 - - Line no.
> 33 - - Line no.
<= 34 - - Line no.
>= 35 - - Line no.
* 36 - - Line no.
/ 37 - - Line no.
% 38 - - Line no.
+ 39 - - Line no.
- 40 - - Line no.
&& 41 - - Line no.
|| 42 - - Line no.
~ 43 - - Line no.
^ 44 - - Line no.
-> 46 - - Line no.