tokenizing (definition) (Perl 5)

Splitting up a program text into tokens. Also known as “lexing”, in which case you get “lexemes” instead of tokens. PerlDoc