Description
Source code tokenization can support tools that inspect or transform Perl 5 programs. Developers use this lexical analyzer for linters, syntax tools, editors, or static-analysis workflows. It reads source text supplied by the host program and does not execute that code by itself.