Description
Wolfram Language input can be tokenized for Mathics parsing and symbolic computation tools.
This is an internal support library, not an app. It is useful for Mathics components and developers who need the scanner portion of the language pipeline.