FICHA · AUR

python-crossandra

A simple tokenizer operating on enums with a decent amount of configuration

  • Tokenizer library
  • LIBRARY
  • TEXT
  • Dependency only
official+codex · reviewed · Jun 3, 2026 description in en

Description

Enum-oriented tokenization can be configured for Python parsing workflows. This library is for developers building small parsers or structured token streams. The tokenizer provides structure and leaves semantic validation to callers.

Permissions

Permissions not analysed for this source yet.