Z
Zyeon UI

Tokenizer Preview · Zyeon UI

A tokenizer playground for input text — alternating-tinted token chunks from a deterministic built-in splitter or your own, token/char/word counts, a live cost estimate at an editable per-Mtok rate, and markers for whitespace and unusually long tokens.

npx shadcn@latest add @zyeon/tokenizer-preview
Preview Tokenizer Preview on Zyeon UI's site (opens in a new tab)

Not checked yet

Zyeon UI limits how often it can be asked, and Tokenizer Preview hasn't had its turn. Its source will show here once it has.