WTF are tokens?
Last updated Feb 11, 2026 by ATDb automated enrichment
Details
When someone sends a prompt or receives a response, the system breaks language into small segments. These fragments are tokens.
Last updated Feb 11, 2026 by ATDb automated enrichment
When someone sends a prompt or receives a response, the system breaks language into small segments. These fragments are tokens.