---
title: "Token"
url: "https://ailawframework.com/glossary/token"
type: "defined_term"
site: "AI Law Framework"
checked: "2026-10-10"
---

# Token

> In natural language processing, a token is a unit of text that is processed by the AI, typically representing a word or a part of a word. However, a token does not have a fixed length in terms of characters or words.…

Canonical page: https://ailawframework.com/glossary/token  
Checked: 2026-10-10

Site index for agents: https://ailawframework.com/llms.txt

In natural language processing, a token is a unit of text that is processed by the AI, typically representing a word or a part of a word. However, a token does not have a fixed length in terms of characters or words. Instead, a token can vary based on the complexity of the language and the content.

Source: [Hong Kong Judiciary GenAI Guidelines (Annex)](https://www.judiciary.hk/doc/en/court_services_facilities/guidelines_on_the_use_of_generative_ai.pdf) (checked 2026-10-10)

## Related terms

- [Generative Pre-trained Transformer (“GPT”)](https://ailawframework.com/glossary/generative-pre-trained-transformer-gpt.md)
- [Large Language Model (“LLM”)](https://ailawframework.com/glossary/large-language-model-llm.md)
- [Machine Learning](https://ailawframework.com/glossary/machine-learning.md)
- [Deep Learning](https://ailawframework.com/glossary/deep-learning.md)
- [Data Mining](https://ailawframework.com/glossary/data-mining.md)
- [Natural Language Processing (“NLP”)](https://ailawframework.com/glossary/natural-language-processing-nlp.md)