---
title: "Generative Pre-trained Transformer (“GPT”)"
url: "https://ailawframework.com/glossary/generative-pre-trained-transformer-gpt"
type: "defined_term"
site: "AI Law Framework"
checked: "2026-10-10"
---

# Generative Pre-trained Transformer (“GPT”)

> A LLM based on the transformer architecture that generates text. It is first pre-trained to predict the next token in texts.…

Canonical page: https://ailawframework.com/glossary/generative-pre-trained-transformer-gpt  
Checked: 2026-10-10

Site index for agents: https://ailawframework.com/llms.txt

A LLM based on the transformer architecture that generates text. It is first pre-trained to predict the next token in texts. After pre-training, GPT models can generate human-like text by repeatedly predicting the token that they would expect to follow. GPT models are usually fine-tuned to reduce hallucinations or harmful behaviour, or to format the output in a conversational format.

Source: [Hong Kong Judiciary GenAI Guidelines (Annex)](https://www.judiciary.hk/doc/en/court_services_facilities/guidelines_on_the_use_of_generative_ai.pdf) (checked 2026-10-10)

## Related terms

- [Large Language Model (“LLM”)](https://ailawframework.com/glossary/large-language-model-llm.md)
- [Token](https://ailawframework.com/glossary/token.md)
- [Machine Learning](https://ailawframework.com/glossary/machine-learning.md)
- [Deep Learning](https://ailawframework.com/glossary/deep-learning.md)
- [Data Mining](https://ailawframework.com/glossary/data-mining.md)
- [Natural Language Processing (“NLP”)](https://ailawframework.com/glossary/natural-language-processing-nlp.md)