Generative Pre-trained Transformer (“GPT”)
A LLM based on the transformer architecture that generates text. It is first pre-trained to predict the next token in texts. After pre-training, GPT models can generate human-like text by repeatedly predicting the token that they would expect to follow. GPT models are usually fine-tuned to reduce hallucinations or harmful behaviour, or to format the output in a conversational format.
MaintainedLast reviewed
Source: Hong Kong Judiciary GenAI Guidelines (Annex) · checked 2026-10-10