Large language model

This article may be too technical for most readers to understand. Please help improve it to make it understandable to non-experts, without removing the technical details. (May 2025) (Learn how and when to remove this message)

A large language model (LLM) is a language model trained with self-supervised machine learning on a vast amount of text, designed for natural language processing tasks, especially language generation.

The largest and most capable LLMs are generative pretrained transformers (GPTs), which are largely used in generative chatbots such as ChatGPT or Gemini. LLMs can be fine-tuned for specific tasks or guided by prompt engineering.^[1] These models acquire predictive power regarding syntax, semantics, and ontologies^[2] inherent in human language corpora, but they also inherit inaccuracies and biases present in the data they are trained in.^[3]