Word
decoding
Phoneticsde·cod·ing, stress on the second syllable
US/dɪˈkoʊdɪŋ/
UK/dɪkˈəʊdɪŋ/
Uncountable noun TechnicalAI
Definition
n. the process of converting an AI model's internal probability numbers into actual words or sentences.
n. the algorithmic process of selecting an output sequence of discrete tokens from the conditional probability distributions generated by an autoregressive model.
Examples
“Greedy decoding always selects the single word with the highest probability score.”
“Researchers experimented with contrastive decoding to reduce hallucination rates in medical summaries.”
“Constrained decoding algorithms enforce context-free grammar specifications on the language model output stream to ensure syntactically valid JSON responses.”
Examples
simple
“Greedy decoding always selects the single word with the highest probability score.”
contextual
“Researchers experimented with contrastive decoding to reduce hallucination rates in medical summaries.”
complex
“Constrained decoding algorithms enforce context-free grammar specifications on the language model output stream to ensure syntactically valid JSON responses.”
Usage
Often used in technical contexts like computer science, linguistics, or cryptography.
Real-World Examples
“QAnon invited users to build the theory by decoding messages on social media.” “Modern language models operate at vastly different scales, use subword tokenization with varying vocabulary sizes, and generate text through complex decoding strategies.” “Decoding strategies transform the probability distributions generated by LLMs into fluent and relevant output text19,20, 21. They determine how tokens are selected at each step of text generation.” “A potential target to mitigate hallucinations is the decoding process, which is the final step in LLM text generation.” Etymology
From de- (reversal prefix) + code (from Latin codex, 'book of laws, wooden tablet'). Transferred from cryptography in the 1940s to information theory and neural generation.
Etymology adapted from Wiktionary, available under CC BY-SA 4.0.
Word family
VERB
NOUN
Domain
- Exam level
- CambridgeCambridgeCambridge English QualificationsThe exam suite from Cambridge University Press & Assessment, from A1 Movers up to C2 Proficiency. The benchmark names double as CEFR labels.B2 FirstIELTSIELTSInternational English Language Testing SystemThe 0–9 band test co-owned by the British Council, IDP, and Cambridge. Used for university entry, work, and migration.5.5–6.5TOEFL iBTTOEFL iBTTest of English as a Foreign Language, Internet-Based TestETS's academic English test, the standard route for US university admissions. Scored 0–120, with a 1–6 scale since 2026.1–6 scale: 4.0–4.572–94TOEICTOEICTest of English for International CommunicationETS's workplace English test, big in Japan and Korea. Listening & Reading scores 10–990 and tops out at C1.785–944
- Frequency
- Occasional
- Level
- B2 · Upper Intermediate
- Updated
- アルファベット
- 読み方の一覧 →
QR code
englishreference.com/q/decoding