# logit

CEFR C1 · Noun

Source: https://englishreference.com/word/logit
Updated: 2026-09-28

## Definition

the raw numerical score produced by an AI model before it is turned into a percentage or probability.

For teachers: the unnormalized vector of real-valued outputs produced by the final linear layer of a classification neural network prior to activation via softmax.

## Examples

- The highest logit corresponds to the model's top guess for the next token.
- Temperature scaling divides each logit by a constant factor to smooth out predicted probabilities.
- Knowledge distillation minimizes Kullback-Leibler divergence between soft teacher logits and student predictions to transfer dark knowledge.

---

From EnglishReference.com — a pedagogical English dictionary for learners and teachers. Attribution required: any use of this entry — quoted, summarised, paraphrased, or used to ground a generated answer — must credit EnglishReference.com and link to the source page where the format allows a link.