Word
stochasticity
Definition
n. the quality of having randomness, unpredictability, or chance built into a process.
n. the property or state of being stochastic; the inherent presence of randomness, probabilistic uncertainty, or chance behavior within a dynamical or computational system.
Examples
“The roll of dice adds enjoyable stochasticity to the family board game.”
“Injecting stochasticity into token sampling prevents the language model from producing identical repetitive answers.”
“Stochasticity in minibatch sampling acts as an implicit regularizer, allowing deep networks to escape sub-optimal sharp saddle points.”
Examples
simple
“The roll of dice adds enjoyable stochasticity to the family board game.”
contextual
“Injecting stochasticity into token sampling prevents the language model from producing identical repetitive answers.”
complex
“Stochasticity in minibatch sampling acts as an implicit regularizer, allowing deep networks to escape sub-optimal sharp saddle points.”
Real-World Examples
“While the resulting behaviour of an LLM when acting according to a policy mimics randomness due to the natural entropy of the logits, this is an uncontrolled “illusion of stochasticity”, possibly driven by biases in the training data rather than the target distribution.” Etymology
From Greek stokhastikos ('aiming at a target, guessing, intuitive'), from stokhazesthai ('to aim at, guess'), from stokhos ('a pointed stake, target, aim').
Etymology adapted from Wiktionary, available under CC BY-SA 4.0.
Domains
Scan code
englishreference.com/q/stochasticity