Skip to content
Search

Context Rot

lastmod 2026-04-14created 2026-04-124 edits

Context Rot refers to the phenomenon in which a large language model (LLM) becomes less intelligent and less accurate at processing information as the context (amount of information) fed into it grows longer. It is caused by the 'Lost in the Middle' phenomenon, in which important information is missed within a long context, or by the dilution of the attention mechanism, and simply supporting long contexts does not guarantee performance.

See also

Favorite site

author Zer0 sitemap