Grokking

lastmod 2024-07-15created 2024-07-152 edits

See also

• Deep learning
• Q-Star (OpenAI)

Favorite site

• A breakthrough past AI's limits according to Bill Gates and Sam Altman - the 'Grokking phenomenon'
• Do machine learning models memorize or generalize? | GeekNews
  • The article discusses a phenomenon of machine learning models called "grokking", in which a model shifts from memorizing its training data to correctly generalizing to unseen inputs after a long period of training.
  • [Original] Do Machine Learning Models Memorize or Generalize?