Google AI Learns to ‘Sleep’ to Retain Knowledge
hitechexpert.topGoogle Research has introduced an innovative development called the “Sleep Framework”, designed to address a fundamental problem plaguing current large language models (LLMs): the loss of knowledge relevance after training concludes.
The Problem of ‘Expiring Knowledge’ Currently, most advanced LLMs enter a static mode after their initial training. This means their knowledge has a certain “expiration date.” If one attempts to supplement a model with new data during operation (e.g., through context), this information is often lost once the session ends.
