Anthropic warns: very close to RSI with self-improvement capability

In a revised S-1A filing submitted on Monday, Anthropic said the company is very close to producing a model with recursive self-improvement (RSI) capability, but stressed that no model has crossed that line yet. The filing adds two points to the risk factors section: first, that the company has already used AI to develop a new model whose capability jump was not noticed at the time, and second, that based on internal estimates and expectations for future models rather than current model performance, the company may soon meet the definition of the RSP threshold of "dramatically accelerated progress from AI." Anthropic said it is considering revising the RSP and said it does not believe Claude can be allowed to fully autonomously design and build the next generation of frontier models without meaningful human oversight or understanding.