Anthropic says it may be approaching a point where artificial intelligence can accelerate its own development. The warning appears in an updated S-1/A filing submitted to the US Securities and Exchange Commission. The company says it has not reached that stage, though its estimates suggest it could happen soon.
The technology, known as recursive self-improvement (RSI), refers to AI systems improving the processes used to develop them, potentially speeding up the progress of their capabilities. The prospect raises sharply different views: some critics warn that increasingly powerful systems could become difficult for people to control, while supporters see the potential to boost productivity and scientific discovery.
Anthropic says it already uses AI in research and development, but cautions that relying on it could create significant safety risks if it sharply accelerates progress. In the filing, the company also says it has previously used AI systems to develop new models without initially recognizing the scale of the capability gains.
The company warns that models could advance faster than it can develop, validate and implement safeguards, alignment measures and other protections. Internal estimates and projections for future models suggest Anthropic could soon reach what its Responsible Scaling Policy calls “dramatically accelerated progress attributable to AI.” The company says none of its current models has been classified as having crossed that threshold, and that its assessment is ongoing.
Anthropic does not expect Claude to design and build successive generations of advanced models entirely autonomously, without significant human oversight or understanding. It is also considering updates to its Responsible Scaling Policy to keep people in control of development of its most advanced models.
The filing says Claude’s capabilities have advanced this year, particularly in programming, mathematics and cybersecurity. Anthropic notes that the document was submitted as part of its disclosures to the SEC; such filings can also present a company’s outlook to the market.
Sources: Olhar Digital.