Independent Assessment of AI R&D Acceleration at Anthropic in October 2026
Posted by Hacktrick 21 hours ago
Comments
Comment by jackschultz 20 hours ago
Of note, "the acceleration in late 2025" believe has to do with Opus 4.5 which in my view and from Metr's analysis[0], was the point where their tests stopped working because the model was so good that doing work without using it took much more time.
> We guess that a majority (perhaps ≈80%) of the current (October 2026) acceleration is due to AI.... We believe AI’s contribution has grown relatively more important over time, and do not think the other factors we investigated would explain the sustained acceleration. The evidence of speedup from the usage of AI we describe below also seems compatible with a large contribution.
In a mini bet, I'd say that Anthropic is going to win by a large margin in what's going on. I've used the other models and no matter what the benchmarks are, places like OpenAI, Gemini, or the Deepseek / Kimi models haven't come close to the ability of the Claude models and harness. If what they say in this post is right, with "We did not identify any convincing bottlenecks to continued rapid progress.", this could be a sort of game over for the other models.
Even with Opus 5.5 in the past month and a half has been a changer in its abilities. In my dev process, I can give it much more freedom and trust with the workflows and connections I have to do the valid work to where I can do more, bigger tasks at once. I can't tell you how curious I am with the Opus 5.6 and whatever Model 4 is going to be called (along with the cost!) will do for dev work. And if this keeps increasing, and if there are subtle tricks that Anthropic has that the other companies don't, what that means for finding solutions and overall value and if the others are ever going to be able to catch up in any way.
All speculation, but what a time to be a dev in these times and get the first hand experience of all of this!
[0] https://metr.org/blog/2026-02-24-uplift-update/#wider-adopti...
Comment by kian 17 hours ago
It lies, ignores instructions, actively invents requirements, and silently breaks parts of my codebase it morally disagrees with and then refuses to fix it. I'm pretty much ready to switch to open source models exclusively once the next generation comes around and they're at previous fable/astra performance.
I'm sick and tired of the bait-and-switch. It's also pretty clear to me that whenever I work on anything even tangentially related to Anthropic's business (I'm looking at you, agent harnesses or storing chat transcripts), it actively deteriorates in quality to the point where I'm left nearly weeping in frustration.
Can't wait for the future in which our corporate overlords pay Anthropic and AI not to advertise, but to silently break and degrade service for people building competing products.
What a brave, new world.
Comment by m_w_ 20 hours ago
Comment by sakompella 11 hours ago
Cool to hear it's over for student before it ever started
Comment by reducesuffering 12 hours ago
Comment by greatgib 2 hours ago
I like that the authors appears to be honest and well meaning by ensuring to make it clear every where that they basically know nothing or can't disclose it.
A data point they use and that shows a nice growing chart is: "Informal self-reported uplift over time from Anthropic employees"
What a joke to pretend it is anything close to a valid scientific data point.
It is "self reported", a "uplift" feeling without concrete measure, and from "Anthropic employees" that are the one creating the tools that pretend to be evaluated here.
You see someone saying "my work is so much horse shit that i would not use it myself", "or you pay me to improve that, but it doesn't make me more efficient or worse". And also, even if you wanted to be honest, how would it look when you have to face the top management after. Not considering that their "stocks" value might depend on their reply.
And you have the following that is so totally bullshit crazy:
"We did not see evidence for significant bottlenecks which would prevent further capabilities progress due to limits on algorithmic progress, training compute, experiment compute, or data in the next 12 months."
You don't know what you don't know, but we think that there is no barrier for the capability being improved when currently we are at the maximum we could have reached at this point.There is a ram shortage worldwide, it becomes hard to find supply in GPU or build data centers, but they don't see training compute limitation in the coming year...