IBM CEO says open weight models are now irresistibly good and cheap on-prem
Posted by beardyw 7 hours ago
Comments
Comment by beardyw 7 hours ago
Not surprising he says that, but it makes sense.
Comment by rvz 7 hours ago
This is the future Anthropic does not want you to see, because that companies believes they are there for your safety, which is complete BS.
Open weight models are the future.
Comment by theplumber 5 hours ago
They are the future as long as someone is releasing them. From what I read lately it could be that OpenAI and Anthropic will get the regulation they caved for and unexpectedly China will stop releasing good open models.
Comment by akagusu 3 hours ago
Open weight models are the present.
Comment by cyanydeez 3 hours ago
they're presentish, if you prepped pre Fall 2025. The current prices for local model GPUs is insane.
I picked up the AMD Strix Halo with 128GB a year ago, and had my company pick up a framework one prior to that.
Qwen3.8-Flash-Next is the equalizer. I'm building autonmously with it for personal and work. There's a halogen-flash-server that runs rings around llamacpp.
With the right engineering harness, I'm keeping the same agent busy through 6 million tokens by recycling the context with dynamic context pruning and eviction so it's able to just keep chugging with a little direction & decisions.
Comment by eqvinox 4 hours ago
Yet another warning sign that Anthropic and OpenAI IPOs are doomed.