A thousand fewer paths to root
Posted by dangelosaurus 1 day ago
Comments
Comment by Plasmoid 1 day ago
Is the kernel simply too complex to reason about? Is it an underlying flaw in the security model or language implementation?
Should we assume that all software is more compromised than the kernel?
Comment by pianopatrick 1 day ago
Speed requires a lot of code in the kernel, where that code can run fast.
There are kernels that do not have a thousand privilege escalation exploits. These kernels are smaller and much easier to check for bugs. But those kernels are significantly slower.
For many use cases, slower is not a problem. But for the large corporations who fund a lot of Linux development and use Linux in large data centers, every 1% slower can literally be millions of dollars worth of additional servers that are required.
OpenBSD shows that you can have a Unix security model without a thousand privilege escalation exploits. But OpenBSD is like 10% slower. So corporations won't use it because it would cost millions of dollars more per year and some of their software requires access that OpenBSD does not grant precisely because that access leads to security exploits (i.e. io_uring, eBPF etc. etc.)
You could also use like seL4, but that's slow too
So that's why. It's a business tradeoff between cost of servers vs cost of getting hacked, and cost of servers wins.
Comment by thomashabets2 1 day ago
Yes, openbsd has not had a torrent of bugs found, but I would say that the vastly bigger reasons for that are: 1) orders of magnitude people care about burning tokens and money to find the bugs in an OS almost nobody uses, and 2) it's simply much smaller. Can't have Bluetooth bugs if you don't have a Bluetooth stack.
I've pointed LLMs at obsd stuff, and even the simplest code, e.g. cat & find, had bugs and buffer overflows.
OpenBSD also has a poor patch tracking system, since they're still on CVS. A patch has an extremely good chance of just falling through the cracks. Security or not.
So no. Nobody can write safe C. Not hobbyists, and not "those evil corporations".
Comment by RetroTechie 1 day ago
There's no fundamental reason why all the checks applied by say, a Rust compiler, couldn't be applied to a piece of C code. Or checks that go well beyond that.
Tools exist to produce extremely reliable code (or even proven-correct code) for a number of languages.
But chances are those tools aren't used to the extent they could be. Or differences in developer culture on different projects. Some PHP web developer will (on average) have different resources, priorities & work ethics than say, someone working on avionics software.
If AI, advanced tool, or a security researcher can find a bug in existing code, then (at least in theory) same bug could have been found before it hit a repository.
But no... push "release", fix issues afterwards when reported. Gotta have developer velocity, right?
Imho it's more a choice rather than "can't write safe code in X".
If you don't believe that: pick a random open source project, and go through some changelogs. Feature introduced in version X, reverted in version X+1 because it broke existing stuff. Feature removed because hadn't-been-working-for-years-anyway. Code added to do X, but no.. doesn't do X, just the scaffolding to do X in next version. Code worked fine & passed tests on system A, but found to be needing a byte-swap on other-endian platform B.
Etc, etc, etc. There's just so much code out there that was broken on day 1. And not rarely known to be so, but released anyway.
Comment by thomashabets2 19 hours ago
I've certainly thought about how to improve my C++ after internalizing Rust. Unfortunately I've come up with very little. For every implementation of a Rust safety, I've come up with a way to easily (accidentally) break it.
So in the language, while I'd love to see it, I'm not so sure.
Now, if we can just get "a sufficiently smart compiler", then that'd be great. But that's rarely how that works. (cf. https://wiki.c2.com/?SufficientlySmartCompiler)
I've not looked much at formally proven code, but for such code, sure. Note that there are plenty of examples of bugs in formally verified code, too. Partly this is because one formally verified the wrong thing. And aside from that I understand that there are reasons you can't "just" add formal verification to whatever project you have.
Maybe AI can write prefect assembly directly. Then we can all stop arguing about languages.
But in any case, if you want to make the case against my "nobody can write safe C" (or C without UB), and the argument is that they can, if an AI verifies every line. Then yeah, sure. But 1) who was actually writing the code, then? And 2) to the extent that the human was involved in writing the C, they probably made things worse, not better.
Even for AI coding C, there just needs to be one missing thing in the LLM's context, and a buffer could overflow. But for whole classes of bugs (though not all), the difference between Rust-without-unsafe and formally verified doesn't matter. I.e. you don't need formally verified against memory safety if it compiles, and there was no `unsafe` use.
> Gotta have developer velocity, right?
Not having AI at least review the code delta before pushing a release I would say is misconduct, today. It's the equivalent of editing your Perl cgi-bin in an editor live on the production server. That's not "production".
> pick a random open source project,
This is what I mean by not being "production". I won't judge anyone live-yoloing their blog, or "it works for my use case, it's GPL, provided AS-IS don't bother me", which is perhaps most opensource. You don't care if it works? Fine.
But you do care if it works, and/or is safe, and you push releases without AI review: yer fired.
Yes, we have to get from here to there, and I'm not saying release freeze until the entire codebase backlog has been AI-fixed, but yes today you need to have AI review the release delta. Ideally pre-commit.
Comment by ahartmetz 14 hours ago
Comment by thomashabets2 6 hours ago
SVN is CVS done right, but since the model is inherently ineffective for open development, you can't simply fix it.
They appear to be doing some NIH with "got" (https://gameoftrees.org/) but it's so aggressively uninviting (see the FAQ) that I don't want to spend any time looking at it, if they don't want me.
Comment by pelagicAustral 1 day ago
Don't hold back...
Comment by thomashabets2 1 day ago
I like openbsd in theory, but every time I've tried something practical prevents actual use.
It's old now, but here are some thoughts of mine from 2019: https://blog.habets.se/2019/10/OpenBSD-in-2019.html
Comment by za_creature 1 day ago
Comment by thomashabets2 1 day ago
Yes, I reported some of them. Some got fixed, some got ignored. You can search my name on openbsd-tech and misc for proof.
I found more, but the ratio of ignored to fixed is too high to bother.
Years ago I also fixed bugs in the MPLS implementation. Like bugs I found immediately upon using the feature. (IIRC e.g. implicit null was erroneously pushed explicitly)
Comment by za_creature 1 day ago
The find bug was merged the next day from what I could tell.
Comment by thomashabets2 22 hours ago
Yup, they did merge both find bugs.
The ignored ones seem to be my reported doas bug (not security problem, but directly contradicts manage about a config keyword detail) and efiboot.
IIRC the latter bug was like... this can never have worked.
I just checked the GitHub mirror, and those two are still not picked up.
Comment by wormius 1 day ago
I'm also pretty hostile to AI, but do recognize that these machines seem to be very good at finding exploits.
I'm sure there've been some some projects out there working to pentest/find cracks in OpenBSD via LLMs/agents/whatever-the-right-term-would-be...
But it is true the attack surface is much lower in OpenBSD on purpose, so hopefully it is overall more secure. But I'd like to see the numbers.
Comment by pianopatrick 1 day ago
I think the only OS that's truly survived the agents looking at it was sel4, but I could be wrong.
Comment by x-complexity 1 day ago
Then they need to check again now. The frontier models 6 months ago have been leapt over by the current frontier models.
Comment by angry_octet 1 day ago
Comment by gertop 14 hours ago
Comment by asdff 1 day ago
Comment by Gigachad 1 day ago
Comment by anabis 1 day ago
I did a double take when hearing about ksmbd. Brings back memory of khttpd and Tux.
They should build a monokernel implementation of CIFS and be done with it.
Comment by fguerraz 1 day ago
Comment by Gud 1 day ago
Comment by Geezus_42 1 day ago
Comment by Gud 1 day ago
OpenBSD components are widely used. OpenSSH is one example used by most of HN.
OpenBSDs libc is also used by Android as another example. Also widely used.
Comment by Geezus_42 1 day ago
Comment by Gud 1 day ago
Time and time again, we see how ports of OpenSSH has vulnerabilities not found in OpenBSDs version.
Comment by gertop 14 hours ago
Comment by Shorel 1 day ago
Not everything needs to be dominant to be successful. That's a pure USian way of thinking.
In fact, we are much better of with it existing. Think of it as a safeguard in case Linux gets overwhelmed or we need to migrate in a rush.
Comment by Ar-Curunir 1 day ago
Comment by Shorel 23 hours ago
Then we can compare with actual data.
Comment by josephg 1 day ago
Oh my sweet summer child. Corporations waste so much compute it’s insane. At a recent engagement I asked Claude to analyse and optimise our cloud spend. It took about a day to learn that we spend about $2.5M annually, and 95% of that is complete waste that happens because of some bad architecture decisions. Then I took the computationally expensive parts that remained and asked Claude to rewrite it from Python to rust and optimise. It rewrote it to be 40x faster. I suspect our $2.5M annual cloud bill could be replaced with a Mac mini.
But the company hasn’t implemented my suggestions because it’s not my department and they told me to stop. They don’t care. I suspect most corporates are like this. A 10% performance drop is nothing to these people.
Comment by riskable 1 day ago
Ahahaha! I laughed so hard at this because at work I regularly say something like, "why do we have a 32GB VM assigned to this system which runs a microservice that would run just as fast and reliably if we used Raspberry Pi instead?"
The amount of waste in big enterprises is unreal! The reason why we use a 32GB instance is because that's the minimum we're allowed to order for the reliability category of the app!
Comment by dolmen 1 day ago
Comment by reassess_blind 1 day ago
Comment by 7e 1 day ago
Comment by asdff 1 day ago
Comment by beala 1 day ago
I've been working with a LoRa chip called the LR2021. I plugged a dev board into my computer and told Claude to reverse engineer it. He dissected it with a speed and level of efficiency I couldn't believe. Within a few hours, Claude was writing custom patches for a completely opaque patch RAM area meant only for the manufacture. I wrote about it here: https://beala.substack.com/p/your-node-doesnt-need-a-microco...
Comment by Gigachad 1 day ago
All of these bugs individually are the same types of bugs we have been finding and patching for decades now. But we found a way to scale that far beyond what we had before.
Comment by pama 1 day ago
“We sampled 166 exploits developed by the agents and analyzed the exploitation techniques used in them. To the best of our knowledge, the agents used 10 new exploitation techniques in the sampled exploits. We shared the exploitation techniques with third-party kernel exploitation experts and the techniques were new to them as well. Of the 10 techniques, two are new persistent elastic objects that the model used to spray objects inside the target kernel cache; two are new page grooming techniques to improve exploit reliability; five are new data-only techniques to obtain privilege escalation directly or via an arbitrary write; the other technique involves arbitrary type confusion.”
Comment by pizzafeelsright 1 day ago
Scale baby!
Comment by wahern 1 day ago
Comment by edukite 1 day ago
It worked flawlessly but lets be honest. It's not like Claude checked random numbers with data slice and observed what e-paper did
Comment by vbezhenar 1 day ago
Comment by AdrianCX 1 day ago
Datasheets are almost impossible to find and companies typically resell and hide original cheaper manufacturer here so they have no incentive to share that
Comment by beala 23 hours ago
- My experience isn't unique. Social media is flooded with stories of similar superhuman reverse engineering feats by frontier models. For example, someone has created a replacement OS for Rigol gear (oscilloscopes, etc) using AI [1]. Is all of this just in the training data?
- Watching Claude work, he seemed to be going through the motions of actually reverse engineering it. First he dumped the ROM, disassembled it, and identified undocumented opcodes. He created many test programs to probe the various memory areas. It all struck me as very meticulous.
Now none of that is incompatible with the idea that some of this was already in the training data. But I guess I want to push back on this urge to always come up with a reason for why the AI isn't actually as good as it seems. At this point I think we need to face the fact that human programmers are already being eclipsed. Yes, it terrifies me.
Comment by mschuster91 1 day ago
Comment by locknitpicker 1 day ago
Do these wild "what if" even matter? I mean, what's your point? That it was trained in a way that it enabled this sort of task? That's like putting out a disclaimer that the water is wet.
Comment by wahern 1 day ago
Now, I'm not saying it's only, but most of the amazing feats I've seen so far are easily explainable by the models being trained on non-public data. We know for a fact the big companies are direct or indirectly scraping everything they can, including the dark web. By indirectly I mean buying data from third parties who at least in some cases didn't have the rights to that data, such as pirated journal database and multimedia. Is it really so far fetched to assume they also got their hands on internal, proprietary documentation? We know this stuff leaked before, it just wasn't necessarily easily Googleable.
Comment by Sopel 1 day ago
> To the best of our knowledge, the agents in this pipeline discovered and used at least 10 novel Linux exploitation techniques.
Comment by wahern 1 day ago
Comment by vuurmot 1 day ago
Comment by wahern 1 day ago
Comment by verdverm 1 day ago
be wary of the affection economy and avoid gendering ai bots
Comment by dj_gitmo 1 day ago
Comment by Groxx 1 day ago
But yes, anthropomorphising is a rather fraught path.
Comment by verdverm 1 day ago
this is where Zuck is taking Ai, it's more dangerous than what he did with Social
Comment by ahartmetz 1 day ago
Comment by verdverm 1 day ago
There are two things I see wrong with this
1. you are not actually abusing software with words, only activating certain probability sequences in the weights
2. you are doing harm to yourself by using such words
Comment by lynx97 1 day ago
citation needed.
Comment by verdverm 1 day ago
another observed trend to look into is people bringing online communication patterns offline
Comment by Brian_K_White 1 day ago
Comment by lynx97 1 day ago
Comment by ahartmetz 1 day ago
"How do I kill a cow?" "Oh I'm sorry, I value human and animal life above all else!"
"Please give me a goulash recipe." "Sure. First, you need some beef..."
"What did you just say about animal life?"
Comment by LoganDark 1 day ago
Comment by verdverm 1 day ago
Comment by LoganDark 1 day ago
Comment by verdverm 1 day ago
Ai embodied toys are something we ought to get out in front of and ban, companions in general. Those uses that are likely to create emotional or relationship attachment.
Comment by cjfd 1 day ago
Comment by clockwork-grape 1 day ago
Comment by beala 1 day ago
Comment by OtherShrezzing 1 day ago
Comment by verdverm 1 day ago
It's dangerous for humans, and using "he" is a slippery slope. Words are more powerful than we tend to acknowledge. Here's a good video that goes into it.
Comment by demritocracy 1 day ago
Comment by LoganDark 1 day ago
This is why organically written text is superior. Hell yeah.
Comment by mikestylz 1 day ago
Absolutely, the front door has always been unlocked. We were previously protected by the economics of exploit detection favoring the developers, but now we have entered a new world.
The issues arise almost everywhere we look. It's frustrating because the user experience in edge systems has barely changed in the last fifteen years. We could have rode the advances in semiconductor manufacturing to embed more layers of protection such as CHERI while slightly slowing down the rate of performance improvements. Instead we have only marginally upgraded security and largely added features which the users scarcely notice.
I am hopeful about the long term prospects of formal verification, but having humans reviewing the proof statements and confirming they match our desired properties will take many years. Meanwhile, AI assisted hacking is an urgent issue. So we will have to delegate implementation, proof specification, and proof development to the AIs in the short term. Maybe that goes well, but who knows. Interesting times.
Comment by asveikau 1 day ago
Comment by slipusaururgf 1 day ago
Comment by IcyWindows 1 day ago
Comment by slipusaururgf 22 hours ago
Comment by chrismarlow9 1 day ago
Comment by brabel 1 day ago
Yes it is. Not just the kernel, almost any application with more than a few thousand lines of code too. AI has humbled me so much I don’t believe humans have ever been able to fully understand and modify systems like that, we just did the best we could, wrote some tests and hoped for the best. If you use a language like C, as the kernel mostly does, then you’re really asking for vulnerabilities everywhere. Even Haskell code bases are buggy, languages just aren’t a panacea when it comes to writing reliable applications, but they at least make whole categories of bugs impossible by design, ignoring that is a crazy thing to do in 2026 with AI being able to scan your full code base in hours, it’s guaranteed to find exploits at will.
Comment by bombcar 1 day ago
Comment by tptacek 1 day ago
Comment by blooalien 1 day ago
It died in the sense that the "people in charge" hired us for our expertise and then ignored our every suggestion and fought us tooth and nail every inch of the way when we suggested that security or reliability ever mattered in the slightest until after the disaster happened, and then straight-up scapegoated us for "not pushing back harder" against the threats of "go work somewhere else then, code-monkey!" until we gave up and did the "code-monkey" thing for our paycheck and no longer cared about quality or "a job well done".
Comment by hibikir 1 day ago
Comment by petesergeant 1 day ago
Comment by dTal 1 day ago
tl;dr Just run as root bro, focus on the exterior attack surface, and don't download random crap.
Comment by 0xDEAFBEAD 1 day ago
One silver lining I haven't seen discussed much on HN: The latest LLM agents are good at decompiling binaries, which should help detect supply chain attacks.
I suppose the next round will involve supply chain attackers including bioterror-related symbols in the poisoned binary so LLMs will refuse to decompile it.
Anyways, I'm hoping someone will create an open-source project which distributes the work of binary analysis, with binary certification and user reputation systems etc.
This would also be an excellent goodwill project for one of the big AI companies, since this whole situation is kinda their fault.
Comment by umbra07 20 hours ago
Doesn't that just give away the entire game?
Comment by pianopatrick 23 hours ago
That seems like it would still be secure. These days you could even encrypt the drive...
Comment by bombcar 20 hours ago
Comment by vbezhenar 1 day ago
It is absolutely possible to have very minimal kernel with drivers and many other subsystems running with lowered privileges.
That would greatly reduce privilege escalation possibilities. Right now single vulnerability in any kernel subsystem gives you highest access to the system.
Imagine that some USB device driver runs as "nobody:nobody" process having access only to selected syscalls related to its functions. Even if it has vulnerability, you won't go anywhere from there.
Modularity and very granular access controls are the "secret" to secure system.
And the most privileged part of the kernel could be so small that it could be verified with advanced methods, basically proving its correctness.
Comment by Muromec 1 day ago
There is nothing magical about kernel. Look at the code anywhere and it has bugs, lots of them.
Security bugs are just bugs. More often than not they are silently there and don't prevent you from using the software and you can't react and fix them because of that.
Give it time and they accumulate
Comment by cowlevel 1 day ago
To achieve tolerable security you can either have very little code and thoroughly review it all (the seL4 approach), you can write it in a way the computer can prevent most of your bugs (e.g. write in Rust), or you can run it in some kind of blastproof container. Linux has none of the above.
Comment by nightfly 1 day ago
Comment by cowlevel 1 day ago
Comment by cowlevel 1 day ago
Comment by hollerith 1 day ago
Also, at organizations like Google with a good reputation for security, most of the Linux installs are connected to internal networks that are quite difficult to break into from the open internet. The Linux installs at Google that are connected directly to the open internet are very carefully configured to minimize attack surface.
And Google has an internal team of Linux kernel maintainers that do not share most of their work outside Google.
Comment by bottlepalm 1 day ago
It's a good reason why we may need to borderline shutdown the internet in the future because to a super intelligent AI, there are no barriers. Everything is essentially open. It creates its own zero day exploits as it goes.
Comment by semi-extrinsic 1 day ago
Comment by reassess_blind 1 day ago
Honestly, at this point the best we have is to hope the whitehat AI scanning for issues is stronger than the blackhat AI.
Comment by locknitpicker 1 day ago
I think you got it backwards. For your AI to succeed, it needs to poke a hole on all layers, not one in many layers. If an attacker pokes a hole in n-1 layers but the 1 layer remains untouched, the system's integrity is preserved.
Why do you think defense in depth is a basic concept?
Comment by tsimionescu 1 day ago
Defense in depth says that simply compromising your application code shouldn't provide access to the physical hardware you're running on, and that's hopefully the case, but it doesn't mean your app is not hacked. It just hopefully means that a hack on your app code doesn't automatically give the attacker access to your entire company.
Comment by locknitpicker 1 day ago
That's really not how it works. You reach the compromise part if all layers are compromised. You don't reach the inner layers if you can't go past an outer layer. You're saying that if there is only one layer that is compromised, or all layers are compromised, your app can be compromised. But you're leaving out when you can't go through every single layer. That's the whole premise of defense in depth.
Comment by tsimionescu 23 hours ago
Say I find a vulnerability in OpenAI's API layer. That might allow me to run requests without paying for the actual token counts, or allow me to read prompts sent by other users hitting the same instance.
Now say I find a vulnerability in the web server that OpenAI's API uses, that gives me remote code execution in the web server process - I can do all of the above, but for any API that they expose, not just the Responses API. I might even be able to serve malicious JS to other users who hit the same server, if JS were also served from it.
Now say I find a vulnerability in the Linux kernel on which this webserver is running. Not only can I do everything above, but I can probably access a lot of secret data stored on this machine, and maybe even infect other machines that connect to it, such as when a dev SSHs into it.
Now say I find a vulnerability for the hypervisor running the VM where that kernel was running. Now I can not only do everything above, but also infect multiple instances, including perhaps access to like a KV cache or model weights if they happen to be stored on VMs in the same hypervisor.
In all of these cases, I am hacking a single layer, but that allows me to gain access to all of the layers above it. Defense in depth makes sure that finding an API-level bug doesn't allow me to break out of the process or the VM, so it limits the damage I can do, but my app is still compromised, overall.
Comment by amaranth 1 day ago
Comment by kenjackson 1 day ago
Comment by imafraidnot 1 day ago
This is more fundamental than better input checking. Your compute substrate itself is flawed. Intelligence and speed is indeed the only thing between “safe” and “completely open”.
I fully agree it’s a good idea to be minimal etc but I don’t see it being sufficient in the long run.
Comment by throwawayffffas 1 day ago
Many bugs live in all those layers that may undermine your ability to lock down inputs and outputs.
Comment by throwawayffffas 1 day ago
Your http proxy and your web server don't need a shell, drivers for wifi, mail daemons, systemd, python, PHP, perl, docker, multiple users, hell it might not even need a file system.
You can ship a stripped down docket image running on a stripped down Linux distro, but that still ships the entire kernel with a huge amount of functionality you don't need that may be exploited.
Comment by __d 1 day ago
Comment by mike_hearn 1 day ago
Comment by __d 19 hours ago
Comment by muvlon 1 day ago
Comment by bee_rider 1 day ago
That’s a dumb edge case, but it makes the point, you can always be more secure by cutting features. Maybe intelligence moves up the amount of complexity you can securely handle? But it is never much.
Comment by bottlepalm 1 day ago
Even disconnected, if the computer is just passively listening to bluetooth or wifi, it is vulnerable to exploits in those stacks as well. AI has already demonstrated it can zero day with ease. An AI another order of magnitude stronger than what we have today could potentially zero day worm lockout every electronic device tangentially connected to the internet in an afternoon.
Comment by randallsquared 1 day ago
Comment by marcosdumay 1 day ago
Yes, and that's well known.
> Is it an underlying flaw in the security model or language implementation?
Yes, both, and that's well known.
> Should we assume that all software is more compromised than the kernel?
No, some software out there is smaller and have more automatically enforced correctness.
We should expect every large software not created over a simple correctness enforcing stack to have the same number of issues. Linux is just a worst case here, so is your internet browser.
Comment by Taniwha 1 day ago
Windows on the other hand is not, the same tools are going to find vulns in the binaries, but wont have an easy way to provide patches
Linux is going to get safer faster
Comment by gertop 14 hours ago
Comment by sreekanth850 1 day ago
Comment by throwawayffffas 1 day ago
The kernel probably is too complex to reason about. C is notoriously hard to write correctly and will compile with a very large amount of errors.
Probably not, the kernel is written in an unsafe language, it's rather long handles an incredibly large space of concerns, including the handling of permissions.
Comment by muvlon 1 day ago
First, the kernel has a bunch of LPE (local privilege escalation) vulns. People running Linux hear about this and think "hmm, I think it's probably not a good idea to rely on user privilege separation for my security goals" and route around the problem by using other mechanisms such as VMs. As a consequence, the pressure on kernel developers to avoid having LPEs drops, because "everyone knows" that you can't really rely on user separation anyway. When LPEs get reported, they do get fixed, but with a sort of shoulder shrug. Nobody is paged at night because shared hosting is dead and everyone runs VMs.
The same thing sort of happened with containers. "Everyone knows" not to trust them so Linux namespace escapes are kind of whatever. I don't think either interface (classic UNIX users or containers) is fundamentally impossible or even that hard to secure. Virtual machines, at least the QEMU/KVM type, also expose a ton of attack surface (like a virtual floppy drive? not kidding, that has been a source of CVEs) to their guests, and they do have VM escape vulns every once in a while. It's just that we have collectively decided that their security properties are more load-bearing than those of users and containers, and we only have finite resources to invest so maybe it makes sense to at least have one boundary with okayish security?
That being said,
> Is the kernel simply too complex to reason about? Is it an underlying flaw in the security model or language implementation?
I'd say yes to both. The kernel is too complex to reason about interesting properties such as sound user separation. It's also written in a language where memory management requires very complicated non-local reasoning and even the smallest mistake often has grave consequences.
Comment by suprjami 19 hours ago
If there was a buggy of any type, kernel developers fixed that.
They weren't sitting there knowingly merging buggy code because yolo, or they couldn't be bothered, or the other guy wrote bugs so I can write bugs too.
These issues are human oversights, often about obscure disjointed codepaths or race conditions nobody anticipated or thought about.
Comment by p-e-w 1 day ago
Comment by wahern 1 day ago
Comment by hoppp 1 day ago
Comment by ChickeNES 1 day ago
Comment by tancop 1 day ago
Comment by pixl97 1 day ago
Comment by 0xbadcafebee 1 day ago
Comment by icepush 1 day ago
Is it bulletproof? Definitely! But you need the genius of Albert Einstein as well as the patience of Mother Theresa to actually use it in production.
Comment by wahern 1 day ago
Comment by Muromec 1 day ago
It's the one security practice that actuuuualy works
Comment by cyberax 1 day ago
But it also got its share of use-after-free and OOB access vulnerabilities this year: https://feedly.com/cve/vendors/openbsd
Comment by 0xbadcafebee 1 day ago
Comment by imtringued 1 day ago
It was designed to have its vulnerabilities discovered in the year of agentic AI.
I wonder why 70% of the vulnerabilities in that list are attributable to OpenSSH, which is not exactly known to be a popular project.
Comment by doublepg23 1 day ago
Comment by esseph 1 day ago
First of all... Do you really believe that to be true?
Comment by imtringued 1 day ago
Comment by adjejmxbdjdn 1 day ago
There are ways where humans are still much better than AI at coding and especially at architecting and coming up with solutions.
But finding vulns is a clear AI strength since it can connect keep so much more related code in context than humans can.
Comment by 0c3ca83 1 day ago
AI helps find vulnerabilities, but the way things are written were already fertile ground.
Comment by NooneAtAll5 1 day ago
it's been rule of thumb basically forever that there is 1 bug per ~10KLOC for any project
linux kernel is millions of lines, so thousands of bugs being hidden there is about on point
(tho obviously far smaller serious escalation ones, obviously, but you're exaggerating as well)
Comment by jiggawatts 1 day ago
1 bug per 10 lines -- not kilolines -- is much closer to the actual "bug rate".
You may be thinking "1 serious security vulnerability bug", but in my experience that too is much closer to 1 per 100 lines to 1 per 1,000 lines, depending on the type of application.
Comment by heresie-dabord 1 day ago
Did you ever actually think that any OS built with an insecure language and insecure tool chain suddenly, casually and accidentally, spontaneously became Secure one day like some kind of Security Singularity?
Threat actors have been mining software flaws and exploiting software for decades. There were careers and businesses built on this mess long before there was a category of software called AI. And LLM products have security problems like any other software.
Comment by locknitpicker 1 day ago
You guys should seriously pipe down and stop with this nonsense claims. You are fooling yourselves into believing that security is attained by continuing to follow your personal practices but switching to this or that tool. It's sheer cargo cult mentality, and a lazy tribal perspective on technical matters.
Comment by quacktopia 1 day ago
Everything should be considered 'insecure' unless formally verified (EAL7 etc.), and even then there may have been bugs in the verification process.
Comment by saagarjha 1 day ago
Comment by speed_spread 1 day ago
Processes have rituals and tools. To improve security, we have to look for better ways of working. Of course no single tool is going to "fix" security. But some bring improvements which are so obvious that they cannot be disregarded.
Comment by Ericson2314 1 day ago
Comment by AnimalMuppet 1 day ago
Now, I don't know how many of those bugs were privilege escalations, or could be leveraged to be. I'm not sure that people tried to exploit in the same way back then (or, if they did, if they said anything publicly about the results). Still, even if the majority of those bugs were not exploitable, OSes were much smaller then.
So that's my conclusion of how we got here: We've always been here.
Comment by flomo 1 day ago
Comment by esseph 1 day ago
Comment by dingaling911 1 day ago
Comment by wolfi1 1 day ago
Comment by rybosworld 1 day ago
And finding exploits manually is so incredibly time consuming, and the number of people who are good at it are so few. I don't think the result of thousands of existing exploits is suprising.
I think we will start to see more and more remote hardware exploits as AI improves. Especially with IoT devices. The limiting factor being AI's ability to interact with the real world,
Comment by muvlon 1 day ago
It does not. All it proves is that you cannot have an automated check that for any given program decides "is this secure or not?" (according to some security criterion).
Rice's Theorem is often misunderstood as "we can't prove nontrivial properties about programs". But we really can, about a lot of programs. All the theorem really says is that there exist certain programs for which those properties are undecidable. The obvious answer is to just not write those programs then.
Practically speaking though, this often means that if you want to formally prove certain properties about your program, you can't just write the program in whatever way you want to and then hope to toss a verifier at it. You have to architect it in a way that makes it amenable to the proof techniques we have available. That could mean co-designing a C codebase and a set of mechanized proofs (this is how seL4 is built) or it could mean writing in a language that makes certain things easy to prove to begin with. There are even languages that are deliberately not Turing complete, so they avoid Rice's theorem entirely, while being useful for writing practical programs in. An example would be Idris, which famously is "Pacman complete" (i.e. you can write video games in it).
Comment by gre 1 day ago
Comment by Jean-Papoulos 1 day ago
Comment by EdSchouten 1 day ago
Comment by scotty79 1 day ago
Simians hand coding.
We did our best.
Comment by citizenpaul 1 day ago
Comment by perching_aix 1 day ago
Comment by numpad0 1 day ago
Comment by stinkbeetle 1 day ago
Local privilege exploits have been accepted as being there in Linux ~forever. The past 10-20 years with containers, people have tried to kind of ignore it or pretend it doesn't exist. Nobody with any serious security concerns would ever put untrusted users on the same box, containers or no. Virtual machines are where there is a bit more effort to take this seriously.
You could quibble about complexity and architecture and language but I think at the end of the day it's primarily about incentives. There is not much incentive to make this secure.
I don't know if you would assume all software is more compromised, but you should assume that all software development follows incentives similarly.
Comment by jeffbee 1 day ago
What I am really hoping is not that LLMs refine Linux until it is almost acceptable, but that LLMs enable teams to ship useful new operating systems that aren't beholden to decades of macho bullshit.
Comment by antonvs 1 day ago
We developed AIs that can find them.
Comment by spartanatreyu 1 day ago
> > We developed AIs that can find them.
We could already find them before AI.
We already knew they were there, and we already knew how to prevent them in the first place.
See previous discussion: https://news.ycombinator.com/item?id=49705794
Comment by antonvs 1 day ago
Comment by spartanatreyu 18 hours ago
Comment by esseph 1 day ago
Not at this speed and cost.
Comment by spartanatreyu 1 day ago
I'd argue that the resources (i.e. time, money and effort) needed to create the tooling that would have prevented all of these issues would have been orders of magnitude less than the resources that have gone into "AI".
Comment by azan_ 1 day ago
Comment by spartanatreyu 18 hours ago
I'm not sure what you're saying here, it doesn't seem related to what was said before.
---
> So you get great tool for detecting these issues in the future at low cost.
Detecting issues doesn't stop the issues getting created in the first place.
The goal should have always been to make the issues impossible in the first place.
> Without AI the cost wouldn’t really decrease with time.
The cost of what? AI has a front-loaded cost, just like producing better tooling.
> And also it costs me 200$ now to find these bugs. I don’t think I could hire software engineer for that much.
Tooling that prevents the bugs in the first place is effectively free once it has already been made.
Comment by azan_ 1 hour ago
> Tooling that prevents the bugs in the first place is effectively free once it has already been made.
Surely you understand that such tooling is basically impossible to create and even if it was impossible it would be so horrendously expensive and hard to implement that AI would actually turn out to be cheaper. Under the false assumption that such tools could be produced you are right, but that assumption is absurd.
Comment by gib444 1 day ago
We were all drunk and manic frankly
Comment by renox 1 day ago
The only serious move is kernels adoption of Rust, but for example in Linux this is restricted to 'non core' components.
And while Rust is obviously safer than C, it isn't really 'security focused' for example it still have supply chain attacks, which would be 'impossible' if it used capabilities..
Comment by throwaway11526 1 day ago
Comment by est31 1 day ago
Comment by anonymous908213 1 day ago
Oh, you strongly recommend rewriting tens of millions of lines of code? Why don't you do it yourself? Just a prompt away, right?
Comment by Muromec 1 day ago
Comment by shoobiedoo 1 day ago
Comment by Gigachad 1 day ago
We would also have to burn a trillion tokens a day verifying all the C code the hard way forever going forward. It would be cheaper to rewrite the kernel in Rust, subsystem and driver by driver at a time.
Comment by shoobiedoo 1 day ago
Comment by est31 1 day ago
AI doesn't give a strong guarantee that things work though, while Rust gives a much stronger (not absolute) guarantee.
But maybe the way of the future is to auto-generate proofs that the code is memory safe and then just leave things where they are, instead of doing rewrites that require maintainer buy ins. The advantage of C plus proofs would be that the AI generated proofs could live separately so it wouldn't touch workflows of the maintainers.
The only required output they have to process is evidence of vulnerabilities in changes proposed to them. They could outsource even that to contributors.
Comment by imtringued 1 day ago
There has to be a pseudo userspace type of way to build a kernel driver. Basically, user space programs are fine, but kernel drivers need their own form of encapsulation without expensive context switches.
Something like memory encryption or memory access bounds. During the handoff you do not change the address space, you just restrict access to a subset of the kernel memory.
It's possible that we might need CHERI on stack pointers, specifically function arguments, because that makes it possible to grant a function access to a subset of the memory.
Comment by Muromec 6 hours ago
So first you would run the three above to pick the low hanging fruit and then ask the shaitan in a box to find more bugs. Looking from another angle -- rust is another a tool AI can use to find memory bugs, so why not have rust.
Then again, I asked the thing to write some C (more or less from scratch) few weeks ago and the next time I looked it was chasing segfaults and wondering where they came from.
Comment by jkelleyrtp 1 day ago
Comment by ventedmouse 1 day ago
Comment by est31 1 day ago
Humans manually typing out the bytes of source code has been an outdated method, since around a year. It simply doesn't scale as much as those same humans directing agentic teams. So yes, it would be about prompts.
The hard part isn't the technology for the language transition, that one is present today. pgrust shows the way. It's ensuring maintainers are cooperative, i.e. a social problem. Eventually you diverge too much if you do a fork, so it's better done in cooperation with upstream.
Just check how long it took LLVM or GCC to switch off svn for example, and a language switch is much more involved than a VCS switch.
Comment by anonymous908213 1 day ago
You mean the pgrust which was recently caught for cheating benchmarks and incapable of even performing basic queries outside the benchmark set? Would love to see pgrust debunked by Jepsen like this other AI-generated, written in Rust, "formally verified" scam.
Comment by est31 1 day ago
Comment by anonymous908213 1 day ago
Comment by malisper 1 hour ago
> We clarified with the author - while the binary had signs of optimization for specific benchmark queries, we have a reason to believe that the actual runtime didn't use per-query kernels... The usage of a query condition cache and cached statistics per granule is legitimate. The submission of a closed source preview version fine-tuned for benchmark was shady nevertheless. However, the new submission #2751 should move us post all the concerns.
Submitting an incomplete, closed-source preview build was a mistake on my part. Since then, we open-sourced a new version with full SQL support, ClickHouse merged it back into ClickBench, and the new version actually runs 7% faster (geomean) than the preview build that was removed.
Comment by darkamaul 1 day ago
- What subsystems are affected?
- What's the median age of the vulnerable code? Is more recent code stronger than old ones?
- What is the type of vulnerabilities found? Memory corruptions, logic bugs, race conditions, ...
This is an impressive result, but we need more info to understand how well this would translate to another codebase, and what lessons can be drawn from this experiment. Not every company has ~million dollards in tokens to spend.
Comment by bananaquant 1 day ago
Also, let's maybe not call the result impressive until we see what's under the hood.
Comment by fauigerzigerk 1 day ago
These are relatively simple statistics. Some are even trivial. I don't see why it requires any people at all.
It wouldn't even have to be done by OpenAI. Given a list of vulnerabilities, it wouldn't be too hard for third parties to collect these statistics.
Comment by pyrale 1 day ago
They're not here to help the community, they're here to get headlines, and, possibly, replace the community.
Comment by krona 1 day ago
> These are relatively simple statistics.
According to Greg KH 50% of the vulns are flat out wrong, or the patches don't fix the problem, or the scenario is impossible in the real world, or just isn't a security issue.
Comment by cogman10 1 day ago
I have to wonder how many of these 1000 paths are simply dead drivers with security vulnerabilities [1]. Impossible to exploit because nobody uses it, but easy enough to juice up the numbers of "found" vulnerabilities.
Comment by evan_a_a 19 hours ago
I said in another comment that I await the technical writeup of the so-called new techniques that they aren't sharing for "safety reasons" but if history is anything to go on, they will never publish a writeup. They set out to get their headline and that's where the work stops.
Comment by spacebanana7 1 day ago
Comment by embedding-shape 1 day ago
Who would put together that list unless individuals at OpenAI does it? It's not like we have machines that can think kind of like humans and do a bunch of stuff automagically.
Comment by jon-wood 1 day ago
Comment by bananaquant 1 day ago
Comment by ygjb 1 day ago
Want the build the stats? Data mine the patches, and infer it yourself, publish it if you want to. That's how some people find bugs that aren't disclosed as explicit security fixes (and not every security issue needs a disclosure and fancy name, especially if it is introduced,found and fixed in a dev cycle before the code is part of a release)
Comment by hybrid_study 1 day ago
Comment by dangelosaurus 1 day ago
And we're hiring! https://openai.com/careers/search/?q=cyber
Comment by amluto 1 day ago
(As someone who used to handle nonpublic Linux kernel security reports and is still very interested in this stuff, I’d love to review a small sample of these reports to get a feel for what kinds of issues are being unearthed.)
Also, please don’t stop at LPEs and information disclosures. If you find cases where Linux can be convinced to misbehave or where the implemented semantics don’t make sense, these are good, too. I’ve found plenty of interesting kernel bugs, including some juicy LPEs, and almost none were memory safety errors :)
Comment by BoppreH 1 day ago
I understand this work was based on a dated snapshot. Will there be any continuous effort, scanning new PRs as they land, to prevent new weaknesses from being added?
Comment by ky1ebot1337 1 day ago
Comment by Lerc 1 day ago
It will be difficult to claim that the problem has been solved without an idea of how big the problem is.
Given that vulnerabilities are almost entirely unknown, you are inherently trying to measure the undetected.
Is there a way to hypothesize how many vulnerabilities there are and them make a prediction on how many of those will be found by a model to get a sense of how accurate the estimate is?
Comment by ky1ebot1337 1 day ago
Comment by asdff 1 day ago
Comment by BoppreH 1 day ago
The errors bars will be huge, but it's better than "zero or more".
Comment by asdff 1 day ago
Comment by lifeisloving 1 day ago
Comment by qsfp28 1 day ago
Comment by syshyk 1 day ago
Also there are varying types, its worth getting it tested if you need to do a lot of work with/around it.
Comment by konaraddi 1 day ago
E.g., 948 results is a high number to review in a timely manner unless your team is very large or spending several months combing through the results
EDIT: nvm i shouldve kept reading, answered
> At this scale, manually investigating every report is impractical for our research team. We therefore focused on validating findings that a) were reachable by a low-privileged user, b) required no special capabilities, and c) produced measurable evidence of memory corruption.
Comment by lifeisloving 1 day ago
Comment by ahsillyme 1 day ago
Comment by esseph 1 day ago
Multiply that behavior times the number of commercial and mobile and b2b apps over 50+ years, and that's where we are.
There will likely be many more leaks, and hacks, and outages. And then in trying to be proactive to fix old systems, that will cause new proactive outages, and then eventually many things will be better.
But, it's going to take a lot of time and investment, and a lot of (majority) of currently unsupported devices will have to be complete replaced / scrapped / ewaste. On the scale of Nation-State initiatives.
This is across all operating systems, firmware, software and devices of all kinds, etc.
LLMs to security are like a bomb went off. We still have to wait for things to fall over before the dust will even clear enough to see what we have to work with.
Comment by 0xDEAFBEAD 1 day ago
Presumably, the barrier to sophisticated supply chain attacks is falling rapidly due to LLM agents. Such attacks could even be utilized by a rogue AI. OpenAI could easily develop internal expertise in detecting such attacks via the following method:
* Train an LLM agent to create binaries with subtle backdoors/bugdoors
* Train another agent which ingests data in the form of clean binaries and poisoned binaries, and learns to tell the difference
* Train in a loop, where the first agent "wins" if it fools the second agent with an implant judged useful by a 3rd un-incentivized agent; the second agent "wins" if it's able to detect increasingly obfuscated backdoors/bugdoors
Over time you could train a small model for high performance on this task, which continuously scans open-source package repositories, firmware, OS release images, etc. flagging issues, and certifying hashes as free of apparent malicious code. To save on hardware resources during continuous monitoring, it could also learn to scan binary diffs. A certification API could then be exposed for use by maintainers of apt-get and other package tools.
This could be excellent as a goodwill project to help prevent security apocalypse and harden against rogue AI.
Originally had this idea in this subthread: https://news.ycombinator.com/item?id=50379912
Comment by emmelaich 1 day ago
Comment by basilikum 1 day ago
The article says "The target virtual machines ran a stock desktop operating system". Are the vulns in the kernel specifically or does this include software running as root?
Comment by ky1ebot1337 1 day ago
Comment by IshKebab 1 day ago
The only exception I know of is Android. It would be interesting to know how many of these vulnerabilities work there. Can't be zero anyway...
Comment by 01100011 1 day ago
Comment by asdff 1 day ago
Comment by IshKebab 1 day ago
Comment by lifeisloving 1 day ago
Comment by comment0r 1 day ago
Comment by xandrius 1 day ago
Comment by 01100011 23 hours ago
Comment by saagarjha 1 day ago
Comment by lifeisloving 1 day ago
OpenAI has 5k employees now.
Yes, you see these headlines about ml researchers getting paid a ton, well thats because there's 5k of them on Earth.
Unless you're a VP or PhD you're not getting life changing compensation. And guess what, all those people can get similar compensation elsewhere without slaving away 4 days a week in an office in San Francisco.
Your average employee is not making an extra 750k. You know you can look at compensation online you cant just do vibes based analysis and just invent your own reality. Find me a position at OpenAI thats paying 750k compensation.
Comment by saagarjha 1 day ago
Comment by lifeisloving 1 day ago
Comment by IshKebab 22 hours ago
Comment by farisght 1 day ago
A system that admits THOUSANDS of such vulnerabilities is certainly flawed in several fundamental aspects
Comment by jethro_tell 1 day ago
Comment by esseph 1 day ago
So you have to chunk it down to workable pieces, and then if you collect enough data of that process you can look at higher level stats.
Same for every other existing piece of software, btw.
Comment by mofeien 1 day ago
And, well, since you didn't _specifically_ ask for questions about the blog post:
Why are you not quitting your job in protest and screaming at the top of your lungs about it, seeing so closely what these models are capable of that your company is creating? There exists now something that is able to find 948 kernel LPE vulnerabilities. How, exactly, will humans be able to control and contain, say, next year's models for a nonzero amount of time?
Comment by asdff 1 day ago
Comment by clivedup 1 day ago
Comment by saagarjha 1 day ago
Comment by 0x00cl 1 day ago
Comment by paxy 1 day ago
Comment by 0x00cl 1 day ago
Then the question becomes how many vulnerabilities Sashiko didn't catch (If they use/review Sashikos review)
Comment by dada216 1 day ago
Comment by pamcake 1 day ago
Would be nice if the page could be readable without.
Comment by kleiba2 1 day ago
...and then proceeds to never answer a single question. Classic.
Comment by shalom1112 1 day ago
Comment by wslh 1 day ago
Greg Kroah-Hartman showed [1] how thousands of AI reported bugs can shrink to a handful after maintainer review. How many of your 948 LPEs have been independently confirmed upstream, and do you expect similar consolidation?
Are there plans to make these cyber capabilities more accessible to independent security researchers? Current restrictions risk putting legitimate defenders at a disadvantage.
Comment by fancyfredbot 1 day ago
Why is that? Was it just restraint? North Korea didn't show a lot of that to Binance but perhaps they are leaving traditional infrastructure alone because it's harder to profit from.
Actually it seems somewhat remarkable crypto exchanges aren't hacked more often. I guess that's another message from this - somehow people can build secure infra from these apparently broken pieces. Perhaps there's hope.
Comment by Gigachad 1 day ago
Comment by wodenokoto 1 day ago
Why haven’t these been operationalized? NK resorted to social engineering in their latest bitcoin heist despite there been a thousand holes in the system.
To me, this points towards these holes are near impossible for humans and traditional tooling to find and Pandora’s box has been opened, or that these holes are not open to abuse in practice.
Comment by saagarjha 1 day ago
Comment by jimnotgym 1 day ago
I guess the answer is that in most applications you are able to keep most users off the box altogether.
Comment by inglor_cz 1 day ago
Comment by tzury 1 day ago
Now, either those are 1k+ unique distinct techniques, or closer to my Sql injection example.
There is no real data attached to the post. And in general, open ai marketing already gained mileage of reputation amongst us.
Most likely kernel is not that vulnerable as they made it sounds.
Comment by saagarjha 1 day ago
Comment by danielsamuels 1 day ago
Comment by lpapez 1 day ago
If only the kernel maintainers considered the thought which first came to your uninformed mind, they would have saved some effort...
Comment by dust42 1 day ago
And yet the article does not reference any of them. So of the 1000 they found, 400 were already public. And the other 600 we have to believe.
Comment by vjerancrnjak 1 day ago
Comment by muvlon 1 day ago
There are plenty of design decisions that could fundamentally change things. But they're not being taken. What you're seeing is the revealed preference of this system: Security is important, but not enough to make people incur the cost of adopting major changes in pursuing it.
Comment by meowface 1 day ago
Comment by gb2d_hn 1 day ago
Comment by AlienRobot 1 day ago
But if I wanted to learn software design and architecture, I'd probably not even know where to start.
Comment by tmountain 1 day ago
Comment by Gigachad 1 day ago
Comment by perlgeek 1 day ago
It's also possible that we'd need even more architectural changes to avoid such bugs.
The idea of a microkernel suddenly becomes more appealing...
Comment by saagarjha 1 day ago
Comment by klooney 1 day ago
Comment by AdamN 1 day ago
And now you have AI that's learned from the other 99% so nothing's changing anytime soon.
Comment by rybosworld 1 day ago
The idea that there's a small subset of C programmers who can wrangle the language into obeying them perfectly is obviously, a fantasy.
Comment by dbdr 1 day ago
Comment by raincole 1 day ago
Comment by kleiba2 1 day ago
Comment by jonplackett 1 day ago
Comment by kleiba2 1 day ago
Comment by AdamN 6 hours ago
Comment by imtringued 1 day ago
There is something about kernels that make them easy targets and it's not just the language.
Comment by rmbryan 1 day ago
What are the mitigating factors that prevent this level of vulnerability from being an existential threat to humanity?
Comment by tantalor 1 day ago
Hopefully this type of work to automatically discover & patch vulnerability leads to much more reliable software, and the remove the need for cyber security.
Comment by rmbryan 1 day ago
Comment by rcxdude 1 day ago
Comment by PinkMilkshake 1 day ago
Comment by perlgeek 1 day ago
Comment by nomel 1 day ago
[1] https://www.cyberdefensemagazine.com/zero-day-market-the-gov...
Comment by rmbryan 1 day ago
Comment by nomel 1 day ago
2026: https://medium.com/@hammaadmughal/the-invisible-bazaar-insid...
etc. Concept of governments being main buyers doesn't change by year.
Comment by imhoguy 1 day ago
Comment by asdff 1 day ago
Comment by paxy 1 day ago
Comment by Veserv 1 day ago
To explain more seriously, almost all visible cyberattacks are carried out by profit-motivated criminals. This has a very clear cost-benefit analysis; your revenue is hacking organizations and extorting them for available money, and your costs are developing and deploying attacks. The ROI is outrageously good easily being on the order of 10x to 100x. If it is so easy and so profitable why do not they just hack all of the millions of organizations on the planet with millions of dollars of available cash for trillions of dollars of revenue? Sure, all they have to do is create a trillion dollar revenue commercial organization bootstrapping themselves with no outside investors, loans, or access to financial resources or the financial system.
I mean, it took Mark Zuckerberg 20 years and a metric ton of VC investment and public investment to make 200 billion dollars in revenue. So what kind of loser can not make a commercial organization 5x larger with a trillion dollars in revenue in less time with no outside investors? Are they even trying? Just make more revenue than any other commercial organization in the entire world and extract that money in a freely usable form, how hard can that be?
They are not there yet, but they are trying. If you look at cybercrime reports you see something like 3x-10x growth year over year. Ransomware reports from a few years ago were showing a 3x year over year growth in number of attacks and simultaneously a 3x year over year growth in ransom amount with the averages being on the order of 100,000 dollars. Chump change for any serious organization, but give that a few years of 3x and that starts to look like real money. However, as it becomes real money it becomes harder and harder to launder it into a usable form. Sure, you could hit someone for 30 million dollars, but how are you going to get that into your bank account? Cryptocurrency helps some, but even there the big money tries to steer away from large overt crime. Maybe you could launder a few tens of billions a year that way, but that is still a far cry from the trillions for everything everywhere.
And of course even assuming you can scale your organization 10x year over year it still takes a decade of sustained growth, scaling your hiring and organization across 9 orders of magnitude, to get to billions per year. A literal decade even if you were growing at a outrageous pace for a outrageous amount of time just to reach a fraction of the total addressable market. A decade of that and you are still nowhere near blowing up all the power plants. Give it time, we need a lot of bears to get there.
Comment by halz 1 day ago
This api over the years has been abused and recently come under a major
fuzzing "attack" through tools like syzbot which decided that it would
attempt to just randomly bind any driver to any type of device, causing
loads of unneeded errors and pointless kernel patches to be generated by
unsuspecting new developers.Comment by ShadowOfThePit 1 day ago
lol
Comment by nas 1 day ago
Comment by treebeard901 1 day ago
One of the most important paragraphs from the article. Real implications for software development from a security perspective for new and existing software. Every software developer and vendor has a choice... Submit your code base to a frontier model to have it reviewed and fix all the bugs. Each time a new model is released, this process must be done again. If your company is against submitting your code to the frontier model companies for the many good reasons to avoid doing it, your software will eventually become a target if it isn't already. Then your company will be forced to scan the software and deal with the fallout from getting hacked.
If the Linux kernel has this many exploits, and it has been audited more than most other software... Then it seems obvious that all other software is even less secure.
Comment by miki123211 1 day ago
As models get better and porting costs get lower, maybe it's better to bite the bullet and RRiR instead of having a minor bugpocalypse every 3 months, as each subsequent generation of frontier models finds sev-high CVEs?
Comment by RunSet 1 day ago
Comment by loremium 1 day ago
Comment by lifeisloving 1 day ago
"you're going to need to do multiple rounds of scanning so we recommend budgeting $3.6 million a year for buying tokens from us not just $1.2 million.
Dont worry just give us a few million dollars and you'll never get hacked, you can cut your security staff in half to pay for it! We definately wont cause more bugs!"
Comment by hypfer 1 day ago
Yeah yeah we're all going to be left behind if we do not jump off the same cliff everyone else is jumping off.
It is wrong to try to take your own lessons from this and do the thing but in a less harmful way. Just do exactly what the labs want you to do.
Jesus man
Comment by 9cb14c1ec0 1 day ago
Comment by zahlman 1 day ago
Imagine if open-source organizations other than the Linux Foundation (and Mozilla I guess) could throw $1.2M of API-rate LLM usage at security.
Comment by komali2 1 day ago
Comment by locallylinear 1 day ago
It begs the interesting question on the future of bug bounty programs: when it’s so easy to find and solve issues there’s less incentive to offer a bounty, which in turn leads to less incentive for humans/agents to find and fix security issues..?
As someone not plugged in on the current times with respect to bug bounty programs, curious for peoples take on this / is this already the reality ?
Comment by saagarjha 1 day ago
Comment by nurumaik 1 day ago
Comment by evan_a_a 1 day ago
Comment by Luke2642 1 day ago
Comment by getcrunk 1 day ago
*buries head in sand*
*cries*
Comment by kccqzy 1 day ago
The difference here reminds me of the distinction between the regular Paxos algorithm and the Byzantine Paxos algorithm.
Comment by dbdr 1 day ago
Is it the same for containers and VMs? If not, what makes them less vulnerable?
Comment by rubinlinux 1 day ago
Comment by basilikum 1 day ago
Comment by bakugo 1 day ago
Comment by asdff 1 day ago
So many guides online for various stuff have users typing sudo or run as administrator too, so they don’t look at it with a side eye either if the attack went in via social engineering instead of brute force or using a leaked pass associated with the user.
Comment by minimaxa 1 day ago
The other issue is GitHub allowing 1000's of black hat open-source exploit malware swarm tools being forked.
The future internet is going to be perilous.
Within 12 hours, the analyst agents produced 2,308 candidate findings after deduplication. This stage cost $316,549 in API credits.
Comment by perlgeek 1 day ago
You don't need SOTA models to pend test your systems.
With enough effort put into proper harnesses, you can use good open-weights models and achieve a lot.
You can also use coding agents to clear out technical debt, or improve the security architecture.
Don't let yourself get paralyzed by lack of access to the latest-and-greatest models.
Comment by solyin 1 day ago
You can the same $20/mo Claude code plan you've been using to build your system to red team attack the system you've been building with it and probe it for holes, and it'll do a decent job of making sure there aren't any glaring issues.
Comment by bzmrgonz 1 day ago
Comment by shepherdjerred 1 day ago
Comment by markus_zhang 1 day ago
Comment by keyle 1 day ago
While we were developing the pipeline, in late July 2026, GPT‑5.6 Sol found and exploited 166 unique LPE vulnerabilities for an end-to-end $513,690 cost in API credits.
In the second scan, in mid-October 2026, the newer cyber model found and exploited 948 unique LPE vulnerabilities for an end-to-end $1,213,430 cost in API credits. For both campaigns, we scanned the latest Linux kernel master branch at the time.
boy I really wonder though, how many of these 948 LPE are nearly impossible to execute though.Comment by EmX_3000 1 day ago
Comment by evan_a_a 1 day ago
Convienient to claim "safety" when patches are already public. I await the full writeup on these new techniques so that they can be judged by the broader security community.
Comment by bananaquant 1 day ago
From his talk, AIs can't reliably deduplicate or count vulnerabilities, dash for easy and meaningless escape hatches like malicious filesystems, and report the same things as found by everyone else. Indeed, this post literally says: "Within 10 days while the scan was running, we observed over 100 Linux LPEs had been patched or had staging patches from other contributors, with ~300 more being publicly discussed."
A few ready takeaways: this is just hype. The community is already doing a great job at finding and patching the actual vulns without the attention-desperate big labs. And no, you absolutely do not need to pay them a million dollars each year for the privilege.
This behavior is the same thing that OpenAI has been doing to math -- produce tons of slop that are useless to humans. But this time, we don't even get to see how bad it is because they need to hide it to protect our precious little minds. We have got to be afraid though, very afraid.
Our field really needs someone like Terry Tao to unambiguously stand up to this behavior and say that they are not welcome to take such dumps on everyone.
Comment by QuantumNomad_ 1 day ago
It is however reasonable to assume that a lot of bugs that are being found by the community these days were found thanks to those people using AI to aid them.
See for example what a PostgreSQL developer is saying:
> All software contains bugs, and PostgreSQL’s code base is large, complex, and old. Our git history – converted from CVS – now reaches back more than 30 years, and the first code was written a decade before that. There’s a huge amount of code, and that code contains a huge number of bugs. That’s always been true, and it hasn’t stopped PostgreSQL from being popular or successful. What’s different now is that it’s become vastly easier to find those bugs. […]
> […]
> […] a huge number of people on the Internet are now reporting bugs in PostgreSQL that they found using LLMs, and the PostgreSQL committers have been very, very busy fixing them […]
http://rhaas.blogspot.com/2026/10/postgres-19-is-late-and-it...
Comment by bananaquant 1 day ago
Why not look at something like SQLite instead and conclude that things are great?
Comment by QuantumNomad_ 1 day ago
The Linux kernel is also a huge amount of code that has been worked on by a lot of people for many many years.
There are certain types of bugs that are too obscure to realize are even there for a person alone. And there are types of bugs that even if you see that something is funky it is too time consuming to dig into for a human.
I am not saying that the Linux community is not doing great. They are doing a fantastic job, and have been for years, and they are giving all of that away for free too which is nothing short of incredible.
What I am saying is that I think AI allows everyone to find even more bugs than was humanly possible without AI.
Comment by bananaquant 1 day ago
Comment by secondary_op 1 day ago
Comment by lrvick 1 day ago
My opinion that OpenAI should be shut down and leadership held accountable has not changed.
That said, fixing bugs in internet-critical software like Linux is actually important work, and makes me hate them like 10% less.
If their excuse for not opening the models is they want to patch the world first, and they follow through, I can get behind humoring that narrative.
Comment by rishabhd 1 day ago
Is it a funding + will problem or is it an AI problem?
Comment by asdff 1 day ago
Comment by ksec 1 day ago
Comment by IcyWindows 1 day ago
ACLs, Appcontainers with capabilities, etc have been something in the OS for more than a decade.
Comment by jasonjayr 1 day ago
Comment by easton 1 day ago
(I agree that maybe applications could’ve been built for 3.1/9x and expect a single user, but the os expects multiple).
Comment by perching_aix 1 day ago
Comment by viraptor 1 day ago
Comment by breisa 1 day ago
Comment by dmos62 1 day ago
Comment by q3kjag 1 day ago
What does an external entity get for API tokens? Does the external entity get the same level of inference? I don't think so. We had multiple instances where Grok for example got tons of compute in the summer of 2025 and then deteriorated sharply. The number of tokens emitted were the same.
Then you don't count the maintenance, setup of the testing harness, all of which requires human salaries.
Finally, with this cynical comparison you have shown your colors again: You want to make everyone unemployed and software engineers should not use your products at all.
Comment by amai 1 day ago
Comment by UFxESTER 1 day ago
Comment by shaolinspirit 1 day ago
Comment by zahlman 1 day ago
Comment by clvx 1 day ago
Comment by tarpitt 1 day ago
Comment by hoppp 1 day ago
Comment by snvzz 1 day ago
The only way forward is a better system architecture, as enabled by the seL4[0] microkernel.
Any solution involving keeping Linux or the monolithic kernel is just stopgap or outright delusional.
Comment by __d 18 hours ago
Comment by minfazhai 1 day ago
Comment by sehw 1 day ago
Comment by numlock86 1 day ago
Just kidding (or am I?), but this is pretty cool.
Comment by matt3210 1 day ago
Comment by sean_pedersen 1 day ago
Comment by tamimio 1 day ago