The AI bubble is popping; we just don't know it yet

Posted by Bender 1 hour ago

Counter42Comment59OpenOriginal

Comments

Comment by cmiles8 35 minutes ago

Outside a relatively small world of circular investment and FOMO feeding FOMO the general consensus seems to be “let it burn.”

It appears very unlikely we will ever see an IPO of OpenAI. Anthropic appears less doomed, but still iffy at best. Tons of other large, but little discussed, AI startups are just dead-companies-walking at this point.

The likes of AWS are showing good headline numbers but are taking out massive debt to build infrastructure that looks increasingly unneeded. Those with capacity are looking to offload it, quickly. Yes AWS has “committed contracts” for this capacity but if those commitments are with shaky AI startups then it’s mostly just fluff PR and these hyperscalers will get left holding the bag on all this debt.

Comment by energy123 16 minutes ago

> infrastructure that looks increasingly unneeded

This is the crux that needs to be substantiated. Without substantiation none of your other arguments hold up.

Comment by cmiles8 10 minutes ago

Are you saying people haven’t been throwing unneeded capacity on the market? That is happening.

Frankly it’s the opposite scenario (that’s there’s all this demand) which is struggling for any hard evidence.

Comment by energy123 4 minutes ago

What are you referring to? Discretionary resets of codex/claude weekly quotas on consumer plans?

What I am aware of: the growing revenue numbers of the model providers (which might be slightly stale data), and the increasing prices for on-demand GPU compute (which is not stale data).

Comment by inigyou 24 minutes ago

It's holding up the entire US stock market and therefore the entire US economy and the dollar value. You probably don't want this particular Atlas to shrug.

Comment by cmiles8 13 minutes ago

The “Let it burn” attitude doesn’t mean people think they are immune.

Yes the overall market will take a hit but, like a forest fire we need a healthy burn to just wipe out the weaker players so the older more mature trees can get on with it. Yes the big trees will get burned a bit but they’ll be fine in the long run.

We need a good brush fire to just wipe out all the iffy startups and investors that over-indexed here. Thats what people want with “let it burn.”

Comment by Waterluvian 15 minutes ago

You can’t threaten me with two good times. Long term that would help correct the overemphasis on the U.S. economy and AI.

Comment by theideaofcoffee 16 minutes ago

I do. The faster it happens, the faster a recovery begins and we can devote resources back to doing more practical things. Get it over with as soon as possible, rip the bandaid off, insert your idiom of choice.

Comment by delfinom 22 minutes ago

It's inevitable though. The funny-money has outpaced actual money by lightyears at this point.

On the plus side, our interest rates aren't 0% right now, so there's some room there.

On the down side, our national debt generation now exceeds 125% of GDP and bond rates are shooting up because nobody wants to buy our debt.

Comment by onlyrealcuzzo 18 minutes ago

Anthropic is almost purely a model company. They own close to no data centers.

If models are becoming commodities, and the main bottleneck is actually serving them at scale, Anthropic does not appear particularly well positioned.

If AWS had a ~60-80% margin for decades, I see no reason why inference can't have a ~60-80% margin for quite some time.

The problem is, if costs continue to drop ~90% for the same level of quality every 18 months, demand is unlikely to grow 10x to keep the revenue stable.

Who knows. Jevon's paradox. But the cost/quality is dropping too fast that it's hard for me to imagine demand keeps up long term to keep revenues (and profits) GROWING.

Comment by farseer 18 minutes ago

More and more companies are signing up with OpenAI and Anthropic at near exponential growth to automate everyday tasks. If anything, these two should manage to IPO just fine. The rest of the downstream startups probably won't make it.

Comment by Hoasi 18 minutes ago

Of course we know it. It’s been obvious since at least 2023. Everyone in AI oversells, except a few companies that built There is no AGI coming anytime soon no matter how much hype is being thrown around. We are not in the singularity. However, peak bullshit is NEAR.

Comment by CuriouslyC 11 minutes ago

The trick the frontier labs have done is define AGI as "better than humans at the vast majority of valuable knowledge work" which is definitely not what most people think it means.

Comment by digitcatphd 33 minutes ago

I would argue we still have not even really gotten started.

What do we have in the decade ahead? Robotics in every household, models 10x+ faster and more intelligent than today.

Really no significant impact in life sciences, R&D, and 'offline' world / robotics today as of yet, which is where most of the value will live.

Comment by horsawlarway 6 minutes ago

Even if we agree with this take (and I do think it's a likely take that you're right on the long term), it doesn't change that it seems likely we're in a bubble, and it probably will pop.

We see a similar paradigm with lots of revolutionary technology. The initial promise is high, people get very excited, lots of money pours in, and.... 15-30 years go by before we start seeing real impact across the economy at large.

It's just a real slog to actually implement and roll out new tech.

So take robots: I can promise you that you won't see robotics in every household in the next decade (especially so if we exclude the current market of robot vacuums). Even if a company makes an incredibly capable robot "today" (and to be clear - they are not) it won't have time to scale out production, reduce costs, generate a used market that's accessible to less wealthy consumers, deal with regulatory hurdles and quality problems that only pop up in real-world usage, etc...

It's just slower than you're implying.

The change very well will happen (I'm inclined to agree that things are going to shift). That doesn't mean that the current investment is sane and will pay off.

So many historical examples of this, just two here real quick:

- Ford built his first automobile in 1896, founded a company in 1901, went out of business, got sued by ALAM, didn't build more than 10k Model T's until 1910, then only finally hit real scale (of low hundred of thousands of units) in 1913: More than a decade to "basic scale". Household ownership didn't hit 60% until 1929... 30+ years later.

- The initial web enthusiasm, followed by the dot-com crash in early 2000s...

Comment by Cthulhu_ 29 minutes ago

Robotics in the household has been the realm of science fiction for decades and it still hasn't happened. We get dedicated, compact machines like dishwashers and washing machine/dryers, that's it. Most recent innovation has been the automatic vacuum.

If you want someone else to do household chores, hire someone. You can pay someone to do your house chores for years for the cost that these things will have initially.

Comment by ghaff 19 minutes ago

>Most recent innovation has been the automatic vacuum

Which are pretty useless for a lot of home layouts and degree of putting cords etc. away. I took a look a few years back and got a stick vac instead. (And have a monthly housekeeper who does a lot more than a robo-vac would.)

Comment by sumedh 11 minutes ago

> Robotics in the household has been the realm of science fiction for decades and it still hasn't happened.

Wasnt AI science fiction (research) for decades but just took couple of years after Chatgpt to become mainstream. Why do you that wont happen to robotics?

Comment by habinero 1 minute ago

We don't have sci-fi AI, and in any case "this thing is now possible, therefore [much more difficult thing] will be possible soon" is not a rational thought.

Comment by CuriouslyC 13 minutes ago

The cost of a timeshare robot will come down first, so you'll be hiring a robot before you own one. But that might not take so long to occur as you imagine.

Comment by habinero 6 minutes ago

People have been talking about this for literally a hundred years at this point. It's not a thing and isn't gonna be one.

Comment by novia 17 minutes ago

What it we would prefer that there were not other people in our homes for interpersonal reasons?

Comment by diego_moita 4 minutes ago

> I would argue we still have not even really gotten started.

I agree, but that doesn't mean there isn't a bubble.

It is possible we'll have all those changes and they generate a lot of revenue for very few players but, still, a lot of the remaining players fail.

In particular, I worry about robotics. It is clearly becoming a China-only game. The west just doesn't have the industrial manufacturing critical mass to play it.

Comment by FrustratedMonky 15 minutes ago

Yep, that is what the bet is. The build out will continue, even if it looks different.

The Internet was a 'bubble' at one point, and after it crashed in 2000, it didn't go away, it continued to build out. We're still using the Internet after the Internet bubble popped.

Comment by lluisantoni 34 minutes ago

There is something I have been pondering recently. If we compare the cost of AI subscriptions (let's say Claude's 100/month) to a median developer salary (let's say 100k/year to 200k/year), the difference is orders of magnitude. This fills like a gap that needs to close. I suspect llms are too cheap right now but will raise their prices to a point where only big companies will be able to afford subscriptions to use them. I think soon we will see models that are only sold at very high prices.

Comment by NoDodgeQuestion 22 minutes ago

This is something I have been pondering recently. If I compare the cost of a plunger ($23.99 on Amazon) to a median plumber salary ($62,970 per year per BLS), the difference is orders of magnitude. This feels like a gap that needs to close. I suspect plungers are too cheap right now but will raise their prices to a point where only big companies will be able to afford subscriptions to use them. I think soon we will seen plungers that are only sold at very high prices.

Comment by KeplerBoy 26 minutes ago

Open weight models tell a different story. Inference is not that much more expensive than what a 100$ plan would allow and will only get cheaper (for current capability models of course, frontier not so much).

Comment by lluisantoni 27 minutes ago

Also, something else to add. At first I thought no one wants to build data centers in hotter areas in the middle of deserts (many places in the American continent). So nobody would spend money building a data center in the Chihuahuan Desert for instance. However, a game of latencies will either require cover llm access from these areas, or make people move closer to the other data centers. In the former, llm prices will go up; in the latter, there will be a migration towards data centers that increase the price of the areas around.

Comment by KeplerBoy 25 minutes ago

Who cares about a few ms more latency on an LLM API? Maybe for voice, but most other use-cases are quite latency insensitive.

Comment by mythrwy 17 minutes ago

They are building data centers in the Chihuahuan Desert right now. Meta has a huge one planned right outside El Paso.

Comment by terabytest 28 minutes ago

LLMs are not as cheap on enterprise plans.

Comment by cracell 26 minutes ago

I don't understand this argument.

Go to OpenRouter and look at all of the unsubsidized providers.

Comment by lopis 23 minutes ago

> 100k/year to 200k/year

Is this range just Silicon Valley or what is this? Even including just Europe, you're looking at a lower bracket of 10k. If you expand to the rest of the world... Or do you think rich cities in the USA, where developers make 100k+ per year, can alone sustain this industry?

Comment by ido 5 minutes ago

salary cost to the company is a lot higher than gross salary (which itself is a lot higher than net salary). you can guestimate total salary cost to be about 1.5x gross salary, so for the lower bound: 100k / 1.5 = $66,666.67 = €57,813.34.

€57-114k p.a. is well within the order of magnitude of yearly gross developer salaries in Western Europe (e.g. Germany).

Comment by feverzsj 53 minutes ago

It's obvious. Most people were expecting this.

Comment by northernsausage 16 minutes ago

I mean we are due our 6-8 year financial crash that we won't learn from. Once again it'll be coming from the USA's feral financial investments all to be bailed out by the tax player whilst the rest of the world picks up the pieces. Maybe its time we moved away from the petro-dollar if the USA can't be trusted to keep its finances in order.

Comment by AussieWog93 41 minutes ago

The title's clickbait (from The Register, of all people - colour me shocked!).

There's nothing really groundbreaking at all in there, just "chips are expensive, and open weights models hosted locally in enterprise could displace Claude/GPT"

Comment by ozgung 19 minutes ago

Note that the “AI Bubble” term used here is only defined in the context of market speculation. If you are not an investor of AI companies then there is nothing to worry about for you. If you are an investor, then you should know that people can’t really predict when bubbles burst. Every prediction in the markets is a speculation and some investors can simply bets against the popular expectations to make good money.

Movements of AI stocks shouldn’t be confused with “AI as a technology” and “AI as a business”. Market valuation is a different game.

Comment by techpression 44 minutes ago

> The same thing happened with their massive investment in Anthropic. They accounted for $53.4 billion due to deals with Anthropic last quarter. He said if you follow one Anthropic dollar through the earnings release, it's counted in AI business revenue, chips business, and AWS segment revenue.

That is insane if that is true, is that even legal?

Comment by cmiles8 42 minutes ago

It is. However remember that when the bubble pops it all works in the reverse direction too. Suddenly you have to mark down investment losses, missed revenue, and written off commitments.

Companies can go from looking really good to a complete financial mess almost overnight when all that leverage and self-reinforcing stuff unwinds. See last weeks headlines for one such scenario.

Comment by Aldipower 29 minutes ago

The bubble in the US pops maybe. China is only limited by chips, not costs.

Comment by delfinom 17 minutes ago

It's entirely possible China has a little bit of a bubble too when it comes to development investment vs demand. But obviously the bubble in the US is basically a whale compared to whatever small fish China is.

Comment by sysguest 49 minutes ago

well if bubble pops, everyone will die EXCEPT google

UNLESS openAI/etc actually succeeds in making AGI that never hallucinates and goes over the current LLM limitations

as for google... well they own the web

(+google has plenty of other revenue sources, so it can just pay out its AI survival)

if you're a website owner, would you welcome chatgpt/etc's data-collection bots?

but... as for google's bots... you need your website to be on the Google search results...

Comment by tremon 30 minutes ago

I expect Nvidia to survive the crash on its own, and everyone else except Softbank to be bailed out with US taxpayer money.

Comment by thepasch 26 minutes ago

Nvidia has hordes of raucous gamers on the prowl waiting to tear their chips out of their hands the moment hyperscaler demand falters; plus, China has made sure there will always be plenty of open models to run for hobbyists and neoclouds, even if training compute were to drop off a cliff. They'll be just fine.

Comment by ff10 20 minutes ago

I want to see the number of gamers that tear the chips from the dead hands of hyperscalers to make up for the implosion of that market. If I had to guess, half of humanity does not have interest in dedicated gaming chips. Memory, that's another story.

Comment by mschild 18 minutes ago

The gpus will be too expensive and a lot of them are not even close to useable for gaming. Any consumer gpus maybe but I suspect that nvidia will be able to pivot more quickly producing consumer gpus again.

Comment by delecti 5 minutes ago

The market for video game hardware is absolutely puny in comparison to the datacenter GPU boom.

I saw it put quite well in a comment on reddit:

> In 2020, the gaming segment was 47% of revenue at around 8 billion. Today it's doubled to 16 billion, or 7% of revenue. That's right, data center went from 6 billion 2020 to around 198 billion today.

Even if gaming revenue doubles again when the AI bubble pops, their total revenue will still drop by something like 80%. I'm neither smart nor dumb enough to be confident about whether that's something Nvidia can survive.

Comment by trashb 24 minutes ago

> but... as for google's bots... you need your website to be on the Google search results...

Why? Depends totally on what kind of website you are running.

Comment by mschild 20 minutes ago

Totally agree. For a lot of tradefolks maps seem to be the actually more important location. Still Google obviously but it's less slopified in comparison to search. For now at least.

Comment by bzzzt 41 minutes ago

> well if bubble pops, everyone will die EXCEPT google

Also, possible Apple since they haven't gone into deep debt to finance 'AI buildout'.

Comment by gizajob 37 minutes ago

They’re also primed to capture the on-device AI market in 3-5 years time when a “good enough” model can run locally.

Comment by delfinom 19 minutes ago

Apple is also just partnering with Google.

https://blog.google/company-news/inside-google/company-annou...

Comment by brazzy 32 minutes ago

Do they even have any direct exposure to the whole AI bubble?

If not, I'd say they don't even count in the "everyone"-

Comment by bzzzt 36 seconds ago

Their exposure could be net positive. If other companies fail they will still be around to pick up their customers.

Comment by 38 minutes ago

Comment by effnorwood 23 minutes ago

[dead]

Comment by simianwords 54 minutes ago

> I caution anyone looking at API prices: they dropped the price, but is it actually less expensive?

> Yeah, they dropped the price, but count the number of tokens you're tossing into it and see if it's actually cheaper. It's good for marketing, but the rub is how much you're actually using.

The level of discourse is so horrible now, I don't have words. Are these the ones making predictions on AI bubble?

Comment by InsideOutSanta 33 minutes ago

This is poorly stated in the podcast, but the underlying point is correct: while cost-per-token is going down, overall token use is way up. This is causing the cost of using LLMs in corporations to skyrocket.

Comment by empath75 50 minutes ago

Of course, the price of tokens going down makes it cheaper. You can now afford to throw millions of tokens at solving a problem that would have been impossible for AI to solve at all a year ago for any price.

People completely lack imagination about this stuff. The main problem right now with AI isn't even AI successfully producing code at a reasonable cost, it's human coordination and review that is the bottleneck.

Comment by HarHarVeryFunny 9 minutes ago

I think it's both. It's easy to run up a massive bill with AI without much to show for it, which is why token-maxxing has now been replaced by cost-awareness and AI budgeting such as Uber's "max 10% of salary per employee".

Cost isn't just token price though - it's (number-of-tokens-used x price-per-token), and there are large differences in token efficiency between different models and harnesses. Increasingly we're seeing benchmark sites focusing on "cost per completed task" as a cost metric, and it's not always the cheapest tokens that win.

I agree that ultimately AI/coding cost is just part of the picture - at the end of the day it's about software development cost, which for time being involves humans.

Comment by ac-ciano 46 seconds ago

[flagged]