OpenRouter Broadcast

Posted by Topfi 5 days ago

Counter33Comment12OpenOriginal

Comments

Comment by echelon 1 day ago

It's not "Open".

I wish this had another name.

I love the idea of fire and forget to a central AI aggregator. This one for LLMs, Fal for image and video. You don't need to juggle dozens of API keys or API integrations.

But these aren't open, despite it being in the name.

I want the ability to pull it all on-prem if I so choose.

I probably won't. But if I want to, I should be able to.

Don't use the name "Open" like this.

OpenAI, OpenRouter, OpenArt... Just stop already.

This isn't even fair source, let alone open. It's totally closed and opaque.

I'm half minded to make an "ActuallyOpenRouter".

(I know there are local routers, but I want hosted and managed with the ability to self-manage.)

Comment by omneity 1 day ago

While not solving everything (such as a single bill), I implemented borgllm[0,1] as a way to get some of that convenience and development speed with no lock-in or even infra.

Perhaps you’ll find it interesting.

0: https://github.com/omarkamali/borgllm

1: https://borgllm.com

Comment by abidlabs 1 day ago

Use Hugging Face inference providers for this: https://huggingface.co/docs/inference-providers/en/index

Comment by embedding-shape 1 day ago

At this point, I'm starting to see "Open" prefix for any product/project as almost an signal for the opposite. Projects that actually are about some sort of openness (the way I see it at least), don't usually prefix their name with it, they just operate "openly" and ensure it stays that way.

Comment by BLKNSLVR 1 day ago

See also: "Smart"

Comment by coolspot 1 day ago

The founder named it OpenRouter because his previous startup was OpenSea.

Some founders choose a prefix, then tend to use it everywhere :)

Comment by Fnoord 22 hours ago

Kometimes Kreally annoyinK.

Had to look up what OpenSea is. NFT. So from one hype (and arguably scam) involving GPUs to the neXt one.

Comment by BizarroLand 12 hours ago

Should make a "ClosedRouter", "ClosedAI", "ClosedArt" instead, but be actually open.

Comment by gregjw 1 day ago

Coming Soon section says 'WhyLabs', weird, isn't WhyLabs shutting down?

Comment by tasn 1 day ago

Congrats OpenRouter on the launch! I'm a big fan of this pattern. We do the same in Svix for our customers, but also we now make it easy for our customers to do the same.

For other companies looking to build something similar, you can use Svix Stream[1] that offers a lot of these integrations out of the box, with more coming.

1: https://www.svix.com/stream/

Comment by jauntywundrkind 1 day ago

This is indeed such an awesome feature. I really hope we see lots of other products & services offer to send you your own traces!!

Also, such integration really ought respect & add to any trace propogation contexts passed in. Fingers crossed that works well here! Not explicitly mentioned so I'm nervous, but the product really needs trace propogation.

Comment by tasn 1 day ago

I'm sure that if they don't already support it, they will add it. TBH, we at first didn't have it either, and then we added both that as well as custom attributes as we realized the way people setup their observability stack is extremely varied!