OpenRouter usage is likely skewed towards LLMs that are more niche and/or self-hostable by solid hardware that's available, but most consumers don't have on hand. I can imagine Anthropic and OpenAI LLMs often get called directly from their APIs instead.
At least from my experience and friends of mine, we use OpenRouter for cases where we want to use smaller LLMs like Qwen, but when I've used ChatGPT and Claude, I use those APIs directly.
0.1% of OpenRouter is around 400 billion tokens per month or around $400k per month at a cost of $1 per 1 million input tokens, not counting output.
I think it's pretty disingenuous to call your SaaS little when it is projected to spend at least 5 million USD just on tokens and this is a low end estimate.
Their homepage says 30T tokens monthly, so 0.1% would be 30 billion.
And I pay way less than $1 per input token, especially when caching is taken into account.
EDIT: they updated it in the last day or two, now it says 70T, so I’m a little below 0.1% now. But seriously, the point stands, 70T tokens a month just isn’t that much in the global scheme. The big labs are pushing quadrillions each.
While it's not perfect, pinning specific versions and managing all updates directly has been a solid solution for my team. Things can of course still slip through, but we're never vulnerable to these just because there was a new package release and we opted into it by default.
Updating packages takes longer, but we try to keep packages to a minimum so it ends up not being that big deal.
Yeah, I think marked down files and a printed version ends up being a good idea. I've never worked with media wiki directly, but I wonder if you could do an easy nightly dump of markdown contents somewhere.
Is that completely based on their expressions and reactions? I mean, you might be right, but I feel like an expression of reaction is too little to base such a damning statement on.
"Most" is probably not accurate. I can't imagine the average middle aged individual in the UK has a VPN they use regularly. I'd be pleasantly surprised if that was the case.
My small company has an office in a coworking space that's about a 1.5 hour train commute for me. I don't go in much, but when I do, I have a great time. Some excellent conversation and product discussion happens there. I even go into a closer coworking space in my city a few times a week (typing from there).
All that said, working from home is so awesome. I'm more productive, have no commute, and get to do things like take care of background tasks like laundry and start my workouts at a reasonable hour after work.
Al a carte content via a good standardized micro payment option sounds wonderful. Not sure if we as a society would pull it off well, but I can dream.
Define micropayments, but we kind of do it with television and movies if you rent from something like Apple, Sony, or Amazon. Would love if that model could apply to the written word as well.
reply