Tag

OpenRouter

2 pieces

News12 days ago

One Developer Benchmarked 20 OpenRouter Providers on the Same Model and Found a 20-Point Quality Swing

Mo Moustafa ran rolling 32-day benchmarks across more than 20 OpenRouter providers serving identical DeepSeek V4 Flash weights and found GPQA scores ranging from 75% to 90%. Same model, same weights, 20-point gap. The post hit 698 points on Hacker News.

Sep 12, 20265 min

News15 days ago

Mercury 2.5 Says It Is 40 Percent Smarter and Publishes No Benchmark to Prove It

Inception's Mercury 2.5 claims 1,107 tokens per second and a 40 percent jump in intelligence. We pulled OpenRouter's live model catalog to check: the 260,000 token context and the pricing are exactly as advertised, and there is not a single benchmark score behind the quality claim.

Sep 9, 20265 min