LLM Infrastructure

One Developer Benchmarked 20 OpenRouter Providers on the Same Model and Found a 20-Point Quality Swing

Mo Moustafa ran rolling 32-day benchmarks across more than 20 OpenRouter providers serving identical DeepSeek V4 Flash weights and found GPQA scores ranging from 75% to 90%. Same model, same weights, 20-point gap. The post hit 698 points on Hacker News.