I love the idea of openrouter. I hadn't realized until recently though that you ...

		pickettd on Dec 7, 2024 \| parent \| context \| favorite \| on: Show HN: Countless.dev – A website to compare ever... I love the idea of openrouter. I hadn't realized until recently though that you don't necessarily know what quantization a certain provider is running. And of course context size can vary widely from provider to provider for the same model. This blog post had great food for thought https://aider.chat/2024/11/21/quantization.html

To expand a little, some providers may apply more aggressive optimization in periods of high load.