Skip to content
The Decoder· Jonathan Kemper·Indexed by this site · Originally published· AI updates →· Its place in the scan record →

Hugging Face now routes model requests through OpenRouter for optimal price or speed

Hugging Face now routes model requests through OpenRouter for the best price or speed

AI summary

Hugging Face's Inference Providers now route language model requests through OpenRouter, automatically selecting providers by price, speed and reliability. OpenRouter says the new routing reduces capacity errors by 46%, shortens time to first token by 16.9%, and increases throughput by 16.3%. Bring-your-own API keys for language model providers are no longer available; image and video providers can still use them.

Read originalthe-decoder.com