Performance & infrastructure

What is Latency?

The delay between sending a request and getting a response.

Latency is the time between asking a model for something and getting the result.

Low latency matters for chat, voice, and anything interactive.

Related terms

Browse hand-reviewed AI tools — compare on pricing, features and real ratings.