Skip to content

Performance and latency testing providers

23 published entries state performance and latency testing on their AI testing pages. Between them they name 8 AI product types.

Load and latency testing of inference: throughput, time to first token and cost per request. Quality checks under load may use LLM-as-judge.

LLM-as-judge: Using one language model to grade another model's answers against a rubric.
AI product type
Company type
Country (HQ or delivery)

Showing 23 of 23. Default order: coverage score, then name. How the score works.

Entries on this page: Performance and latency testing providers
RankCompany typeAI products (as stated)ServicesVerified
1DeviQAPure-play QA companyPoland, Warsaw
LLM applicationsAI agentsRecommender and ranking systemsPredictive ML modelsComputer visionVoice AI
82010162026-11-09
2AbstractaPure-play QA companyUnited States, Jacksonville
LLM applicationsAI agentsPredictive ML models
102008152026-11-09
4BetterQAPure-play QA companyRomania, Cluj-Napoca
LLM applicationsAI agentsVoice AI
92018142026-11-09
4QATestLabPure-play QA companyCyprus
LLM applicationsAI agentsPredictive ML models
10142026-11-09
4TestDevLabPure-play QA companyLatvia, Riga
LLM applicationsAI agentsVoice AIComputer visionPredictive ML modelsRecommender and ranking systemsAutonomous and embedded AI
52011142026-11-09
11Fulminous SoftwareIT services firm with a QA practiceIndia, Jaipur
Voice AIAI agentsAutonomous and embedded AI
72019122026-11-09
11QualityAI (formerly Qualitest)Pure-play QA companyUnited States, Santa Clara
LLM applicationsAI agentsPredictive ML modelsRecommender and ranking systems
7122026-11-09
11SunTec IndiaData and evaluation vendorIndia, New Delhi
LLM applicationsDocument AIPredictive ML models
71999122026-11-09
14QA MadnessPure-play QA companyPoland, Warsaw
LLM applicationsAI agentsRecommender and ranking systems
7112026-11-09
14QAwerkPure-play QA companyUkraine, Kyiv
LLM applicationsAI agents
72015112026-11-09
14Testrig TechnologiesPure-play QA companyUnited States, Dallas
Predictive ML models
82015112026-11-09
18Indium SoftwareIT services firm with a QA practiceUnited States, Cupertino
AI agentsLLM applicationsRecommender and ranking systems
6102026-11-09
18KiwiQAPure-play QA companyAustralia, Bella Vista
LLM applications
72009102026-11-09
18KualitatemPure-play QA companyUnited States, New York
Predictive ML models
72010102026-11-09
23BugRaptorsPure-play QA companyIndia
Computer visionPredictive ML modelsVoice AI
4201692026-11-09
23ChetuIT services firm with a QA practiceUnited States, Sunrise
Predictive ML models
6200092026-11-09
23CodoidPure-play QA companyIndia, Chennai
LLM applicationsAI agents
5201292026-11-09
23Luxe QualityPure-play QA companyUnited States, McLean
Computer visionVoice AIPredictive ML models
592026-11-09
29Frugal TestingPure-play QA companyIndia, Hyderabad
Voice AIComputer visionAutonomous and embedded AI
482026-11-09
29TestMatickPure-play QA companyUnited States, New York
Recommender and ranking systemsPredictive ML models
4200982026-11-09
34MosChipIT services firm with a QA practiceIndia, Hyderabad
AI agentsAutonomous and embedded AI
3199972026-11-09
34QualitrixPure-play QA companyIndia, Bengaluru
Predictive ML models
572026-11-09
61SnoopgamePure-play QA companyEstonia, Tallinn
Computer visionRecommender and ranking systems
242026-11-09

Product types covered by vendors stating this service

Count of entries on this page that state each product type.

Product types stated by entries offering Performance and latency testing
Product typePerformance and latency testing
LLM applications12
AI agents12
Voice AI7
Computer vision6
Predictive ML models13
Recommender and ranking systems7
Generative media0
Document AI1
Autonomous and embedded AI4

Scope and standards referenced

Inference load, token throughput, time to first token, cost per request under load.

The directory lists which vendors state this service. It does not test whether a vendor applies these standards.

Questions

Which metrics are used to evaluate voice agent quality?

Common metrics are word error rate for recognition, intent accuracy, task completion, response latency, interruption handling and listener ratings of synthesised speech.

Request a listing or correction