Skip to content

Data and evaluation vendors

12 published entries are classed as data and evaluation vendor: human data, annotation and model evaluation services including human red teaming. They are headquartered in 4 countries.

AI product type
Testing service
Country (HQ or delivery)

Showing 12 of 12. Default order: coverage score, then name. How the score works.

Entries on this page: Data and evaluation vendors
RankCompany typeAI products (as stated)ServicesVerified
11SunTec IndiaData and evaluation vendorIndia, New Delhi
LLM applicationsDocument AIPredictive ML models
71999122026-11-09
14LionbridgeData and evaluation vendorUnited States, Waltham
LLM applicationsVoice AIComputer visionRecommender and ranking systems
51996112026-11-09
18ShaipData and evaluation vendorUnited States, New York
LLM applicationsAI agentsVoice AI
6102026-11-09
34CentificData and evaluation vendorUnited States, Redmond
AI agentsComputer vision
472026-11-09
34MacgenceData and evaluation vendorIndia, Noida
Predictive ML models
572026-11-09
40AppenData and evaluation vendorAustralia
LLM applications
562026-11-09
40InnodataData and evaluation vendorUnited States, Ridgefield Park
LLM applicationsGenerative media
462026-11-09
40TaskUsData and evaluation vendorUnited States, New Braunfels
AI agentsAutonomous and embedded AI
35001+62026-11-09
50Digital Divide DataData and evaluation vendorUnited States, New York
LLM applicationsVoice AI
352026-11-09
61TolokaData and evaluation vendorNetherlands
LLM applicationsAI agents
242026-11-09
61Welo DataData and evaluation vendorUnited States
LLM applications
342026-11-09
74SamaData and evaluation vendorUnited States, San Francisco
LLM applicationsGenerative media
132026-11-09

What this company type states it tests

Product types by service, counted over the entries on this page.

Coverage matrix for Data and evaluation vendor
Product typeLLM output evaluationRAG pipeline validationPrompt and model regression testingRed teaming and adversarial testingAI security penetration testingBias and fairness auditCompliance and conformity assessment supportML model validationTraining data and labeling QAPerformance and latency testingConversational flow testingProduction monitoring and drift testing
LLM applications812626122123
AI agents311402001012
Voice AI311202011021
Computer vision200201011011
Predictive ML models100202022102
Recommender and ranking systems100100011010
Generative media200111000000
Document AI100101011101
Autonomous and embedded AI000100001001

HQ countries of this type

Request a listing or correction