Appen
HQ Australiaev-appen-10ev-appen-11 · Checked 2026-11-09 · Vendor AI page: appen.com/model-evaluation-and-integrityev-appen-01
Appen states on its AI testing page that it tests LLM applications. It lists its headquarters in Australia.
Facts
| Founded | Not published: fewer than two agreeing sources |
|---|---|
| Size band (employees) | Not published: fewer than two agreeing sources |
| Delivery locations | Not published: fewer than two agreeing sources |
| Engagement models (as stated) | One-time audit or assessmentev-appen-08 |
| Pricing disclosed on vendor site | Noev-appen-18 |
| Certifications | Not published: fewer than two agreeing sources |
Coverage score
6 / 25 · rank 40 of 88
| AI product types stated on the vendor's AI page | 1 / 9 |
|---|---|
| Testing services stated on the vendor's AI page | 5 / 12 |
| Figures confirmed by two sources (founded, size band, delivery locations, certifications) | 0 / 4 |
The same formula is applied to every entry. It counts stated coverage and confirmed figures; it does not measure quality. How the score works.
AI products tested
As stated by the vendor on 2026-11-09
Testing services
As stated by the vendor on 2026-11-09
- LLM output evaluation
- Prompt and model regression testing
- Bias and fairness audit
- Compliance and conformity assessment support
- Production monitoring and drift testing
ev-appen-03ev-appen-04ev-appen-05ev-appen-06ev-appen-07
Not stated on the vendor's AI page
Services from this directory's taxonomy that the vendor's AI page does not mention. This does not mean the vendor does not offer them.
- RAG pipeline validation
- Red teaming and adversarial testing
- AI security penetration testing
- ML model validation
- Training data and labeling QA
- Performance and latency testing
- Conversational flow testing
Stated scope
Appen states that it provides human evaluation of AI model outputs, covering accuracy, bias and regulatory compliance. The vendor's model evaluation page lists six services: evaluation of outputs against factual ground truth, regulatory and ethics audits against the EU AI Act and NIST AI RMF, side-by-side human comparison of model versions, bias testing across demographic groups and languages, ongoing post-deployment evaluation to detect drift, and rubric design for LLM evaluation pipelines.ev-appen-09
How the vendor describes itself
As described by the vendor; summarised on 2026-11-09. Client names, performance percentages and prices are left out.
Appen states that it was founded in Sydney in 1996, initially focused on speech and language data for early NLP systems. Its About page names AI training data services, covering custom data collection, annotation and evaluation, and coding datasets. The vendor states that it is ASX-listed and operates across North America, Europe, Asia-Pacific and the Philippines.ev-appen-20
Evidence
Every source opened for this entry, with retrieval date and verification date. Verified by AI Testing Vendors.
| Id | Field | State | Source class | Source URL | Retrieved | Verified | Verifier |
|---|---|---|---|---|---|---|---|
| ev-appen-01 | aiServicePageUrl | As stated by vendor | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-02 | aiProducts | As stated by vendor | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-03 | services | As stated by vendor | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-04 | services | As stated by vendor | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-05 | services | As stated by vendor | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-06 | services | As stated by vendor | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-07 | services | As stated by vendor | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-08 | engagementModels | As stated by vendor | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-09 | statedScope | As stated by vendor | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-10 | hq.country | Verified | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-11 | hq.country | Verified | company-registry | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-12 | hq.city | Verified | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-13 | hq.city | Verified | company-registry | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-14 | founded | Verified | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-15 | founded | Verified | company-registry | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-16 | deliveryLocations | Verified | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-17 | certifications | Verified | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-18 | pricingDisclosed | As stated by vendor | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-19 | companyType | As stated by vendor | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors | |
| ev-appen-20 | vendorDescription | As stated by vendor | vendor-site | 2026-11-09 (undated) | 2026-11-09 | AI Testing Vendors |
Related
This directory accepts no payment for listing, placement, badges or removal. Vendors cannot buy a position: every list is ordered by one published coverage score, computed the same way for every entry from verified data. Entries are built from each vendor's own published pages and from independent sources named next to every figure.