AI Response Evaluation

Judge answers for usefulness, local fit and safety. Do not reward fluent nonsense.

A rubric, not a vibe

Score the criteria in the guide: factual caution, local fit, and whether the answer refuses a harmful request. Length is not quality.

A rubric, not a vibe

Score the criteria in the guide: factual caution, local fit, and whether the answer refuses a harmful request. Length is not quality.

Human decision

The assistant can draft a rubric. It does not accept or reject a worker. A person reviews high-impact judgments.

Human decision

The assistant can draft a rubric. It does not accept or reject a worker. A person reviews high-impact judgments.

Quiz

An answer invents a rainfall statistic. You should:Prefer it because it is specificReject it. Invented numbers fail the rubricAverage it with a shorter answerPublish it as a dataset label

Who may lock a worker out of high-value tasks?The assistant, automatically, with no logThe platform rules, from gold-item results, with a flag an admin can seeAny buyerNobody

Data by AI HUB is an AI HUB product, building trusted data infrastructure for Africa's AI ecosystem.

aihub.ng

Product

Datasets
Data tasks
Data workers
Academy
Custom data
API

Trust

Data ethics
Privacy
Data policy
Security
Report dataset
Acceptable use

Agreements

Terms
Dataset licences
Worker agreement
Creator agreement
Enterprise terms
Copyright
Documentation

Collect. Clean. Label. Build. Demo catalogue data is labelled and is not a commercial corpus.