Side by Side Quality Evaluator – English
We’re looking for English-fluent experts to engage on a project about the overall quality of AI-generated responses.
As an independent contractor, you’ll interact directly with large language models (LLMs) and compare their responses side by side to decide which one better meets the user’s needs. Your evaluations and written rationales will help build AI systems that are more helpful, accurate, and reliable.
Experts may be asked to:
- Interact directly with different AI models and tools
- Compare two or more model responses side by side (SxS)
- Judge responses on several quality dimensions, such as accuracy, helpfulness, instruction-following, clarity, and overall quality
- Follow multi-step evaluation workflows and detailed rating guidelines
- Write clear, well-reasoned explanations for each evaluation decision
- Record consistent judgments across a wide range of prompts and topics
This project may be a strong match for experts who:
- Are fluent in English, with strong reading comprehension and writing skills
- Have extensive hands-on experience using LLMs and evaluating their outputs
- Have strong critical-thinking skills and can compare responses on several quality dimensions
- Pay close attention to detail and follow instructions carefully
- Can explain their evaluation decisions clearly and convincingly
- Are comfortable following multi-step workflows and switching between different models and tools
What is Meridial?
Meridial connects you with remote, paid AI projects that match your skills and expertise. By contributing your knowledge, you help advance the world's leading AI systems and accelerate the future of artificial intelligence.
