Skills & Resources
Skills & Resources
Downloadable instruction files, reference guides, and productivity frameworks — everything you need to contribute at the highest level.
Annotation Standards
Official instruction files for each task type used on the platform.
Preference Ranking Instructions
Step-by-step guide for evaluating and ranking model response pairs.
Factual Verification Rubric
Criteria and scoring guide for assessing factual accuracy in model outputs.
Chain-of-Thought Evaluation Guide
How to assess reasoning quality, logical flow, and intermediate steps.
Response Writing Standards
Style, depth, and citation standards for expert-authored training responses.
Productivity Frameworks
Systems and templates to optimize your annotation workflow.
Expert Session Planner
A structured template for planning and tracking your annotation sessions.
Personal Quality Checklist Template
Customizable checklist to self-review your work before submission.
Cognitive Load Management Guide
Practical strategies for sustaining focus and accuracy on complex tasks.
Deep Work Protocol for Annotators
Time-boxing and distraction management adapted for annotation work.
Domain Reference Guides
Specialized instruction files for high-stakes domain contributions.
Medical Domain Contribution Standards
Evidence levels, clinical citation formats, and safety annotation rules.
Legal Reasoning & Citation Guide
Jurisdiction-aware citation standards and legal reasoning annotation rules.
Scientific Rigor Reference
How to represent uncertainty, evidence quality, and reproducibility in AI training data.
Engineering Precision Standards
Specs, tolerances, unit conventions, and tradeoff documentation for technical domains.
Quick References
Concise cheat sheets for common tasks and edge cases.
Quality Rubric Cheat Sheet
One-page summary of all scoring dimensions used across project types.
Common Annotation Errors Reference
The 20 most frequent mistakes and how to avoid them.
Uncertainty & Hedging Language Guide
When and how to express epistemic uncertainty in expert responses.
Files are updated with every platform release
Always download the latest version before starting a new project. Outdated rubrics may not match current quality standards.