AI Policy Reviewer

About the role

We are looking for an AI Policy Reviewer to evaluate AI‑generated and user‑generated content against our governance standards and responsible‑AI principles. Working remotely, you will act as a quality‑assurance checkpoint, ensuring outputs are safe, truthful, fair and compliant with community guidelines.

Key responsibilities

• Review and score AI‑generated responses using detailed policy rubrics.
• Assess outputs for safety, truthfulness, fairness and alignment with community standards.
• Identify and document edge cases where policy application is ambiguous.
• Analyze data to uncover systematic bias, hallucinations or policy gaps and report findings to product and engineering teams.
• Collaborate with policy teams to refine evaluation rubrics and test their teachability to AI models.
• Participate in adversarial testing (red‑team) to expose vulnerabilities before product launch.
• Work with machine‑learning engineers to explain rating decisions and help adjust model behavior.
• Create high‑quality prompt‑response examples for training “golden sets.”

Required profile

• Minimum 3 years of experience in Trust & Safety operations, content policy, risk analysis or legal/compliance review.
• Deep understanding of moderation policies covering hate speech, harassment, misinformation and graphic violence.
• Proven ability to deconstruct complex AI responses and identify logical flaws, hallucinations or subtle biases.
• Strong written communication skills to explain findings to engineers and policy experts.
• Emotional resilience to handle disturbing content and established self‑care strategies.

Required skills

• Familiarity with large language models (e.g., ChatGPT, Gemini).
• Experience using dashboards and spreadsheet tools for data analysis.
• Proficiency with specialized content‑review platforms.