AI Safety Specialist - Evaluation Expert
Mercor
- Travail à distance
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: AI Safety Practitioner
Type: Contract
Compensation: $60–$70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
- Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
- Apply and refine evaluation rubrics for RLHF , SFT , and AI safety benchmarking .
- Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
- Provide structured feedback to improve model alignment and safety performance.
- Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.
Qualifications
Must-Have
- Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
- 5+ years of professional experience in AI Safety , Trust & Safety, journalism, public policy, scientific research, security, or a related field.
- Excellent written English , critical thinking, and analytical reasoning skills.
- Ability to consistently evaluate nuanced and policy-sensitive scenarios.
Preferred
- Experience with AI Safety , RLHF , SFT , Trust & Safety, or AI evaluation.
- Familiarity with safety policies, content moderation, or evaluation rubric development.
- Experience reviewing complex, high-risk, or ambiguous content.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Montrer un mail
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
- ...technical talent with leading AI research labs. Headquartered in... ...Dorsey . Position: AI Safety Practitioner Type: Contract... ...Role Responsibilities Evaluate AI-generated responses for... .... Apply and refine evaluation rubrics for RLHF , SFT , and...SuggéréTravail à distanceEmploi contractuelTravail d'été
- ...technical talent with leading AI research labs. Headquartered... ...Dutch (Belgium) Generalist Expert — AI Safety Type: Contract... ...behind your judgments. Evaluate and strengthen how AI models... ...content moderation, policy evaluation, or adversarial testing....SuggéréTravail à distanceEmploi contractuelTravail d'étéRecrutement immédiat
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...: Bilingual Dutch (Belgium) STEM Expert (PhD) — AI Safety Type: Contract Compensation... ...specialized scientific topics. Evaluate and annotate model responses for...SuggéréTravail à distanceEmploi contractuelTravail d'étéRecrutement immédiat
- ...technical talent with leading AI research labs. Headquartered in... ...Dorsey . Position: AI Safety Red Teamer Type: Contract... ..., and policy failures. Evaluate model robustness across... ...prompt engineering, or adversarial evaluation methodologies. Expertise...SuggéréTravail à distanceEmploi contractuelTravail d'été
- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: AI Safety Experts — English & Dutch Type: Contract Compensation:...SuggéréTravail à distanceEmploi contractuelTravail d'été
- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: AI Safety Experts — English & Dutch Type: Contract Compensation:...Travail à distanceEmploi contractuelTravail d'été
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Generalist Expert (UK/Europe) Type: Contract... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...Travail à distanceEmploi contractuelTravail d'été
- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code...Travail à distanceEmploi contractuelTravail d'été
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Music Audio Expert - French Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation...Travail à distanceEmploi contractuelTravail d'étéRecrutement immédiat
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation... ...structured feedback to improve document evaluation processes. Utilize MS Excel and Google...Travail à distanceEmploi contractuelTravail d'été
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...from those that merely look correct. Evaluate responsive behavior and semantic quality,... ...Prior RLHF , preference labeling, or model evaluation work. Code review or technical...Travail à distanceEmploi contractuelTravail d'été
400 $ par mois
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Travail à distanceEmploi contractuelTravail d'été- ...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Product / Platform Experts Type: Contract Compensation... ...skills to contribute to high-impact evaluation projects. Collaborate asynchronously...Travail à distanceEmploi contractuelTravail d'été
- AI Expert Team Lead Position Description The opportunity CGI is looking for a hands-on AI professional ready to build and lead... ...decide what should scale. • Explore emerging technologies. Evaluate and apply relevant approaches across generative AI, machine learning...Stage
- ...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Finance / Business Ops Experts Type: Contract Compensation... ...analytical skills to contribute to high-impact evaluation projects. Collaborate asynchronously...Travail à distanceEmploi contractuelTravail d'été
- ...Are you ready to join the forefront of technology as a AI Specialist in Netcompany? As an AI Specialist you will:... ...Knowledge of prompt engineering techniques, including prompt design, evaluation, optimisation, and analysis of model behaviour. Hands-on experience...
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Arabic expert Type: Contract Compensation... ...independently to ensure high-quality evaluations and feedback. Qualifications Must...Travail à distanceEmploi contractuelTravail d'étéRecrutement immédiat
- ...accelerate their digital transformation through leading Cloud, Data & AI solutions while growing your own career in a high-growth market?... ...We are seeking a commercially driven Cloud & AI Sales Specialist to identify, develop, and secure new business opportunities across...
- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: HR Expert Type: Contract Compensation: $70–$80/hour...Travail à distanceEmploi contractuelTravail d'été
40 $ - 45 $ par heure
...professionals based in Belgium to evaluate written content and apply... ...review guidelines across advanced AI projects. This role... ...analytical reasoning, and content evaluation. Selected professionals will... ...Background in trust and safety, content moderation, policy evaluation...Travail à distanceTemps partielPour les contractantsRecrutement immédiat1845 € par mois
...Content Moderator , you'll help protect the platform and its users by identifying potential risks and making sure activity follows safety guidelines. You'll: Review and assess potentially harmful or inappropriate activity Identify risks, suspicious patterns...Temps complet- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: Regulatory Law Expert Type: Contract Compensation: $90–$100/hour...Travail à distanceEmploi contractuelTravail d'été
56982.59 € par année
...Als Fiscaal expert zal je o.a. meewerken aan het project e-reporting, het proces waarbij btw-plichtige ondernemingen hun factuur- en transactiegegevens bijna in real-time digitaal en gestructureerd doorsturen. Je coördineert en werkt compliance bevorderende acties...Emploi en CDI27 $ par heure
...technical talent with leading AI research labs. Headquartered in... ...use of spatial language. Evaluate if the assistant provided timely warnings on health, safety, or financial risks. Write... ...content moderation, or AI model evaluation. Training in linguistics,...Travail à distanceEmploi contractuelTravail d'étéRecrutement immédiat- AI Expert Team lead Position Description We are looking for a high-potential, fast-rising AI leader to build and drive one of our AI teams. This role is ideal for someone early in their leadership journey who has already demonstrated exceptional technical ability,...Emploi contractuelRecrutement immédiat
- ...transformational growth. WPP Media is WPP's AI-driven media operating unit,... ...Role As a Senior Programmatic Expert , you will be a key programmatic specialist within the team, working closely... ...the highest standards of brand safety, brand suitability and quality....Emploi contractuelEmploi en CDITemps complet
- ...academic institutes. Role Overview Our client currently has a vacancy for an AI Adoption & Training Specialist fluent in English, to offer his/her services as an expert who will be based in Belgium. The work will be carried out either in the company’s...Temps complet
- ...and accessible across borders — a global safety net. Our platform protects 15M+ users... ...to that shift. The Customer Operations Specialist collaborates closely with Customer Growth... ...driving force behind making it smarter. Early AI-driven improvements are already in motion...Emploi contractuelStageEmploi en CDITemps completTravail posté
- ...SFEIR BELGIUM - AI Engineer - Deviens un expert augmenté Bruxelles | Esprit startup | AI-Native Group Sharp Tech. Real Impact. Qui sommes-nous ?... ...décides aussi si on est le bon endroit pour toi. On évalue ton raisonnement, ta façon de collaborer et de débloquer...Emploi en CDITravail d'été
- ...bouwen aan de strategische versnelling van AI binnen Partena Professional? Geloof... ...business teams, IT, leveranciers en AI-specialisten. Creëren van draagvlak bij management... ...van business-, technologie- en innovatie-experten. Ruimte voor initiatief, ondernemerschap...Emploi contractuelEmploi en CDITemps completTravail à domicile3 jours par semaine
Voulez-vous recevoir plus d'offres d'emploi ?
S'abonner et recevoir des offres d'emploi similaires à AI Safety Specialist - Evaluation Expert. Soyez parmi les premiers à postuler !




