AI Safety Specialist - Evaluation Expert
Mercor
- Travail à distance
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: AI Safety Practitioner
Type: Contract
Compensation: $60–$70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
- Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
- Apply and refine evaluation rubrics for RLHF , SFT , and AI safety benchmarking .
- Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
- Provide structured feedback to improve model alignment and safety performance.
- Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.
Qualifications
Must-Have
- Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
- 5+ years of professional experience in AI Safety , Trust & Safety, journalism, public policy, scientific research, security, or a related field.
- Excellent written English , critical thinking, and analytical reasoning skills.
- Ability to consistently evaluate nuanced and policy-sensitive scenarios.
Preferred
- Experience with AI Safety , RLHF , SFT , Trust & Safety, or AI evaluation.
- Familiarity with safety policies, content moderation, or evaluation rubric development.
- Experience reviewing complex, high-risk, or ambiguous content.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Montrer un mail
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
- ...technical talent with leading AI research labs. Headquartered in... ...Dorsey . Position: AI Safety Red Teamer Type: Contract... ..., and policy failures. Evaluate model robustness across... ...prompt engineering, or adversarial evaluation methodologies. Expertise...SuggéréTravail à distanceEmploi contractuelTravail d'été
- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: AI Safety Experts — English & Dutch Type: Contract Compensation:...SuggéréTravail à distanceEmploi contractuelTravail d'été
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Generalist Expert (UK/Europe) Type: Contract... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...SuggéréTravail à distanceEmploi contractuelTravail d'été
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Music Audio Expert - French Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation...SuggéréTravail à distanceEmploi contractuelTravail d'étéRecrutement immédiat
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...from those that merely look correct. Evaluate responsive behavior and semantic quality,... ...Prior RLHF , preference labeling, or model evaluation work. Code review or technical...SuggéréTravail à distanceEmploi contractuelTravail d'été
- ...network of Senior Freelance Evaluation Experts to support proposals and... ...& Energy Policy Health, Safety & Employment Occupational... ...Artificial Intelligence (AI) Digitalisation of Work... ...Monitoring & Evaluation (M&E) Specialist Quality Assurance Reviewer...Freelance
400 $ par mois
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Travail à distanceEmploi contractuelTravail d'été- AI Expert Team Lead Position Description The opportunity CGI is looking for a hands-on AI professional ready to build and lead... ...decide what should scale. • Explore emerging technologies. Evaluate and apply relevant approaches across generative AI, machine learning...Stage
- ...Are you ready to join the forefront of technology as a AI Specialist in Netcompany? As an AI Specialist you will:... ...Knowledge of prompt engineering techniques, including prompt design, evaluation, optimisation, and analysis of model behaviour. Hands-on experience...
- ...Mission Overview: The client is seeking an AI Coach - Expert for a consultancy mission delivered by Keystone Solutions. As a Keystone Solutions consultant, you will represent our values and expertise while working on-site at the client, focusing on the adoption and...Travail à domicile
62558.9 € par année
...Belgische digitale omgeving veiliger! Het AI Lab binnen de dienst Netwerkveiligheid... ...(CRA); het begrijpen, analyseren en evalueren van AI-systemen. Het AI Lab heeft als... ...tussen de leden. Als AI-Lab Expert draag je bij aan de uitwerking van het toezichtbeleid...Emploi contractuelTravail temporaireMissionsÀ distance- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: Regulatory Law Expert Type: Contract Compensation: $90–$100/hour...Travail à distanceEmploi contractuelTravail d'été
- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: HR Expert Type: Contract Compensation: $70–$80/hour...Travail à distanceEmploi contractuelTravail d'été
1845 € par mois
...Content Moderator , you'll help protect the platform and its users by identifying potential risks and making sure activity follows safety guidelines. You'll: Review and assess potentially harmful or inappropriate activity Identify risks, suspicious patterns...Temps complet- ...and accessible across borders — a global safety net. Our platform protects 15M+ users... ...to that shift. The Customer Operations Specialist collaborates closely with Customer Growth... ...driving force behind making it smarter. Early AI-driven improvements are already in motion...Emploi contractuelStageEmploi en CDITemps completTravail posté
- ...seeking a high volume of Dutch-speaking coding experts with JSON expertise to combine language fluency, customer service judgment, and technical evaluation skills to help improve the quality, accuracy, and usability of AI-generated outputs, in an audio format. Work is...Emploi contractuelTravail supplémentaire
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Psychiatry Expert Type: Contract Compensation... ...Remote Role Responsibilities Evaluate how large language models reason through...Travail à distanceEmploi contractuelTravail d'été
- AI Expert Team lead Position Description We are looking for a high-potential, fast-rising AI leader to build and drive one of our AI teams. This role is ideal for someone early in their leadership journey who has already demonstrated exceptional technical ability,...Emploi contractuelRecrutement immédiat
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Music Audio Expert - Dutch Type: Contract Compensation... .../week Role Responsibilities Evaluate AI model output for lyrics and voice...Travail à distanceEmploi contractuelTravail d'étéRecrutement immédiat
- ...expertise op in vastgoedwaardering, financiële analyse en data. De functie combineert economisch inzicht, modellen, marktinformatie en AI en vraagt vooral één ding: sterk analytisch oordeel. Geen puur uitvoerende rol, maar een omgeving waarin complexe informatie...IndépendantTemps complet
54 $ par heure
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Music & Lyrics Expert - French Type: Contract... ...hours/week Role Responsibilities Evaluate AI-generated music across various genres...Travail à distanceEmploi contractuelTravail d'étéRecrutement immédiat- ...Job Description Join our Data & AI team. You will join a multidisciplinary... ...stakeholders, data teams and AI specialists. You help organizations move beyond AI ambition... ...journey by assessing AI and data maturity, evaluating data readiness, building business cases...StageTemps complet
- ...Albanian Speaking Digital Trust and Safety Specialist About Mercier Consultancy Group Mercier Consultancy Group is one of Europe's most respected international recruitment and business process outsourcing firms, connecting exceptional multilingual talent with world...Temps complet
36614 € par année
...betaalbaar wonen in Vlaanderen mogelijk maken. Als financieel expert binnen de dienst Financiën Woonactoren combineer je financiële... ...overheid in jou. Er zijn veel kansen om bij te leren en specialisten die je helpen beter te worden in je werk. En dankzij de...Emploi contractuelStageEmploi en CDI- ...We currently have a vacancy for an Expert in AI/NLP/ML fluent in English, to offer his... ...specifications; Designing and proposing AI- and cloud-based architectures that are... ...LLMs: fine-tuning, prompting strategies, evaluation, and deployment; At least 2 years of...Emploi contractuelTemps complet
- ...for mission-based Customer Experience Evaluators who are existing luxury brand customers... ...Brand Evaluator, you can perform several evaluations per month and provide your valuable... ...are a team of 220+ customer experience experts and a network of over 80,000 evaluators...Freelance
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Internet-Native Bilingual Evaluator Expert (French) Type: Contract... ...sarcasm, and code-switching. Build evaluation rubrics for bilingual internet communication...Travail à distanceEmploi contractuelTravail d'été
- ...opportunity for you! For our partnership with ING Belgium, we are looking for a matchmaker. About the Role The Expert Talent Advisor (Internal Mobility Specialist) is a new role within ING. As a matchmaker you are responsible for making the match between redundant...Pour les contractants
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Music Production Expert - French Type: Contract... ...hours/week Role Responsibilities Evaluate AI-generated music across various genres...Travail à distanceEmploi contractuelTravail d'étéRecrutement immédiat
- ...cutting‑edge capabilities. With over 1,000 specialists across Belgium, Luxembourg, and the... ...looking for an experienced Social Media Expert to join a high-profile communication team... ..., opportunities, and best practices. Evaluate the effectiveness and impact of social...Temps complet
Voulez-vous recevoir plus d'offres d'emploi ?
S'abonner et recevoir des offres d'emploi similaires à AI Safety Specialist - Evaluation Expert. Soyez parmi les premiers à postuler !





