AI Safety Practitioner - Expert Evaluator
Mercor
- Travail à distance
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: AI Safety Practitioner
Type: Contract
Compensation: $60–$70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
- Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
- Apply and refine evaluation rubrics for RLHF , SFT , and AI safety benchmarking .
- Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
- Provide structured feedback to improve model alignment and safety performance.
- Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.
Qualifications
Must-Have
- Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
- 5+ years of professional experience in AI Safety , Trust & Safety, journalism, public policy, scientific research, security, or a related field.
- Excellent written English , critical thinking, and analytical reasoning skills.
- Ability to consistently evaluate nuanced and policy-sensitive scenarios.
Preferred
- Experience with AI Safety , RLHF , SFT , Trust & Safety, or AI evaluation.
- Familiarity with safety policies, content moderation, or evaluation rubric development.
- Experience reviewing complex, high-risk, or ambiguous content.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Montrer un mail
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
- ...technical talent with leading AI research labs. Headquartered in... ...Dorsey . Position: AI Safety Red Teamer Type: Contract... ..., and policy failures. Evaluate model robustness across... ...prompt engineering, or adversarial evaluation methodologies. Expertise...SuggéréTravail à distanceEmploi contractuelTravail d'été
- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: AI Safety Experts — English & Dutch Type: Contract Compensation:...SuggéréTravail à distanceEmploi contractuelTravail d'été
- ...Certainement. Audacieux aussi. Description de la fonction En tant qu'AI Engineer, vous êtes chargé-e de concevoir, de développer et d'... ...gestion des accès, audit et validation de l'input/output. - Évaluation et assurance qualité — Mettre en place des évaluations, des...SuggéréSalaire horaireTemps completÀ distance
400 $ par mois
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...SuggéréTravail à distanceEmploi contractuelTravail d'été- ...expanding its network of Senior Freelance Evaluation Experts to support proposals and implementation... ...Climate & Energy Policy Health, Safety & Employment Occupational Safety & Health... ...Artificial Intelligence (AI) Digitalisation of Work Platform Work...SuggéréFreelance
- ...werknemers snel kan laten evolueren, ongeacht hoe snel ze van job veranderen. Handig? Jazeker, en uitdagend ook. Functieomschrijving Als AI Engineer ben je verantwoordelijk voor het ontwerpen, bouwen en integreren van AI-functionaliteit. Je vertaalt use cases naar...Temps completÀ distance
- ...Mission Overview: The client is seeking an AI Coach - Expert for a consultancy mission delivered by Keystone Solutions. As a Keystone Solutions consultant, you will represent our values and expertise while working on-site at the client, focusing on the adoption and...Travail à domicile
62558.9 € par année
...Belgische digitale omgeving veiliger! Het AI Lab binnen de dienst Netwerkveiligheid... ...(CRA); het begrijpen, analyseren en evalueren van AI-systemen. Het AI Lab heeft als... ...tussen de leden. Als AI-Lab Expert draag je bij aan de uitwerking van het toezichtbeleid...Emploi contractuelTravail temporaireMissionsÀ distance- ...seeking a high volume of Dutch-speaking coding experts with JSON expertise to combine language fluency, customer service judgment, and technical evaluation skills to help improve the quality, accuracy, and usability of AI-generated outputs, in an audio format. Work is...Emploi contractuelTravail supplémentaire
- AI Expert Team lead Position Description We are looking for a high-potential, fast-rising AI leader to build and drive one of our AI teams. This role is ideal for someone early in their leadership journey who has already demonstrated exceptional technical ability,...Emploi contractuelRecrutement immédiat
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Music Audio Expert - Dutch Type: Contract Compensation... .../week Role Responsibilities Evaluate AI model output for lyrics and voice...Travail à distanceEmploi contractuelTravail d'étéRecrutement immédiat
3474 € - 5956 € par mois
...correcte en coherente toepassing van de reglementering inzake medische materie, ten dienste van de ziekenfondsen en hun leden. Expert 360° Business Unit Medisch zijn bij de Onafhankelijke Ziekenfondsen betekent: Je levert, beheert en actualiseert informatie over...Emploi contractuelTemps completTravail à domicile3 jours par semaine- ...organizations reach their goals through the smarter use of data and AI. With over 300 successful projects completed in Belgium and... ...AI tools (LLMs, agents, copilots) in actual project work, as a practitioner. Statistical packages and ETL tools (Python, R, Spark, SAS,...Temps completÀ distance
3474 € - 5956 € par mois
...application correcte et cohérente de la réglementation en matière médicale, au service des mutualités et de leurs membres. Être un(e) Expert 360° Business Unit Médicale aux Mutualités Libres, au quotidien, c’est : Fournir, gérer et mettre à jour l’information relative...Salaire horaireEmploi contractuelEmploi saisonnierTemps complet- ...We currently have a vacancy for an Expert in AI/NLP/ML fluent in English, to offer his... ...specifications; Designing and proposing AI- and cloud-based architectures that are... ...LLMs: fine-tuning, prompting strategies, evaluation, and deployment; At least 2 years of...Emploi contractuelTemps complet
- ...for mission-based Customer Experience Evaluators who are existing luxury brand customers... ...Brand Evaluator, you can perform several evaluations per month and provide your valuable... ...are a team of 220+ customer experience experts and a network of over 80,000 evaluators...Freelance
- ...That's where Nodalview comes in. Our AI-powered platform helps them create standout... ...fine-tuning methods, mainly LoRA . Evaluate and benchmark image generation models ,... ...projects: from idea, to fine-tuning and evaluation, to production with latency and cost optimization...StageTravail à domicile
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Internet-Native Bilingual Evaluator Expert (French) Type: Contract... ...sarcasm, and code-switching. Build evaluation rubrics for bilingual internet communication...Travail à distanceEmploi contractuelTravail d'été
- ...shape it together. Job Description Join our Data & AI team. You will join a multidisciplinary Data & AI team that helps... ...stages of their AI journey by assessing AI and data maturity, evaluating data readiness, building business cases and helping prioritize...StageTemps complet
- ...AI Transformation Manager Rejoignez Artefact Belgique : Construisez les fondations de l'IA et de la transformation des données... ...réglementaires. 1. Identification et priorisation des cas d'usage Évaluer les processus et pratiques métier existants pour détecter les...Alternance
- ...beauté, de la joaillerie ou encore de l'automobile. À propos du poste : En tant qu'évaluateur/évaluatrice de marques de luxe, vous entrerez dans l'univers du luxe pour évaluer discrètement l'expérience client en donnant un avis essentiel qui aidera les marques à...
- ...verifiëren. Het opstellen van een veiligheidsactieplan om dynamisch risicobeheer te organiseren kan de volgende stap zijn. Onze Safety Business Unit levert verschillende diensten: Juridische diensten (sitecoördinatie volgens lokale wetgeving)...Emploi en CDITemps complet
36614 € par année
...en samen met ons kwaliteitsvol, toegankelijk, woonzeker en betaalbaar wonen in Vlaanderen mogelijk maken. Als financieel expert binnen de dienst Financiën Woonactoren combineer je financiële expertise, rapportering, databeheer en teamcoördinatie. Je staat mee...Emploi contractuelStageEmploi en CDI- ...COSMOTE Global Solutions NV is seeking a skilled Data & AI Engineer to join our dynamic ICT team. As part of the OTE Group of Companies, we specialize in delivering cutting-edge ICT solutions and services spanning Cloud Services, Data Centre operations, Networking, Cybersecurity...Emploi contractuel
- ...new. You will be based in in Brussels as part of our Tech & AI team. Tech & AI helps enterprises think strategically about how... ...looking for sharp advice on technology. With a team of 2,100 experts and consultants across 60 countries, McKinsey Tech and AI works...
- ...Joining Collibra's Talent Management & Development team AI is fundamentally reshaping how organizations operate. At Collibra, we... ...identify high-value AI and automation opportunities Help teams evaluate opportunities based on business impact, feasibility and...
- ...Are you ready to join the forefront of technology as a AI Specialist in Netcompany? As an AI Specialist you will... ...Knowledge of prompt engineering techniques, including prompt design, evaluation, optimisation, and analysis of model behaviour. Hands-on experience...
- ...About the Role Next Ventures is currently supporting one of our clients in Brussels, and we're looking for a few AI Engineers for the role. ~ This is a freelance contract ~2 Years in a production environment is required Responsibilities # Translate...Emploi contractuelFreelance
47363.64 € par année
...rédigez une brochure d’information à cet effet. Vous évaluez, avec d’autres experts, les propositions de projets introduites. Vous dirigez... ...scientifiques (ou équivalent) Vous êtes capable d'analyser et évaluer des propositions de projet et des rapports scientifiques...Salaire horaireEmploi contractuelAlternanceÀ distance- ...French AI Product Tester Location: 100% Remote, global Device: Applicants must own a qualifying Google Pixel device for... ...ready to start without delay. Project Requirements Native or expert-level fluency in French as spoken in France (fr-FR)...Emploi contractuelTravail supplémentairePour les contractantsÀ distanceRecrutement immédiat
Voulez-vous recevoir plus d'offres d'emploi ?
S'abonner et recevoir des offres d'emploi similaires à AI Safety Practitioner - Expert Evaluator. Soyez parmi les premiers à postuler !





