DevOps Engineer - AI Model Evaluator
400 $ par moisMercor
Bruxelles
- Travail à distance
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes.
- Compare outputs from multiple frontier models and assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
- Work independently and asynchronously to meet sprint-based project deadlines.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling .
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task .
- Compensation is tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Montrer un mail
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
L'offre d'emploi a été publiée il y a 8 heures
Des emplois similaires qui pourraient vous intéresserBasé sur l'offre DevOps Engineer - AI Model Evaluator à Bruxelles
400 $ par mois
...technical talent with leading AI research labs. Headquartered... ...Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)... ...coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving...SuggéréTravail à distanceEmploi contractuelTravail d'étéMercor
Bruxellesil y a 4 jours- ...creative and technical talent with leading AI research labs. Headquartered in San... ...week Role Responsibilities Evaluate AI model output lyrics , voice generation, and... ...experience as a music producer, audio engineer, and/or sound mixer. ~ College degree...SuggéréTravail à distanceEmploi contractuelTravail d'étéRecrutement immédiat
Mercor
Bruxellesil y a 14 jours - ...Let's build the future of AI & Data, together At Data Wizards... ...the lookout for bright data engineers, data scientists, machine learning... ...deploying machine learning models and AI solutions tailored to various... ...scalable, and adhere to best DevOps/MLOps practices. Leveraging...SuggéréEmploi en CDITemps completRecrutement immédiat
- ...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate AI-generated responses for... ...domains. Apply and refine evaluation rubrics for RLHF , SFT , and... ...feedback to improve model alignment and safety performance...SuggéréTravail à distanceEmploi contractuelTravail d'été
Mercor
Bruxellesil y a 19 jours - ...Solutions NV is seeking a skilled Data & AI Engineer to join our dynamic ICT team. As part of... ...with analytics development and data modelling. Exposure to AI/ML solutions, particularly... ...Engineering Practices Knowledge of DevOps, Git, CI/CD, and pipeline automation....SuggéréEmploi contractuel
- ...Mission Overview: We are seeking an experienced Azure DevOps Engineer for a consultancy mission at a client site, representing Keystone Solutions. In this role, you will be responsible for designing, developing, and maintaining robust and scalable .NET applications...Temps completÀ distance
Keystone Solutions
Bruxellesil y a 5 jours - ...application solutions since 2016, delivered by local teams and supported, when necessary, by the group's skills and resources. Cloud DevOps Engineer M/F This is your mission Are you passionate about DevOps, automation, cloud environments and production infrastructure ?...Emploi contractuelÀ distance
- ...Collibra is the context engine that powers trustworthy enterprise AI, giving LLMs and agents... ...Brussels office. Our hybrid model means you’ll work from... ..., instrumenting, and evaluating AI/ML models and treat a... ...~ Experience with agent evaluation frameworks which test tool...
- ...Our client currently has a vacancy for an AI Engineer fluent in English, to offer his/her... ...techniques, including data pipelines, metadata/model versioning, and database integration (... ...of modern software engineering and DevOps practices including Git workflows, CI/CD...Temps complet
Black Pen Recruitment
Bruxellesil y a 6 jours - ...end technical delivery of unstructured AI systems from prototype through stable production... ...for AI features. Partner with engineering, product, sales, and field teams from... ...document AI workflows. Knowledge of model evaluation best practices and experience with...Temps complet
- ...universities and enterprises on AI, Data, and Cloud . About... ...We are looking for an Engineer to join one of our EU public... ...in analytics development, data modelling, and exposure to AI/ML on text... ...traceability. Knowledge of DevOps, Git, CI/CD, and pipeline automation...Temps complet
98 € par jour
...seeking an experienced Platform Engineer to join a client's AI Engineering team in Braine-... ..., API management, DevOps pipelines, and networking each... ...experiment Continuously evaluate new Azure AI Foundry capabilities... ...(agent frameworks, model deployments, tool integrations...Emploi contractuelRecrutement immédiat- ...About the Role Next Ventures is currently supporting one of our clients in Brussels, and we're looking for a few AI Engineers for the role. ~ This is a freelance contract ~2 Years in a production environment is required Responsibilities # Translate...Emploi contractuelFreelance
- ...teams. Due to several planned projects, the team is looking for a DevOps Engineer with a strong development background to support the... ...and CI/CD tools such as Jenkins, GitLab and GitHub. Use of AI tools such as GitHub Copilot while respecting security and privacy...Temps complet
- ...Mission: Devops Engineer The DevOps Engineer is responsible for Support development, technical support and other teams in their day to day jobs. You are the “Role model” in quality and all release and deployment aspects and good practices. You are eager in improving...
- ...SFEIR BELGIUM - ⚙️ Cloud/DevOps Engineer - Become an Augmented Expert Brussels | Startup Spirit | AI-Native Group Sharp Tech. Real Impact. Who are we? SFEIR is a technology innovation catalyst at the forefront of the AI revolution. We transform organizations...Emploi en CDI
- ...We are currently looking for a DevOps to strengthen the Cronos Europa team. This is a mid-level / confirmed position. Responsabilities... ...Professional (CDP) certification, AWS Certified DevOps Engineer – Professional, Microsoft DevOps Engineer Expert, Google Professional...Temps complet
- ...teams helpt om het Azure-cloudplatform optimaal te gebruiken. De stakeholders zijn Nederlandstalig en Franstalig. Als Azure DevOps Engineer ontwerp, ontwikkel en onderhoud je robuuste en schaalbare .NET-oplossingen in een Azure-omgeving. Je werkt nauw samen met ontwikkelaars...FreelanceÀ distance2 jours par semaine
EngiFlex
Bruxellesil y a 5 jours - ...technical talent with leading AI research labs. Headquartered in... .... Position: Frontend Engineer Type: Contract... ...visual fidelity in detail: box model and spacing, typography (family... ..., preference-labeling, model-evaluation, or structured code-review work...Travail à distanceEmploi contractuelTravail d'été
Mercor
Bruxellesil y a 10 jours - ...the Kubernetes-native AI infrastructure company,... ...Mirantis empowers platform engineering teams to deliver... ...as a platform engineer, DevOps engineer, or cloud architect... ..., inferencing, model serving - you're already... ...record of leading technical evaluations that turn into signed deals...
9 $ - 30 $ par heure
...Turkish-speaking Mac users to support application-level AI voice and audio evaluation tasks. This project involves installing a specific application... ...assessing application behavior, instruction adherence, model logic, and overall system quality. This is a short-term...Emploi contractuelFreelanceTravail supplémentaireÀ distanceRecrutement immédiat- ...Visium combines strategy, frontier AI, and deep regulated-industry... ...Role As a Senior Data Modeler, you will play a key role in designing... ...scientists, machine learning engineers, and AI specialists. Our focus... ...in agile environments with a DevOps toolchain (CI/CD, Git,...
- ...student to develop the next generation of AI-driven protein design methods that... ...research will involve training machine-learning models on large structure and sequence datasets... ...nanopores. These methods will open the door to engineering sophisticated functionalities into...
- DevOps engineer- Openshift Position Description Are you passionate about automation, container platforms, and cloud-native solutions? Join our dynamic team as a DevOps Engineer and help us build scalable, secure, and innovative environments using OpenShift. Your...Emploi contractuelRecrutement immédiat
- ...technical talent with leading AI research labs.... ...Position: Frontend Engineer — Web Replication Preference... ...detail, including box model, typography, color, image... ...look correct. Evaluate responsive behavior and... ...preference labeling, or model evaluation work. Code review...Travail à distanceEmploi contractuelTravail d'été
Mercor
Bruxellesil y a 14 jours - ...can help you explore your potential and discover new realities in other countries - you can count on us. Are you a savvy DevOps Engineer seeking a new challenge in a dynamic team? We want to know more about you! Tell us about your: solid experience in Cloud Platforms...Temps complet
- ...Mission Overview: Keystone Solutions is seeking a talented 3D Modeller for a consultancy mission at a client site, where you will... ...MR). Experience exporting and integrating assets into a game engine, preferably Unity. Excellent eye for detail, proportion, and...Temps complet
Keystone Solutions
Bruxellesil y a 4 jours - ...creative and technical talent with leading AI research labs. Headquartered in San... ...week Role Responsibilities Evaluate AI model output for lyrics and voice generation... ...experience as a music producer, audio engineer, or sound mixer. ~ College degree...Travail à distanceEmploi contractuelTravail d'étéRecrutement immédiat
Mercor
Bruxellesil y a 22 jours - ...sleutelrol spelen in de verdere uitbouw van artificiële intelligentie binnen een internationale bedrijfsomgeving? In deze functie zet je AI-opportuniteiten om in concrete oplossingen en werk je samen met diverse stakeholders om innovatie duurzaam te verankeren binnen de...Travail à domicile
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar... ...written feedback and ratings to improve AI model outputs . Compare and rank AI-generated...Travail à distanceEmploi contractuelTravail d'été
Mercor
Bruxellesil y a 2 jours
Voulez-vous recevoir plus d'offres d'emploi ?
S'abonner et recevoir des offres d'emploi similaires à DevOps Engineer - AI Model Evaluator. Soyez parmi les premiers à postuler !
