DevOps Engineer - AI Model Evaluator
400 $ par moisMercor
Bruxelles
- Travail à distance
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task
- Compensation tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Montrer un mail
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
L'offre d'emploi a été publiée il y a 4 jours
Des emplois similaires qui pourraient vous intéresserBasé sur l'offre DevOps Engineer - AI Model Evaluator à Bruxelles
400 $ par mois
...technical talent with leading AI research labs.... ...Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)... ...coding agents to complete and evaluate complex infrastructure engineering... ...engineering tasks. Review model-generated implementations...SuggéréTravail à distanceEmploi contractuelTravail d'étéMercor
Bruxellesil y a 8 jours- ...creative and technical talent with leading AI research labs. Headquartered in San... ...week Role Responsibilities Evaluate AI model output lyrics , voice generation, and... ...experience as a music producer, audio engineer, and/or sound mixer. ~ College degree...SuggéréTravail à distanceEmploi contractuelTravail d'étéRecrutement immédiat
Mercor
Bruxellesil y a 5 jours - ...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate AI-generated responses for... ...domains. Apply and refine evaluation rubrics for RLHF , SFT , and... ...feedback to improve model alignment and safety performance...SuggéréTravail à distanceEmploi contractuelTravail d'été
Mercor
Bruxellesil y a 6 jours - ...Solutions NV is seeking a skilled Data & AI Engineer to join our dynamic ICT team. As part of... ...with analytics development and data modelling. Exposure to AI/ML solutions, particularly... ...Engineering Practices Knowledge of DevOps, Git, CI/CD, and pipeline automation....SuggéréEmploi contractuel
- ...Collibra is the context engine that powers trustworthy enterprise AI, giving LLMs and agents... ...Brussels office. Our hybrid model means you’ll work from... ..., instrumenting, and evaluating AI/ML models and treat a... ...~ Experience with agent evaluation frameworks which test tool...Suggéré
98 € par jour
...seeking an experienced Platform Engineer to join a client's AI Engineering team in Braine-... ..., API management, DevOps pipelines, and networking each... ...experiment Continuously evaluate new Azure AI Foundry capabilities... ...(agent frameworks, model deployments, tool integrations...Emploi contractuelRecrutement immédiat525 € par jour
...Data & AI Engineer Freelance Contract €525 per day Hybrid, Brussels EU27 Nationals Only If you're passionate about building... ...for reporting, analytics and AI use cases. Knowledge of DevOps, Git and CI/CD practices. Exposure to AI, machine...Emploi contractuelFreelanceRecrutement immédiat- ...universities and enterprises on AI, Data, and Cloud . About... ...We are looking for an Engineer to join one of our EU public... ...in analytics development, data modelling, and exposure to AI/ML on text... ...traceability. Knowledge of DevOps, Git, CI/CD, and pipeline automation...Temps complet
- ...teams. Due to several planned projects, the team is looking for a DevOps Engineer with a strong development background to support the... ...and CI/CD tools such as Jenkins, GitLab and GitHub. Use of AI tools such as GitHub Copilot while respecting security and privacy...Temps complet
- ...end technical delivery of unstructured AI systems from prototype through stable production... ...for AI features. Partner with engineering, product, sales, and field teams from... ...document AI workflows. Knowledge of model evaluation best practices and experience with...Temps complet
- ...About the Role Next Ventures is currently supporting one of our clients in Brussels, and we're looking for a few AI Engineers for the role. ~ This is a freelance contract ~2 Years in a production environment is required Responsibilities # Translate...Emploi contractuelFreelance
- ...We’re on the lookout for an AI Engineer to join our team of Wizards! As an AI Engniner, your... ..., and deploying machine learning models and AI solutions tailored to various industries... ...-ready, scalable, and adhere to best DevOps/MLOps practices. Leveraging cloud environments...Emploi en CDITemps completRecrutement immédiat
- ...Visium combines strategy, frontier AI, and deep regulated-industry... ...Role As a Senior Data Modeler, you will play a key role in designing... ...scientists, machine learning engineers, and AI specialists. Our focus... ...in agile environments with a DevOps toolchain (CI/CD, Git,...
- ...SFEIR BELGIUM - ⚙️ Cloud/DevOps Engineer - Become an Augmented Expert Brussels | Startup Spirit | AI-Native Group Sharp Tech. Real Impact. Who are we? SFEIR is a technology innovation catalyst at the forefront of the AI revolution. We transform organizations...Emploi en CDI
- ...sleutelrol spelen in de verdere uitbouw van artificiële intelligentie binnen een internationale bedrijfsomgeving? In deze functie zet je AI-opportuniteiten om in concrete oplossingen en werk je samen met diverse stakeholders om innovatie duurzaam te verankeren binnen de...Travail à domicile
- ...the Kubernetes-native AI infrastructure company,... ...Mirantis empowers platform engineering teams to deliver... ...as a platform engineer, DevOps engineer, or cloud architect... ..., inferencing, model serving — you're already... ...record of leading technical evaluations that turn into signed deals...Temps completÀ distance
- ...We are currently looking for a DevOps to strengthen the Cronos Europa team. This is a mid-level / confirmed position. Responsabilities... ...Professional (CDP) certification, AWS Certified DevOps Engineer – Professional, Microsoft DevOps Engineer Expert, Google Professional...Temps complet
- ...Mission: Devops Engineer The DevOps Engineer is responsible for Support development, technical support and other teams in their day to day jobs. You are the “Role model” in quality and all release and deployment aspects and good practices. You are eager in improving...
- ...student to develop the next generation of AI-driven protein design methods that... ...research will involve training machine-learning models on large structure and sequence datasets... ...nanopores. These methods will open the door to engineering sophisticated functionalities into...
- ...potential to grow with us towards the best energy utility ? Are you an ENGINEER ? Then ENGIE , leader of the Energy Transition, wants to... ...have power market understanding and good analytical, data and AI skills. Profiel You recognise yourself in the following...Temps completÀ distance
ENGIE
Bruxellesil y a 8 jours - ...can help you explore your potential and discover new realities in other countries - you can count on us. Are you a savvy DevOps Engineer seeking a new challenge in a dynamic team? We want to know more about you! Tell us about your: solid experience in Cloud Platforms...Temps complet
- DevOps engineer- Openshift Position Description Are you passionate about automation, container platforms, and cloud-native solutions? Join our dynamic team as a DevOps Engineer and help us build scalable, secure, and innovative environments using OpenShift. Your...Emploi contractuelRecrutement immédiat
- ...technical talent with leading AI research labs.... ...Position: Frontend Engineer — Web Replication Preference... ...detail, including box model, typography, color, image... ...look correct. Evaluate responsive behavior and... ...preference labeling, or model evaluation work. Code review...Travail à distanceEmploi contractuelTravail d'été
Mercor
Bruxellesil y a 1 jour - ...Marketing, IT, Design, AI-driven analytics,... ...problem, and it needs an engineer. This is a... ...ComfyUI or similar engines, GPU environments, one... ...product photography to evaluated, production-ready models; Build control-... ...dataset curation to evaluation; Control techniques...À distanceTravail à domicile
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...week Role Responsibilities Evaluate AI model output for lyrics and voice generation... ...experience as a music producer, audio engineer, or sound mixer. ~ College degree...Travail à distanceEmploi contractuelTravail d'étéRecrutement immédiat
Mercor
Bruxellesil y a 9 jours - ...Nodalview comes in. Our AI-powered platform helps... ...you as our next AI Engineer Intern in Paris .... ...pipelines with diffusion models : object removal, virtual... ..., mainly LoRA . Evaluate and benchmark image... ...idea, to fine-tuning and evaluation, to production with latency...StageTravail à domicile
Nodalview
Bruxellesil y a 23 jours - ...creative and technical talent with leading AI research labs. Headquartered in San... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar... ...written feedback and ratings to improve AI model outputs . Compare and rank AI-generated...Travail à distanceEmploi contractuelTravail d'été
Mercor
Bruxellesil y a 4 jours - ...Senior Python / Agentic AI Engineer Capco: Where Innovation Meets Opportunity Capco... ...agentic/LLM systems, planning, simulation and evaluation), rapid prototyping and production... ...structured logging, versioning of prompts and models) to ensure reliability and...À distance
- ...Description Join our Data & AI team. You will join a... ...with colleagues across data engineering, architecture, AI, analytics,... ...assessing AI and data maturity, evaluating data readiness, building... ...assessment, governance, operating models and AI transformation. We...StageTemps complet
70 € - 80 € par heure
...We are seeking a skilled Data Scientist with experience in AWS, AI, and Machine Learning to tackle complex data challenges and drive... ...critical part in developing and implementing advanced algorithms and models that enhance data-driven decision-making across the organization....Emploi contractuelÀ distance
Voulez-vous recevoir plus d'offres d'emploi ?
S'abonner et recevoir des offres d'emploi similaires à DevOps Engineer - AI Model Evaluator. Soyez parmi les premiers à postuler !
