AI Agent Evaluation Engineer - Remote
- Employment type
- Contract · On-site
- Posted
- September 26, 2026
- Salary range
- $166,400–$249,600 CAD per year
- Province
- Alberta (AB)
Hiring confidence: Some gaps · 56/100
Some signals are missing from this posting. It may well be genuine, but it is worth confirming the role is still open before you invest time in applying. How this is scored
Job Overview
This role is based in Alberta. YO AI Labs is hiring for this contract position through Jobily, where you can check how well your resume matches the posting before you apply.
Market context
About this role in Alberta
Average salary for AI Agent Evaluation Engineer - Remote in Alberta
We do not have a salary benchmark for this title in Alberta yet. The posting advertises $166,400–$249,600.
NOC code
This posting has not been matched to a NOC 2021 unit group yet. Use the NOC finder to identify the code from the duties listed above.
Typical qualifications for Canadian employers
- Senior-level software engineering experience
- Experience with reinforcement learning
- Knowledge of Model Context Protocol (MCP) tools
- Ability to design reproducible environments
- Experience with deterministic verification
Fit check
Is this role right for you?
Top skills this posting asks for:
- Reinforcement Learning
- Model Context Protocol (MCP)
- Software Engineering
Jobily reads your resume against this posting and scores the fit — the skills you already have, the gaps, and what to change before applying. Signed-in Premium members see the score at the top of this page.
Scan your resume to see your fitKeep looking
Similar jobs
What you'll do
- Create reinforcement learning environments for AI model evaluation
- Evaluate AI models on complex software engineering tasks
- Design reproducible environments
- Implement deterministic verification systems
- Develop reference solutions for tasks
- Support AI training projects
- Handle bug fixing and feature implementation tasks
What you'll need
- Senior-level software engineering experience
- Experience with reinforcement learning
- Knowledge of Model Context Protocol (MCP) tools
- Ability to design reproducible environments
- Experience with deterministic verification
- Remote work capability
- Availability for ~15 hours/week contractor role