Remote Python Engineer — Autonomous Agent Builder

Outlier helps the world’s most innovative companies improve their AI agents by providing human feedback. We collaborate with leading AI organizations to train Large Language Models (LLMs) to function as proactive, multi-step agents.

Our projects focus on teaching these systems how to design, coordinate, and optimize complex, real-world workflows. Whether you are a passionate orchestration guru or an experienced software developer, we want you to help us train the world’s most advanced generative

Write Eval Rubrics Debug Agent Traces Stress Test Agent 2+ years of experience in backend engineering, AI automation, or complex systems integration. Proven ability to build and maintain production-grade software with modular separation (e.g., distinct services for data parsing, logic processing, and reporting). Practical experience building for live, non-mocked environments and handling multi-turn system interactions. Outstanding attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors.