Shapd AI
Senior Software Engineer - AI Training
$80 - $140/hourRequired Skills
About Shapd AI
Shapd AI is an expert-led AI data and evaluation company. We connect skilled professionals with AI teams that need reliable human judgment for task authoring, model evaluation, red teaming, rubric design and data quality workflows.
Our work turns real-world expertise into high-signal training data, evaluations and feedback loops that help AI systems learn, reason and perform more reliably.
Job Title: Senior Software Engineer - AI Training
Job Type: Contractor (10-20 hrs a week)
Location: Remote
Job Summary
Apply software engineering expertise to create and evaluate realistic coding tasks that help advanced AI systems reason through real-world development workflows.
In this role, you will apply your domain expertise to help AI teams test capabilities, identify failure modes and build more reliable evaluation workflows. The work is structured, remote and reviewed against clear quality standards.
What You Will Do
- Author practical coding tasks that test reasoning, implementation quality, debugging and codebase understanding.
- Evaluate model responses for correctness, maintainability, performance, edge-case handling and instruction adherence.
- Create clear reference solutions, rubrics and reviewer notes for complex software workflows.
- Identify recurring model weaknesses and communicate them in structured feedback.
Required Skills and Qualifications
- Strong professional experience building and reviewing production software.
- Deep understanding of algorithms, data structures, APIs, tests and debugging workflows.
- Ability to explain technical judgments clearly and follow structured evaluation criteria.
- Comfort working independently in a remote, asynchronous environment.
Preferred Qualifications
- Experience with large codebases, distributed systems, developer tooling or AI-assisted coding.
- Prior work creating technical assessments, coding interviews, benchmarks or educational content.
Process
- Apply to the role and submit your basic profile details.
- Complete a structured screening or calibration step if required.
- Shapd AI reviews your background, availability and domain fit.
- If selected, you receive project-specific onboarding instructions.
Compensation Structure
Compensation depends on project requirements, task complexity and quality standards. Pay ranges are listed for planning purposes and may vary by project scope.
Start Timeline and Availability
Some projects begin quickly, while others depend on client timelines and expert matching. Applying to a role does not guarantee immediate placement, but it helps us evaluate your profile for relevant opportunities.