Software Engineer, AI Coding Tasks
Askable is looking for experienced software engineers to build AI coding tasks from a codebase they know well, turning real changes from a repository into tasks that current AI coding models struggle with.
1 nəfər orijinalı açıb
Texnologiya və bacarıqlar
- Python
- TypeScript
- Go
- Rust
- Java
- C++
- Docker
- Linux
- Git
Why this role is interesting
- US$1,000 per task that passes review with no cap on how many you can do
- Help measure and train today's best AI coding models by creating challenging tasks
- Remote and flexible schedule requiring about 10 hours a week
About the role
Askable is looking for experienced software engineers to build AI coding tasks from a codebase they know well, turning real changes from a repository into tasks that current AI coding models struggle with.
What you'll do
- Complete a short screener interview and upload your resume
- Pick a change from a repository you know and submit a short proposal
- Set up the repository in the platform as it was before the change
- Write the brief, the correct solution, and the grading checks
- Stress-test lazy, incorrect, and shortcut solutions to make sure your checks catch them
- Run your task against leading AI models until strong models often fail but a skilled engineer can solve it
- Revise your task based on reviewer feedback
- Start another task once your current task is accepted
Requirements
- 2+ years of professional software engineering
- Code merged into a public open-source repository or a private codebase you own
- Strong in at least one of Python, TypeScript, Go, Rust, Java or C++
- Solid with Docker, Linux, Git and automated testing
- Regular use of an AI coding tool
- Experience writing tests, rubrics or evaluation criteria
- Ability to explain a change clearly and concisely in your own words
- At least 10 hours a week, starting now
- A secure personal or work computer
Nice to have
- Deep expertise in one area, such as databases, compilers, distributed systems, security or infrastructure
- Experience building agent tasks or RL environments
Terms
- Payment is US$1,000 for each task that passes quality review, paid directly to you
- Sign Askable's contract and accept its terms once your proposal is qualified
- The change and your solution must be your own and free to license to Askable
- Do not publish the work anywhere, including public pull requests or public forks
Benefits
- US$1,000 for each task that passes quality review