Description

We are seeking excellent software engineers to work with Mercor on a research project with a leading AI startup. In this project, you will help build a benchmark for evaluating their large language model's abilities to solve real-world software issues sourced from GitHub.

Qualifications

• Bachelors or higher degree in Computer Science (or equivalent)
• 4+ years of experience in a software engineering role OR significant contributions to an open source project
• Strong capabilities in Python, Go, C, C++, and/or JavaScript/TypeScript

More Role Details

• The role is fully remote and asynchronous, i.e., you can work according to your own schedule.
• We ask that you work at least part-time weekly (~15-20 hours per week), but you can work longer if you prefer too.
• The project is expected to last between 4-6 weeks.
• This project will be creating a set of evaluations similar to the ones found in the popular SWE-bench and SWE-bench Verified benchmarks.

About Mercor

• Our team is based in San Francisco, CA.
• We specialize in recruiting experts for top AI labs.
• Our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey.

Pay Rate:50-100 USD/hr