Sr. SWE for Code Reviewing LLM Data Training (Ruby)

About the Company

G2i connects subject-matter experts, students, and professionals with flexible, remote AI training opportunities, including annotation, evaluation, fact-checking, and content review. We partner with leading AI teams, and all contributions are paid weekly once approved, ensuring consistent and reliable compensation.

About the Role

We're hiring a Code Reviewer with deep Ruby expertise to review evaluations completed by data annotators assessing AI-generated Ruby code responses. Your role is to ensure that annotators follow strict quality guidelines related to instruction-following, factual correctness, and code functionality.

Responsibilities

• Review and audit annotator evaluations of AI-generated Ruby code.
• Assess if the Ruby code follows the prompt instructions, is functionally correct, and secure.
• Validate code snippets using proof-of-work methodology...