Bilingual Evaluator for AI

New

Skills

AI model evaluation Bilingual writing Critical thinking Cultural contextualization Instructional design Language mastery Linguistic nuance Prompt engineering Quality assurance Technical writing

Mercor is seeking native Spanish speakers from the United States, Spain, Chile, or Mexico with exceptional writing skills to contribute to a high-impact AI research project with a leading lab. Freelancers will author Spanish/English prompt–golden answer pairs that train and evaluate advanced language models.

Key Responsibilities
  • Create detailed prompts in Spanish and/or English with multiple constraints and instructions.
  • Establish high-level expectations for correct responses in various consumer contexts.
  • Run prompts through models and assess preliminary outputs for accuracy and cultural fit.
  • Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor.
  • Help shape the next generation of AI systems in your area of expertise.
Required Skills & Qualifications
  • Native Spanish speaker from the U.S., Spain, Chile, or Mexico.
  • Exceptional writing skills in both Spanish and English.
  • Deep familiarity with local language usage, tone, and cultural context.
  • Strong critical thinking and instructional clarity.
  • Experience in creating prompts and evaluation rubrics.

No forms. Your profile is generated instantly.

Job Type: Remote

Salary: Not Disclosed

Experience: Entry

Duration: Months

Share this job:

Similar Jobs

Bilingual French Evaluator

Posted 29 days ago

Identify and hire native French speakers from specific regions.

Create language prompts for AI training.

AI model evaluation Bilingual proficiency (French/English) Critical thinking Cultural context understanding

Bilingual Evaluator Expert

Posted 20 days ago

To find native German speakers for AI research.

To create and evaluate language model prompts.

AI model evaluation Bilingual proficiency in German and English Critical thinking Cultural competency

Bilingual Spanish Evaluator

Posted 20 days ago

Recruit native Spanish speakers from specified countries.

Create prompts for training AI models.

AI language models Benchmarking Bilingual writing Critical thinking

AI Research Evaluator

Posted 32 days ago

Review AI-generated responses for accuracy.

Validate reasoning quality in datasets.

AI evaluation Analytical skills Attention to detail Critical thinking

AI Research Evaluator

Posted 35 days ago

Review AI-generated responses for accuracy.

Identify errors in STEM datasets.

AI evaluation Analytical skills Attention to detail Collaboration

AI Research Evaluator

Posted 33 days ago

Review AI-generated responses for accuracy.

Identify errors in STEM-related datasets.

AI evaluation Analytical skills Attention to detail Critical thinking

AI Research Evaluator Role

Posted 34 days ago

Review and validate AI-generated responses.

Identify errors and inconsistencies in datasets.

AI evaluation Analytical skills Attention to detail Critical thinking

Finance Director Controllership

Posted 33 days ago

Oversee financial closing processes and audits.

Ensure compliance with accounting standards.

Accounting standards assessment Clear communication Critical thinking ERP systems

RN Adult Nursing Evenings

Posted 33 days ago

Provide nursing care in clients' homes.

Document and follow medical orders.

Basic life support (BLS) Client relationship management Critical thinking Documentation and record-keeping

AI Research Evaluator

Posted 33 days ago

To find reviewers for AI reasoning datasets.

To ensure accuracy in AI-generated responses.

AI evaluation Analytical skills Attention to detail Critical thinking

Bilingual French Evaluator

Posted 29 days ago

Identify and hire native French speakers from specific regions.

Create language prompts for AI training.

AI model evaluation Bilingual proficiency (French/English) Critical thinking Cultural context understanding

Trust & Safety Specialist

Posted 21 days ago

Investigate violations of house rules.

Coordinate incident responses across teams.

Communication skills Conflict resolution Critical thinking Cross-functional collaboration

Trust & Safety Specialist

Posted 21 days ago

Investigate reported violations of house rules.

Coordinate cross-functional incident responses.

Communication skills Critical thinking Customer service skills Data analysis

Margin Operations Specialist

Posted 28 days ago

Own and manage daily margin processes.

Collaborate with teams on margin inquiries.

AI integration Automation tools Critical thinking Customer service

Senior Manager, Strategic Finance

Posted 24 days ago

Partner with cross-functional teams to enhance strategic initiatives.

Develop and evolve user growth and monetization models.

Analytical skills Collaboration Critical thinking Dashboard creation

Bilingual Evaluator Expert

Posted 20 days ago

To find native German speakers for AI research.

To create and evaluate language model prompts.

AI model evaluation Bilingual proficiency in German and English Critical thinking Cultural competency

Bilingual Spanish Evaluator

Posted 20 days ago

Recruit native Spanish speakers from specified countries.

Create prompts for training AI models.

AI language models Benchmarking Bilingual writing Critical thinking

Bilingual French Evaluator

Posted 20 days ago

Recruit native French speakers for an AI project.

Create bilingual prompts for language models.

AI research Critical thinking Cultural context expertise English proficiency

RN Adult Nursing

Posted 19 days ago

Provide one-to-one nursing care to clients in their homes.

Document and follow up on medical orders.

Client relationship management Communication skills Critical thinking Documentation and record-keeping

Executive Client Advisor

Posted 19 days ago

Raise awareness of Tanium among senior leaders.

Identify and propose solutions for capability gaps.

Acquisition processes Budgeting processes Communication skills Critical thinking

Trust & Safety Specialist

Posted 17 days ago

Investigate reported violations of house rules.

Coordinate incident responses across departments.

Communication skills Critical thinking Cross-functional collaboration Customer service

Legal Operations Associate

Posted 14 days ago

Manage compliance and legal processes.

Collaborate with cross-functional teams.

Communication skills Critical thinking Cross-functional collaboration Data privacy knowledge

eLearning Content Designer

Posted 20 days ago

Design and develop engaging eLearning courses.

Create supplementary materials like guides and manuals.

Adobe Creative Cloud Adult learning principles Articulate Storyline Collaboration with SMEs

Bilingual French Evaluator

Posted 20 days ago

Recruit native French speakers for an AI project.

Create bilingual prompts for language models.

AI research Critical thinking Cultural context expertise English proficiency

Senior AI Engineer

Posted 31 days ago

Design and build LLM-powered applications for internal automation.

Develop and maintain AI integration pipelines across various systems.

CI/CD pipelines (GitHub Actions/Jenkins/CircleCI) Cloud (AWS/GCP/Azure) Docker Kubernetes

AI Compliance Manager

Posted 32 days ago

Design and implement AI-native compliance workflows.

Deploy and configure AI agents across compliance use cases.

Accuracy assessment AI agent deployment AI-native workflows Audit readiness

Senior Product Architect

Posted 25 days ago

Conduct customer meetings to gather use cases.

Translate use cases into technical specifications for AI tools.

AI tools API documentation CI/CD pipelines Coding standards

Agentic Systems Software Engineer

Posted 21 days ago

Design and build agentic systems.

Architect multi-step workflows across tools.

Agentic systems CI/CD Cloud infrastructure Full-stack development

Applied AI Engineer

Posted 12 days ago

Build and deploy AI agents for workflow automation.

Collaborate with commercial and PMO teams for process mapping.

AI agents Automation workflows Claude MCP servers

AI Quality Research Engineer

Posted 18 days ago

Design evaluation frameworks for AI output quality.

Improve production prompts through iterative experiments.

AI systems Collaboration tools Data analysis Experimental design

AI Engineer Consultant

Posted 13 days ago

Design and deploy AI/ML solutions.

Develop LLM-powered applications.

AI/ML technologies APIs Azure-based services Cloud-native architecture

LLM Platform Engineer/Lead

Posted 7 days ago

Develop foundational AI tooling and frameworks.

Facilitate integration of AI features across teams.

AI frameworks AI orchestration frameworks Cloud (AWS/GCP/Azure) Distributed systems

AI Backend Software Engineer

Posted 4 days ago

Build and scale AI features for merchants.

Integrate LLMs into user-facing products.

Agent workflows AI experimentation APIs Event-driven services

Senior AI Platform Engineer

Posted 3 days ago

Identify AI enablement needs across the organization.

Collaborate to define metrics and tools for improvement.

Agentic coding tools AI observability AI platform development CI/CD processes

ABA Clinical Director

Posted 42 days ago

Provide clinical leadership for ABA program.

Supervise and develop ABA staff.

BCBA certification Behavioral analysis Clinical supervision Collaboration skills

Member Care Operations Director

Posted 35 days ago

Define and execute Member Care strategy.

Lead and manage Member Care operations.

Automation and AI implementation Budget management Cross-functional collaboration Customer support strategy development

Digital Authentication Associate

Posted 35 days ago

Authenticate and approve item listings.

Remove non-compliant or unsafe listings.

Community engagement Data sensitivity Digital authentication Fashion knowledge

Science Assessment Specialist

Posted 29 days ago

Create standards-aligned Science assessment items.

Transfer existing assessments into the Formative platform.

Assessment item creation Content review and validation Depth of Knowledge (DOK) Digital assessment platforms

AI Model Evaluator

Posted 29 days ago

Contract experienced finance/accounting professionals.

Evaluate AI-generated responses for quality.

Accounting knowledge AI evaluation skills Analytical skills Data analysis

Bilingual French Evaluator

Posted 29 days ago

Identify and hire native French speakers from specific regions.

Create language prompts for AI training.

AI model evaluation Bilingual proficiency (French/English) Critical thinking Cultural context understanding

Science Assessment Specialist

Posted 28 days ago

Create original Science assessment items.

Transfer existing assessments into the Formative platform.

Assessment item creation Depth of Knowledge (DOK) classification Digital assessment platforms Educational assessment design

Science Assessment Specialist

Posted 21 days ago

Create original Science assessment items aligned to standards.

Transfer existing assessments to the Formative platform.

Assessment item development Content validation Depth of Knowledge (DOK) classification Digital assessment platforms

Agency Manager Services

Posted 20 days ago

Supervise the Sector Managers and their activities.

Evaluate home assistance requests and create plans.

Client evaluation Customer service Digital tool proficiency Healthcare collaboration

CRM Campaign Manager

Posted 26 days ago

Own execution of CRM campaigns.

Manage and mentor CRM Associates.

A/B testing CRM campaign management Data analysis Email marketing

ORM Client Delivery Manager

Posted 25 days ago

Manage client relationships and delivery oversight.

Conduct regular client update calls.

ClickUp Client relationship management Communication skills Digital marketing

Science Assessment Item Specialist

Posted 24 days ago

Create original Science assessment items and tasks aligned to standards.

Transfer existing assessments into the Formative platform.

Assessment design Depth of Knowledge (DOK) Digital assessment platforms Educational content development

Sector Manager - Home Services

Posted 20 days ago

Manage home assistance requests effectively.

Evaluate client needs and develop support plans.

Customer service Digital tools proficiency Healthcare coordination Home care management

Bilingual Evaluator Expert

Posted 20 days ago

To find native German speakers for AI research.

To create and evaluate language model prompts.

AI model evaluation Bilingual proficiency in German and English Critical thinking Cultural competency

Bilingual Spanish Evaluator

Posted 20 days ago

Recruit native Spanish speakers from specified countries.

Create prompts for training AI models.

AI language models Benchmarking Bilingual writing Critical thinking

Customer Support Specialist

Posted 19 days ago

Assist customers across various channels.

Maintain high CSAT and QA scores.

Adaptability Communication skills Customer service Problem-solving