Bilingual Spanish Evaluator

New

Skills

AI language models Benchmarking Bilingual writing Critical thinking Cultural context understanding Instructional clarity Linguistic nuance analysis Prompt design Quality assurance Technical precision in writing

Mercor is seeking native Spanish speakers from the United States, Spain, Chile, or Mexico with exceptional writing skills to contribute to a high-impact AI research project with a leading lab. Freelancers will author Spanish/English prompt–golden answer pairs that train and evaluate advanced language models.

Key Responsibilities
  • Create detailed prompts in Spanish and/or English that ensure natural phrasing and real-world relevance.
  • Establish high-level expectations for correct responses in various Spanish-speaking contexts.
  • Run prompts through models and assess preliminary outputs for accuracy and cultural fit.
  • Collaborate in QA review processes to ensure consistency and reliability across benchmarks.
  • Document evaluation standards and develop comprehensive rubrics that account for linguistic nuances.
Requirements & Qualifications
  • Native Spanish speaker from the United States, Spain, Chile, or Mexico.
  • Exceptional writing skills in both Spanish and English.
  • Deep familiarity with local language usage, tone, and cultural context.
  • Strong critical thinking skills.
  • Ability to distill complex concepts into well-crafted Spanish text.

No forms. Your profile is generated instantly.

Job Type: Remote

Salary: Not Disclosed

Experience: Entry

Duration: Months

Share this job:

Similar Jobs

Physics AI Research Project

Posted 32 days ago

Advance AI reasoning in physics

Validate and refine AI problem-solving capabilities

Benchmarking phd Remote Collaboration

Management Consulting AI Project

Posted 32 days ago

Benchmark and improve AI model capabilities

Design consulting-style prompts and evaluations

Ai Benchmarking Management Consulting Online Research

Vulnerability Research Engineer

Posted 32 days ago

Improve security detection capabilities in GitLab

Enhance vulnerability research and analysis

Benchmarking Devops Engineer Product Development

Energy Efficiency Account Manager

Posted 32 days ago

Promote energy efficiency concepts and services to customers

Identify cost-effective investments in energy efficiency

Benchmarking

HR Director - Total Rewards

Posted 32 days ago

Lead People Operations and HR functions effectively

Manage Total Rewards and compensation planning efficiently

Benchmarking Compliance Management Finance Technology

Compensation Business Partner

Posted 32 days ago

Collaborate with various stakeholders on compensation issues

Lead benchmarking efforts to ensure competitive compensation levels

Analytical Skills Benchmarking Communication Skills Data Analysis

Strategic Partnership Consultant

Posted 32 days ago

Analyze and advise on strategic partnership frameworks with global card networks.

Develop partner engagement models and contractual approaches.

Benchmarking Financial Analysis Go-to-market Strategies Market Research

Sensor Development Engineering Manager

Posted 32 days ago

Lead a team of Rust engineers for Sensor development

Ensure end-to-end delivery of Sensor features

Benchmarking CI/CD Performance Optimization Rust

Total Rewards Analyst Role

Posted 13 days ago

Maintain compensation records and job data.

Support merit, bonus, and promotion cycles.

AI Tools Benchmarking Benefits Administration Compensation Analysis

BEPS Fellow Position

Posted 14 days ago

Lead outreach to building owners for BEPS support.

Provide energy and emissions reduction services.

Benchmarking Building science Communication skills Data analysis

Model Evaluation Engineer

Posted 15 days ago

Lead end-to-end model evaluation.

Build competitive benchmarking pipelines.

Benchmarking Cloud Infrastructure Data Pipelines Documentation

Model Evaluation Engineer

Posted 10 days ago

Lead end-to-end model evaluation.

Develop benchmarking pipelines.

Benchmarking Cloud Infrastructure Data Pipelines Documentation

Technical Staff - Top Secret

Posted 7 days ago

Design and optimize Starshield AI integrations.

Develop software for government use.

AI/ML API Development Benchmarking Data Analysis

Global Compensation Analyst

Posted 7 days ago

Support global compensation programs and annual cycles.

Conduct compensation analysis for pay equity and benchmarking.

Benchmarking Compa-ratio modeling Compensation analysis Data analysis

Compensation Intern

Posted 6 days ago

Assist in data collection and cleaning for compensation analysis.

Support market research and external benchmarking of pay ranges.

Attention to Detail Benchmarking Communication Skills Compensation Databases

AI Model Optimization Engineer

Posted 5 days ago

Optimize large-scale models using advanced techniques.

Develop pipelines for model conversion and deployment.

Benchmarking C++ (14/17/20) CUDA Efficient Attention Techniques

Compensation Lead Role

Posted 3 days ago

Utilize AI tools for process improvements.

Ensure job architecture supports global expansion.

AI tools Benchmarking Clear communication Data cleaning automation

Computational Protein Scientist

New

Model de novo protein generation.

Optimize protein designs with in-loop data.

AI Integration Benchmarking Biophysics Computational Biology

AI Research Evaluator

Posted 14 days ago

Review AI-generated responses for accuracy.

Validate reasoning quality in datasets.

AI evaluation Analytical skills Attention to detail Critical thinking

AI Research Evaluator

Posted 16 days ago

Review AI-generated responses for accuracy.

Identify errors in STEM datasets.

AI evaluation Analytical skills Attention to detail Collaboration

AI Research Evaluator

Posted 14 days ago

Review AI-generated responses for accuracy.

Identify errors in STEM-related datasets.

AI evaluation Analytical skills Attention to detail Critical thinking

AI Research Evaluator Role

Posted 15 days ago

Review and validate AI-generated responses.

Identify errors and inconsistencies in datasets.

AI evaluation Analytical skills Attention to detail Critical thinking

Finance Director Controllership

Posted 15 days ago

Oversee financial closing processes and audits.

Ensure compliance with accounting standards.

Accounting standards assessment Clear communication Critical thinking ERP systems

RN Adult Nursing Evenings

Posted 15 days ago

Provide nursing care in clients' homes.

Document and follow medical orders.

Basic life support (BLS) Client relationship management Critical thinking Documentation and record-keeping

AI Research Evaluator

Posted 15 days ago

To find reviewers for AI reasoning datasets.

To ensure accuracy in AI-generated responses.

AI evaluation Analytical skills Attention to detail Critical thinking

Bilingual French Evaluator

Posted 10 days ago

Identify and hire native French speakers from specific regions.

Create language prompts for AI training.

AI model evaluation Bilingual proficiency (French/English) Critical thinking Cultural context understanding

Trust & Safety Specialist

Posted 3 days ago

Investigate violations of house rules.

Coordinate incident responses across teams.

Communication skills Conflict resolution Critical thinking Cross-functional collaboration

Trust & Safety Specialist

New

Investigate reported violations of house rules.

Coordinate cross-functional incident responses.

Communication skills Critical thinking Customer service skills Data analysis

Margin Operations Specialist

Posted 9 days ago

Own and manage daily margin processes.

Collaborate with teams on margin inquiries.

AI integration Automation tools Critical thinking Customer service

Senior Manager, Strategic Finance

Posted 6 days ago

Partner with cross-functional teams to enhance strategic initiatives.

Develop and evolve user growth and monetization models.

Analytical skills Collaboration Critical thinking Dashboard creation

Bilingual Evaluator Expert

New

To find native German speakers for AI research.

To create and evaluate language model prompts.

AI model evaluation Bilingual proficiency in German and English Critical thinking Cultural competency

Bilingual French Evaluator

New

Recruit native French speakers for an AI project.

Create bilingual prompts for language models.

AI research Critical thinking Cultural context expertise English proficiency

RN Adult Nursing

New

Provide one-to-one nursing care to clients in their homes.

Document and follow up on medical orders.

Client relationship management Communication skills Critical thinking Documentation and record-keeping

Executive Client Advisor

New

Raise awareness of Tanium among senior leaders.

Identify and propose solutions for capability gaps.

Acquisition processes Budgeting processes Communication skills Critical thinking

Bilingual French Evaluator

Posted 10 days ago

Identify and hire native French speakers from specific regions.

Create language prompts for AI training.

AI model evaluation Bilingual proficiency (French/English) Critical thinking Cultural context understanding

Bilingual French Evaluator

Posted 10 days ago

Identify and hire native French speakers from specific regions.

Create language prompts for AI training.

AI model evaluation Bilingual proficiency (French/English) Critical thinking Cultural context understanding

Bilingual Evaluator Expert

New

To find native German speakers for AI research.

To create and evaluate language model prompts.

AI model evaluation Bilingual proficiency in German and English Critical thinking Cultural competency

Bilingual French Evaluator

Posted 10 days ago

Identify and hire native French speakers from specific regions.

Create language prompts for AI training.

AI model evaluation Bilingual proficiency (French/English) Critical thinking Cultural context understanding

Bilingual Evaluator Expert

New

To find native German speakers for AI research.

To create and evaluate language model prompts.

AI model evaluation Bilingual proficiency in German and English Critical thinking Cultural competency

Bilingual French Evaluator

New

Recruit native French speakers for an AI project.

Create bilingual prompts for language models.

AI research Critical thinking Cultural context expertise English proficiency

ABA Clinical Director

Posted 23 days ago

Provide clinical leadership for ABA program.

Supervise and develop ABA staff.

BCBA certification Behavioral analysis Clinical supervision Collaboration skills

Member Care Operations Director

Posted 17 days ago

Define and execute Member Care strategy.

Lead and manage Member Care operations.

Automation and AI implementation Budget management Cross-functional collaboration Customer support strategy development

Digital Authentication Associate

Posted 16 days ago

Authenticate and approve item listings.

Remove non-compliant or unsafe listings.

Community engagement Data sensitivity Digital authentication Fashion knowledge

Science Assessment Specialist

Posted 10 days ago

Create standards-aligned Science assessment items.

Transfer existing assessments into the Formative platform.

Assessment item creation Content review and validation Depth of Knowledge (DOK) Digital assessment platforms

AI Model Evaluator

Posted 10 days ago

Contract experienced finance/accounting professionals.

Evaluate AI-generated responses for quality.

Accounting knowledge AI evaluation skills Analytical skills Data analysis

Bilingual French Evaluator

Posted 10 days ago

Identify and hire native French speakers from specific regions.

Create language prompts for AI training.

AI model evaluation Bilingual proficiency (French/English) Critical thinking Cultural context understanding

Science Assessment Specialist

Posted 10 days ago

Create original Science assessment items.

Transfer existing assessments into the Formative platform.

Assessment item creation Depth of Knowledge (DOK) classification Digital assessment platforms Educational assessment design

Science Assessment Specialist

New

Create original Science assessment items aligned to standards.

Transfer existing assessments to the Formative platform.

Assessment item development Content validation Depth of Knowledge (DOK) classification Digital assessment platforms

Agency Manager Services

New

Supervise the Sector Managers and their activities.

Evaluate home assistance requests and create plans.

Client evaluation Customer service Digital tool proficiency Healthcare collaboration

CRM Campaign Manager

Posted 8 days ago

Own execution of CRM campaigns.

Manage and mentor CRM Associates.

A/B testing CRM campaign management Data analysis Email marketing