Bilingual German Evaluator

New

Skills

AI model evaluation Bilingual proficiency (German/English) Critical thinking Cultural context familiarity Instructional writing Linguistic nuance understanding Prompt design Quality assurance Research collaboration Technical precision

Mercor is seeking native German speakers from Austria, Switzerland, or Germany with exceptional writing skills to contribute to a high-impact AI research project with a leading lab. Freelancers will author German/English prompt–golden answer pairs that train and evaluate advanced language models.

Key Responsibilities
  • Create detailed prompts in German and/or English with multiple constraints and instructions, ensuring natural phrasing and real-world relevance.
  • Establish high-level expectations for correct responses in consumer contexts, developing comprehensive rubrics that account for linguistic nuance.
  • Run prompts through models, assessing preliminary outputs for accuracy, fluency, and cultural fit in German.
  • Collaborate in QA review processes to ensure consistency and reliability across benchmarks.
  • Contribute to training and enhancing AI systems using human expertise.
Requirements & Qualifications
  • Native speaker of German from Austria, Switzerland, or Germany.
  • Exceptional writing skills in both German and English.
  • Deep familiarity with local language usage, tone, and cultural context.
  • Strong critical thinking abilities.
  • Experience in instructional clarity and distilling complex concepts.

No forms. Your profile is generated instantly.

Job Type: Remote

Salary: Not Disclosed

Experience: Entry

Duration: Months

Share this job:

Similar Jobs

ABA Clinical Director

Posted 85 days ago

Provide clinical leadership for ABA program.

Supervise and develop ABA staff.

BCBA certification Behavioral analysis Clinical supervision Collaboration skills

Member Care Operations Director

Posted 78 days ago

Define and execute Member Care strategy.

Lead and manage Member Care operations.

Automation and AI implementation Budget management Cross-functional collaboration Customer support strategy development

AI Research Evaluator

Posted 78 days ago

Review AI-generated responses for accuracy.

Identify errors in STEM datasets.

AI evaluation Analytical skills Attention to detail Collaboration

Digital Authentication Associate

Posted 78 days ago

Authenticate and approve item listings.

Remove non-compliant or unsafe listings.

Community engagement Data sensitivity Digital authentication Fashion knowledge

AI Research Evaluator Role

Posted 77 days ago

Review and validate AI-generated responses.

Identify errors and inconsistencies in datasets.

AI evaluation Analytical skills Attention to detail Critical thinking

Finance Director Controllership

Posted 76 days ago

Oversee financial closing processes and audits.

Ensure compliance with accounting standards.

Accounting standards assessment Clear communication Critical thinking ERP systems

RN Adult Nursing Evenings

Posted 76 days ago

Provide nursing care in clients' homes.

Document and follow medical orders.

Basic life support (BLS) Client relationship management Critical thinking Documentation and record-keeping

AI Research Evaluator

Posted 76 days ago

To find reviewers for AI reasoning datasets.

To ensure accuracy in AI-generated responses.

AI evaluation Analytical skills Attention to detail Critical thinking

AI Research Evaluator

Posted 76 days ago

Review AI-generated responses for accuracy.

Identify errors in STEM-related datasets.

AI evaluation Analytical skills Attention to detail Critical thinking

AI Research Evaluator

Posted 75 days ago

Review AI-generated responses for accuracy.

Validate reasoning quality in datasets.

AI evaluation Analytical skills Attention to detail Critical thinking

Science Assessment Specialist

Posted 72 days ago

Create standards-aligned Science assessment items.

Transfer existing assessments into the Formative platform.

Assessment item creation Content review and validation Depth of Knowledge (DOK) Digital assessment platforms

AI Model Evaluator

Posted 72 days ago

Contract experienced finance/accounting professionals.

Evaluate AI-generated responses for quality.

Accounting knowledge AI evaluation skills Analytical skills Data analysis

Bilingual French Evaluator

Posted 72 days ago

Identify and hire native French speakers from specific regions.

Create language prompts for AI training.

AI model evaluation Bilingual proficiency (French/English) Critical thinking Cultural context understanding

Science Assessment Specialist

Posted 71 days ago

Create original Science assessment items.

Transfer existing assessments into the Formative platform.

Assessment item creation Depth of Knowledge (DOK) classification Digital assessment platforms Educational assessment design

Margin Operations Specialist

Posted 71 days ago

Own and manage daily margin processes.

Collaborate with teams on margin inquiries.

AI integration Automation tools Critical thinking Customer service

CRM Campaign Manager

Posted 69 days ago

Own execution of CRM campaigns.

Manage and mentor CRM Associates.

A/B testing CRM campaign management Data analysis Email marketing

ORM Client Delivery Manager

Posted 68 days ago

Manage client relationships and delivery oversight.

Conduct regular client update calls.

ClickUp Client relationship management Communication skills Digital marketing

Senior Manager, Strategic Finance

Posted 67 days ago

Partner with cross-functional teams to enhance strategic initiatives.

Develop and evolve user growth and monetization models.

Analytical skills Collaboration Critical thinking Dashboard creation

Science Assessment Item Specialist

Posted 67 days ago

Create original Science assessment items and tasks aligned to standards.

Transfer existing assessments into the Formative platform.

Assessment design Depth of Knowledge (DOK) Digital assessment platforms Educational content development

Trust & Safety Specialist

Posted 64 days ago

Investigate violations of house rules.

Coordinate incident responses across teams.

Communication skills Conflict resolution Critical thinking Cross-functional collaboration

Trust & Safety Specialist

Posted 64 days ago

Investigate reported violations of house rules.

Coordinate cross-functional incident responses.

Communication skills Critical thinking Customer service skills Data analysis

Science Assessment Specialist

Posted 64 days ago

Create original Science assessment items aligned to standards.

Transfer existing assessments to the Formative platform.

Assessment item development Content validation Depth of Knowledge (DOK) classification Digital assessment platforms

Agency Manager Services

Posted 63 days ago

Supervise the Sector Managers and their activities.

Evaluate home assistance requests and create plans.

Client evaluation Customer service Digital tool proficiency Healthcare collaboration

Sector Manager - Home Services

Posted 63 days ago

Manage home assistance requests effectively.

Evaluate client needs and develop support plans.

Customer service Digital tools proficiency Healthcare coordination Home care management

Bilingual Evaluator Expert

Posted 63 days ago

To find native German speakers for AI research.

To create and evaluate language model prompts.

AI model evaluation Bilingual proficiency in German and English Critical thinking Cultural competency

Bilingual Spanish Evaluator

Posted 63 days ago

Recruit native Spanish speakers from specified countries.

Create prompts for training AI models.

AI language models Benchmarking Bilingual writing Critical thinking

Bilingual French Evaluator

Posted 63 days ago

Recruit native French speakers for an AI project.

Create bilingual prompts for language models.

AI research Critical thinking Cultural context expertise English proficiency

Customer Support Specialist

Posted 62 days ago

Assist customers across various channels.

Maintain high CSAT and QA scores.

Adaptability Communication skills Customer service Problem-solving

RN Adult Nursing

Posted 62 days ago

Provide one-to-one nursing care to clients in their homes.

Document and follow up on medical orders.

Client relationship management Communication skills Critical thinking Documentation and record-keeping

Executive Client Advisor

Posted 62 days ago

Raise awareness of Tanium among senior leaders.

Identify and propose solutions for capability gaps.

Acquisition processes Budgeting processes Communication skills Critical thinking

Senior Design Engineer

Posted 62 days ago

Lead HV/EHV substation projects.

Collaborate with global engineering teams.

Collaboration tools Compliance analysis Design software (AutoCAD etc.)

Trust & Safety Specialist

Posted 60 days ago

Investigate reported violations of house rules.

Coordinate incident responses across departments.

Communication skills Critical thinking Cross-functional collaboration Customer service

Software Development Engineer in Test

Posted 58 days ago

Develop automated test frameworks.

Maintain quality assurance across software products.

Agile methodologies CI/CD Git Java

Science Assessment Specialist

Posted 57 days ago

Create Science assessment items aligned with standards.

Transfer existing assessments to the Formative platform.

Assessment item writing Depth of Knowledge (DOK) Digital assessment platforms Educational assessment design

Legal Operations Associate

Posted 57 days ago

Manage compliance and legal processes.

Collaborate with cross-functional teams.

Communication skills Critical thinking Cross-functional collaboration Data privacy knowledge

Agency Manager - Home Services

Posted 56 days ago

Manage home assistance requests and evaluations.

Coordinate caregiver assignments based on client needs.

Caregiver coordination Client evaluation Communication skills Customer service

Sector Manager - Agency Opening

Posted 56 days ago

Establish relationships with healthcare professionals.

Report actions to the agency manager.

Adaptability Care plan development Client relationship management Communication skills

Sales Systems Analyst II

Posted 55 days ago

Enhance sales productivity through systems.

Design and implement Salesforce enhancements.

AI technologies Analytical skills Business analysis CRM systems

Localization Coordinator Role

Posted 50 days ago

Manage localization projects from start to finish.

Troubleshoot and improve workflows.

Analytical skills Attention to detail File preparation for translation Glossary management

Linux Engineering Manager

Posted 48 days ago

Lead a team to optimize Ubuntu for new hardware.

Engage with partners for enhanced Ubuntu experiences.

Agile methodologies Customer engagement Debian packaging High-performance hardware

Bilingual Evaluator for AI

Posted 43 days ago

Recruit native Spanish speakers for AI evaluation.

Create Spanish/English prompt-golden answer pairs.

AI model evaluation Bilingual writing Critical thinking Cultural contextualization

Lift Operator Role

Posted 40 days ago

Manage order fulfillment processes.

Ensure inventory accuracy through cycle counts.

Attention to detail Communication skills Cycle counting Forklift operation

Maintenance Technician Role

Posted 36 days ago

Maintain rental properties effectively.

Perform routine and emergency repairs.

Auditing Electrical work HVAC repair Mobile applications

Trade Specialist Role

Posted 29 days ago

Review and validate service estimates.

Provide training on complex maintenance scopes.

Construction estimating Data analysis Home insurance knowledge Pricing strategy

Math Subject Matter Expert

Posted 22 days ago

Khan Academy is looking for a Math Subject Matter Expert to enhance educational resources for Grades 6-12. In this remote freelance role, you will manage freelancers, create engaging syllabus-aligned content, and conduct quality checks. This is an exciting opportunity to contribute to a nonprofit organization dedicated to providing free, world-class education, impacting millions of learners in India and beyond.

Create and improve Math content for Grades 6-12.

Communication skills Educational content development Feedback analysis Freelancer management

Weekend Nurse Position

Posted 22 days ago

The Weekend Nurse role at BAYADA offers an exciting opportunity to provide compassionate, one-to-one care for clients with complex medical needs, including ALS and TBI. As part of a dedicated team, you'll work independently while receiving robust support. This position requires a valid RN license and a passion for adult home care, with flexible scheduling options available. Enjoy competitive pay, the chance to make a real difference in clients' lives, and the opportunity for professional growth within a caring organization.

Support clients with specific medical conditions.

Communication skills Compassionate care Critical thinking Home health care

Solar Lab Manufacturing Lead

Posted 19 days ago

The Solar Manufacturing Lead position offers an exciting opportunity to lead the setup of a state-of-the-art solar lab focused on high-precision assembly. You will manage technology transfers with partners, develop standard operating procedures, and qualify essential manufacturing equipment. With over 5 years of experience required in solar module manufacturing and a strong background in engineering, this role is ideal for someone passionate about advancing solar technology for space applications.

Manage technology transfer with partners.

Collaboration with external partners High-precision assembly Lamination Laser cutting

Supplier Development Engineer

Posted 17 days ago

The Supplier Development Engineer for the Starshield project plays a crucial role in ensuring the continuous supply of copper and fiber harnessing materials. This position offers the opportunity to collaborate with various teams, manage supplier relationships, and implement quality assurance processes. Candidates will engage in identifying new suppliers and analyzing performance metrics to drive improvements. This is an exciting chance to contribute to innovative projects within a leading manufacturing environment.

Collaborate with design and production teams.

APQP AS9100 Copper harnessing Fiber harnessing

AI Marketing Specialist

Posted 14 days ago

Join Knack as an AI Marketing Specialist and drive organic growth through innovative content and social media strategies. At Knack, a leader in the no-code movement, you will leverage AI to enhance marketing effectiveness and ensure brand consistency across platforms. This role offers the opportunity to work independently while collaborating closely with the VP of Marketing on strategic initiatives. If you're passionate about AI and marketing, this is an exciting chance to make a measurable impact in a fast-growing company.

Manage content, SEO, and social media strategies.

AI technologies Automation tools Brand voice consistency Content marketing

GxP Instrument Engineer

Posted 8 days ago

Join a leading biotech company as a GxP Instrument Systems Engineer in Norwood, MA, where you will play a crucial role in ensuring laboratory instrument systems adhere to GxP regulations. You will be responsible for designing, validating, and maintaining these systems while collaborating with quality assurance teams. This opportunity offers the chance to work in a dynamic environment, contributing to innovative solutions and regulatory compliance in the biotechnology field.

Design and validate laboratory instrument systems.

Control systems Cross-functional collaboration Documentation management GxP compliance