Model Evaluation Engineer

Conduct comprehensive model evaluations.

Establish and maintain benchmarking pipelines.

Conduct comprehensive model evaluations.

Develop and maintain benchmarking pipelines.

Lead end-to-end model evaluation processes.

Develop and maintain benchmarking pipelines.

Architect alliances with hardware partners.

Identify decision-makers within partner organizations.

Evaluate models across accuracy and latency.

Build benchmarking pipelines for competitive analysis.

Support delivery of data center programs.

Manage timelines and project scope.

Conduct comprehensive model evaluations.

Establish and maintain benchmarking pipelines.

Partner with engineering leaders for sourcing plans.

Lead sourcing across infrastructure and AI technology.

Unify technology strategy and enhance decision-making.

Oversee cross-functional initiatives from start to finish.

Develop and maintain ML platform infrastructure.

Provide shared components for deployment and API design.

Build automation tools for resource delivery.

Collaborate with engineering teams for quality product delivery.

Lead strategic partnerships with key industry players.

Develop go-to-market strategies for AI and GPU deployments.

Ensure user privacy across data handling.

Develop tools for privacy enhancement.

Lead security and infrastructure strategy.

Manage and develop security teams.

Conduct comprehensive model evaluations.

Develop and maintain benchmarking pipelines.

Lead end-to-end model evaluation processes.

Develop and maintain benchmarking pipelines.

Lead end-to-end model evaluation.

Build competitive benchmarking pipelines.

Serve as the primary contact for Aviation accounts.

Manage onboarding and account tasks post-signature.

Hiring for a remote Product Manager position.

Position is full-time and has no geographical restrictions.

Building advanced AI systems powered by LLMs and intelligent agents

Developing scalable backend systems

Build and productionize advanced AI systems

Develop scalable LLM-powered applications and agents

Build and deploy scalable AI systems for production use.

Develop advanced multi-agent architectures and conversational AI.

Lead design and development of data warehouse and analytics platform

Elevate engineering standards at Level AI

Expand and optimize data architecture

Assemble complex data sets

Lead research direction for advanced AI systems

Guide the design of cutting-edge RAG systems

Evaluate LLM-generated responses

Conduct fact-checking on model responses

Connect chemistry experts to AI projects

Improve AI model reasoning in chemistry

Support AI model development with expert mathematics input

Evaluate and refine AI-generated mathematical responses

Collaborate remotely on AI projects

Enhance generative AI with domain expertise

Enhance AI with civil engineering expertise

Generate and evaluate AI prompts

Improve conversational AI systems

Assess model-generated responses

Architect and maintain evaluation suites

Build scalable pipelines for model training

Define AI/ML agents for reliability

Prototype agent behaviours

Develop and maintain Python code for data analysis, model evaluation, and AI workflow automation.

Design and refine prompts for LLMs to optimize conversational performance.

Lead and own the Intelligence Catalog and taxonomy

Drive improvements in noise reduction and precision/recall metrics

Conduct comprehensive model evaluations.

Develop and maintain benchmarking pipelines.

Lead end-to-end model evaluation processes.

Develop and maintain benchmarking pipelines.

Lead end-to-end model evaluation.

Build competitive benchmarking pipelines.

Drive adoption of Ubuntu Pro in enterprise settings

Understand and address customer requirements

Lead team towards high-impact solutions, Work collaboratively with scientific teams, Stay updated

cutting-edge tools, Develop novel assays, Efficiently allocate team

Understand user experiences with agentic AI systems

Gather insights from developers and practitioners in the field

Implement public-key cryptography for client security.

Facilitate device addition and revocation for user accounts.

Implement public-key cryptography for secure client-server communication.

Enable clients to manage device access through per-device keys.

Analyze and quantify sustainability solutions

Assess projects for investment impact

Lead research, design, and development of secure solutions.

Apply innovative security primitives and attestation capabilities.

Develop validation and regression tools for image sensors and pipelines

Perform lab and real-world camera data collection and analysis

Test, validate, and debug RF control systems

Operate and maintain cryogenic and vacuum systems

Design and implement firmware for embedded devices

Manage project tasks and day-to-day activities