BIS Software Engineer

New

Skills

Autoscaling Backend Infrastructure Benchmarking Distributed Systems LLM Inference Observability Platform Engineering Release Automation Routing Scheduling

Join our innovative team as a Software Engineer for the BIS (Baseten Inference Stack) project, where you will develop cutting-edge infrastructure for large-scale LLM inference. This role allows you to work across the entire stack, from customer features to low-level infrastructure, creating impactful platform capabilities.

Key Responsibilities
  • Develop infrastructure and orchestration for large-scale LLM inference.
  • Build platform capabilities for routing, autoscaling, scheduling, and observability.
  • Collaborate with Model Performance engineers for inference optimizations.
  • Define best practices for testing, release automation, and benchmarking.
Required Skills & Qualifications
  • Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, or related field.
  • Strong background in distributed systems, backend infrastructure, or platform engineering.
  • Experience building production systems with a focus on reliability, latency, and scale.
  • Strong sense of developer experience and system usability.
  • Motivated to learn new languages, frameworks, and systems.

No forms. Your profile is generated instantly.

Job Type: Remote

Salary: Not Disclosed

Experience: Entry

Duration: Months

Share this job:

Similar Jobs

Remote Admin Assistant Role

Posted 78 days ago

Hire a remote administrative professional

Support executive and team operations

Administrative Support Calendar Management Communication Skills Google Workspace

Remote Technical Program Manager

Posted 78 days ago

Hiring a remote Technical Program Manager at Axios.

Full-time position that can be done remotely anywhere in the United States.

Budget Management Collaboration Communication Cross-functional Collaboration

Real-Time Support Analyst

Posted 78 days ago

Manage and optimize customer support schedules in real time

Monitor adherence and proactively address staffing gaps

Analyst Forecasting Monitoring Scheduling

Chaos Engineer Lead

Posted 78 days ago

Lead the chaos engineering strategy at Goodnotes.

Design and execute fault injection experiments.

Automation Chaos Engineering Engineer Observability

Senior Engagement Manager UK

Posted 78 days ago

Manage remote client engagements

Drive adoption of Grafana platform

Communication Skills Customer success Grafana Observability

Staff API Engineer Role

Posted 78 days ago

Design and scale high-performance GraphQL APIs

Champion developer-friendly API architecture and standards

API Design GraphQL Observability Python

Remote Appointment Setter

Posted 78 days ago

Identify and engage potential clients for offshore team solutions

Schedule and conduct introductory calls with interested businesses

Business Development Communication Crm English

SRE Engineer UK

Posted 78 days ago

Improve system availability and reliability, Enhance incident response and postmortems, Collaborate

on monitoring solutions, Optimize observability tooling, Mentor engineering

Observability Software Development

Platform Engineering Manager Role

Posted 78 days ago

Lead and mentor engineering teams

Scale and manage cloud infrastructure

AWS CI/CD Cloud Security Infrastructure as code

Physics AI Research Project

Posted 78 days ago

Advance AI reasoning in physics

Validate and refine AI problem-solving capabilities

Benchmarking phd Remote Collaboration

Management Consulting AI Project

Posted 78 days ago

Benchmark and improve AI model capabilities

Design consulting-style prompts and evaluations

Ai Benchmarking Management Consulting Online Research

Travel Concierge Specialist

Posted 78 days ago

Deliver exceptional travel support and service

Resolve urgent travel disruptions rapidly

Crm Crm systems Email Communication English

Senior Software Engineer

Posted 78 days ago

- Lead complex projects in a fast-paced, agile environment - Design and develop high-quality,

le features - Collaborate with cross-functional teams - Stay current with emerging technologies -

Algorithms Data Structures GraphQL Java

Incident Manager Night Shift

Posted 78 days ago

Lead incident response and resolution

Oversee and improve service management processes

Change Management Communication Itil Jira

Logistics Scheduling Representative

Posted 78 days ago

Schedule appointments efficiently, Coordinate with various teams, Optimize customer delivery

es, Improve carrier sourcing, Resolve challenging

agility Communication Skills Customer Service Problem Solving

Remote Publishing Assistant for TED

Posted 78 days ago

Assist in content curation and publication for TED.

Manage and organize publishing schedules.

Collaboration Communication Content management systems Organization

TED Podcast Producer Remote

Posted 78 days ago

Hire full-time remote producer

Produce high-quality podcasts

Audio Editing Communication Content Development Interviewing

Lead Software Engineer

Posted 78 days ago

Lead technical strategy for high-availability systems

Migrate to TypeScript/Node.js across teams

Ai Tools API Design Distributed systems Java

Infrastructure Staff Engineer

Posted 78 days ago

Build and enhance infrastructure capabilities

Maintain and optimize system reliability

Computer science Content management systems Engineer JavaScript

Trust & Safety Engineer

Posted 78 days ago

Develop anti-abuse tools for Wikimedia projects

Design privacy-respecting detection systems

Content management systems Content Moderation Css Drupal

Recruiting Coordinator Project

Posted 78 days ago

Support and coordinate high-volume interview processes

Enhance candidate and interviewer experience

Administrative Support Communication Google Calendar Process Improvement

Engineering Manager - Integration Quality

Posted 78 days ago

Lead and manage a team focused on improving integration quality and reliability

Make product and technical decisions autonomously while seeking alignment on larger decisions

Ai Ai Tools Apis ChatGPT

Remote Junior Tech Success Manager

Posted 78 days ago

- Provide exceptional customer support - Enhance customer experiences - Drive company growth -

inate onboarding processes - Resolve technical

Cloud Computing Customer success Cybersecurity Observability

Neon Blue Data Platform

Posted 78 days ago

Design and build React-based SaaS platform, Implement scalable data systems, Collaborate with

functional teams, Own projects end-to-end, Solve novel data

AWS Node.js Observability PostgreSQL

Social Media Virtual Assistant

Posted 78 days ago

Hire a Virtual Assistant with Social Media Marketing expertise

Manage and grow client's social media presence

Collaboration Communication Content Creation Marketing Analytics

Social Media Virtual Assistant

Posted 78 days ago

Manage clients' online presence

Support the CEO in daily tasks

Communication Skills Content Creation Marketing Analytics Organizational Skills

Skilled Shoot Coordinator Needed

Posted 78 days ago

Recruit skilled Shoot Coordinator

Manage photo and video shoot schedules

Administrative Support Communication Communications Customer Service

RavenTek Remote Job Opportunities

Posted 78 days ago

Enhance client missions

Improve organizational performance

Cloud Computing Cybersecurity Data Analytics Data Management

Executive Assistant Support

Posted 78 days ago

Coordinate scheduling tasks efficiently

Create professional templates in Word and PowerPoint

Client Communication Communications Email Communication Microsoft Powerpoint

Vulnerability Research Engineer

Posted 78 days ago

Improve security detection capabilities in GitLab

Enhance vulnerability research and analysis

Benchmarking Devops Engineer Product Development

Principal Engineer - Multi-Tenant Scale

Posted 78 days ago

Design and evolve GitLab’s multi-tenant platform into distributed systems

Provide technical leadership across infrastructure and development areas

Architecture Cloud Cloud Computing Distributed systems

Principal Engineer - Group Tenant Scale

Posted 78 days ago

Design and evolve GitLab’s multi-tenant platform

Provide technical leadership across infrastructure and development areas

Access control API Design Architecture Cloud

Customer Operations Workforce Analyst

Posted 78 days ago

Drive operational efficiency and customer satisfaction through staffing and scheduling

Forecast workforce needs and adjust staffing levels proactively

Analyst Customer Service Data Analysis Excel

Node.js Developer - Specialist

Posted 78 days ago

Offering exponential growth and support for personal development

Encouraging a remote work environment with flexibility and well-being benefits

Git Node.js Observability Restful Api

Energy Efficiency Account Manager

Posted 78 days ago

Promote energy efficiency concepts and services to customers

Identify cost-effective investments in energy efficiency

Benchmarking

Visa Junior Software Engineer

Posted 78 days ago

Ensure system scalability and reliability

Maintain data integrity across distributed systems

Cloud Computing Devops Distributed systems Go

Pismo Junior Software Engineer

Posted 78 days ago

Ensure reliable and scalable account processing

Support migration from legacy to advanced platforms

Cloud Computing Devops Distributed systems Go

Infra & Platform Manager

Posted 78 days ago

Lead infrastructure and platform engineering teams

Implement scalable and reliable core services

CI/CD Cloud infrastructure Observability Software Architecture

Senior Backend Engineer - Auth Infrastructure

Posted 78 days ago

Build critical infrastructure for authentication and authorization

Optimize performance and reliability of authentication and authorization systems

Architecture Engineer Go gRPC

Junior Software Developer - Observability

Posted 78 days ago

Hiring a Junior Software Developer for observability tools.

Remote full-time position in EMEA.

Go Grafana Java Observability

Eng Manager - Integration

Posted 78 days ago

Build and develop a high-performing team focused on improving integration quality and reliability

Own product and technical decisions for the team's work

Ai Tools Cross-functional Collaboration Documentation Leadership

Client Services Manager, Home Care

Posted 78 days ago

Provide superior customer service and quality home care

Coordinate client services and scheduling issues

Communication Skills Customer Service Healthcare Relationship Building

Regional Clinical Outreach Director

Posted 78 days ago

Lead regional strategy and operations

Manage Clinical Outreach team effectively

Business Development Crm Google Suite Healthcare

Regional Director, Outreach

Posted 78 days ago

Lead regional Go-To-Market efforts

Manage and mentor Outreach Directors/Managers

Business Development English Google Suite Healthcare

Manager, Customer Support Project

Posted 78 days ago

Lead Tier 1 Support team effectively

Monitor and ensure SLAs are met

Data Management Jira Reporting Salesforce

EMEA Sales Engineer Lead

Posted 78 days ago

Lead technical sales with owners and GCs

Translate construction knowledge into customer value stories

Customer success Revenue growth Scheduling

Retail Manager Job

Posted 78 days ago

Assume responsibility for overall store management

Create a welcoming environment for customers

Customer Service Leadership Problem-solving Sales Management