AI Platform Lead Engineer

New

Skills

Airflow BigQuery Dataflow Pyspark Python SQL

Join AssemblyAI as a Lead AI Platform Engineer and drive the development of scalable, future-proof data platforms optimized for cutting-edge AI research. This fully remote position is available to candidates based in the United States. You will design and implement efficient data pipelines, manage large-scale ML infrastructure, and lead the adoption of advanced tooling to accelerate team performance in a fast-paced startup environment.

Key Responsibilities
  • Design and build scalable data platforms optimized for AI research workloads.
  • Develop efficient data pipelines using advanced GCP services.
  • Implement cost-effective storage and monitoring solutions for large-scale ML operations.
  • Optimize resource allocation and management for maximum training efficiency.
  • Lead adoption of cutting-edge ML tools and streamline workflows to reduce complexity.
  • Enhance tooling and documentation to improve team velocity.
  • Implement guardrails for cost, quality, and performance.
  • Participate in on-call rotation to ensure system reliability.
  • Identify and eliminate technical bottlenecks in training pipelines.
Required Skills & Qualifications
  • 8+ years of experience in AI/ML infrastructure or research platform engineering.
  • 3+ years in an AI data and infrastructure or similar role.
  • Strong proficiency in Python and SQL.
  • Expertise with GCP services including BigTable, BigQuery, Dataproc, and Dataflow.
  • Experience with distributed processing frameworks (e.g., Apache Beam, PySpark).
  • Familiarity with workflow orchestration tools (e.g., Airflow, Composer, Astronomer).
  • Understanding of distributed training systems and data loading optimization.
  • Experience with experiment tracking and training tooling.
  • Ability to thrive in a dynamic, fast-paced startup environment.
  • Excellent problem-solving and communication skills.

No forms. Your profile is generated instantly.

Job Type: Remote

Salary: Not Disclosed

Experience: Entry

Duration: 12.0 Months

Share this job:

Similar Jobs

Software Engineer III, Google Cloud

Posted 57 days ago

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another.

Python

LLVM Compiler Developer

Posted 54 days ago

Develop and enhance LLVM and Clang based toolchain components

Collaborate with LLVM community for continuous integration

Back-end Bash C C++

Compiler Engineer (LLVM, C++)

Posted 54 days ago

Hiring experienced Compiler Engineers for LLVM and Clang toolchain development

Responsibilities include analyzing requirements, designing, and collaborating with the LLVM community

Back-end Bash Communication Llvm

LLVM Compiler Developer Role

Posted 54 days ago

Enhance and maintain LLVM/Clang-based toolchains

Support and optimize code for diverse platforms

Back-end Bash C++ Communication

Junior Mobile Security Tester

Posted 54 days ago

Conduct security testing on mobile and web applications

Identify and document vulnerabilities in digital banking platforms

Android Bash JavaScript Penetration Testing

Junior Web/Mobile Pen Tester

Posted 54 days ago

Ensure security of mobile and web banking applications

Identify and document vulnerabilities through penetration testing

Android JavaScript Penetration Testing Python

Senior Full Stack Engineer

Posted 54 days ago

Develop and maintain full stack web and mobile applications.

Implement and automate robust backend API services.

Angular API Design AWS CI/CD

LLVM Compiler Engineer Role

Posted 54 days ago

Enhance and implement LLVM toolchain components

Extend open source compilers for new platforms

Back-end Bash C++ Communication

LLVM Compiler Engineer

Posted 54 days ago

Seek experienced Compiler Engineers for LLVM and Clang toolchain

Collaborate with LLVM community and contribute to public repositories

Back-end Bash Communication Llvm

LLVM Compiler Development

Posted 54 days ago

Enhance and implement components of the LLVM toolchain

Extend open source LLVM and Clang code bases

Back-end Bash Communication Llvm

LLVM Compiler Developer

Posted 54 days ago

- Enhance and implement toolchain components - Extend LLVM and Clang for client platforms -

ate with LLVM community - Analyze, build, and debug platform code - Develop and maintain target

Bash Python Version control

Senior Golang Developer Role

Posted 54 days ago

Develop cloud-based cyber protection solutions

Design and maintain high-load distributed services

Algorithms Architecture Cloud Services Data Structures

Senior Go Cloud Developer

Posted 54 days ago

Develop scalable cloud disaster recovery services

Design and implement high-load distributed systems

Algorithms Architecture Cloud Cloud Services

Remote AI Analyst

Posted 54 days ago

Drive customer experience automation

Optimize business processes with AI solutions

Ai Business Analyst Data Analysis Data Visualization

Pricing Strategy Analyst Role

Posted 54 days ago

Hire a remote pricing analyst

Optimize business pricing strategies

Data Analysis Data Visualization Excel Financial Modeling

Senior Marketing Analyst Role

Posted 54 days ago

Offer a remote full-time analyst position

Drive business growth through marketing analytics

Cross-functional Collaboration Customer Experience Data Analytics Digital Marketing

Principal AI Engineer Role

Posted 54 days ago

Hire a remote Principal AI Engineer

Develop customer experience automation solutions

Ai Automation AWS Cloud Computing

ML Engineer - AdTech

Posted 54 days ago

Design and implement ML systems|Apply optimization strategies|Collaborate with teams|Analyze data

r user behavior|Develop data

C++ Data Analysis Java Machine Learning

Affirm Senior Backend Engineer

Posted 54 days ago

Lead a team of engineers through ambiguity to solve problems

Collaborate with various stakeholders in product development

Android AWS Code Review Distributed systems

Software Engineer II, Backend

Posted 54 days ago

Develop backend systems for credit decisioning.

Collaborate with team members and stakeholders.

Android AWS Backend Systems Code Review

Software Engineer Role

Posted 54 days ago

Contribute to team projects and goals

Maintain system stability while achieving business goals

Code reviews Css Debugging Html

Senior Software Engineer - BizTech

Posted 54 days ago

Solve challenging problems for Airbnb and users

Remove friction from user journey

Android C++ Engineer Java

Transaction Monitoring Lead

Posted 54 days ago

Hiring a Transaction Monitoring Lead to enhance compliance capabilities

Optimizing TM rules and alert systems to reduce false positives

Automation Documentation Fraud Detection Monitoring

Transaction Monitoring Manager

Posted 54 days ago

Lead and scale transaction monitoring operations

Optimize and automate AML controls and alert logic

Automation Data Analysis Documentation Monitoring

Business Development Rep

Posted 54 days ago

Conduct regular outbound activities to key web3 prospects

Understand prospective customers' goals and assess how Allium.so can help

Blockchain Business Development Collaboration Tools Communication Skills

Blockchain Solutions Engineer

Posted 54 days ago

Engage with customers to understand blockchain data needs

Design and implement tailored data analytics solutions

Blockchain technology Data Analytics Data Security Documentation

Revenue Operations Lead

Posted 54 days ago

Optimize revenue operations for Allium.so's growth

Develop accurate revenue forecasting models

Bi tools Collaboration Tools Crm systems Data Analytics

Growth Engineer at Allium

Posted 54 days ago

Optimize internal customer support processes

Automate customer interactions for efficiency

Blockchain Collaboration Tools Documentation Engineer

Forward Deployed Software Engineer (Data)

Posted 54 days ago

Leading the technical implementation of AI-driven data solutions

Translating customer needs into technical requirements

AWS Communication Skills Engineer Microsoft Azure

Forward Deployed Software Engineer

Posted 54 days ago

Lead technical implementation and optimization of data platform

Serve as primary technical contact for key accounts

Airflow AWS Databricks Engineer

Staff AI Backend Engineer

Posted 54 days ago

Architect and maintain high-performance backend infrastructure

Integrate advanced AI and LLM technologies into data workflows

AWS Docker Engineer FastAPI

Staff Software Engineer Role

Posted 54 days ago

Lead backend development for AI-powered data solutions

Architect scalable systems and APIs for enterprise clients

Agile Methodologies Angular AWS CI/CD

Staff Software Engineer, AI Backend

Posted 54 days ago

Design and build scalable AI-driven backend systems

Integrate advanced language models into data workflows

AWS Docker FastAPI Google Cloud Platform

Staff Software Engineer

Posted 54 days ago

Revolutionize enterprise data operations through AI solutions.

Automate and accelerate data tasks for overworked data teams.

Ai Airflow Ansible Api Development

AI-Powered Data Operations Revolution

Posted 54 days ago

Revolutionize enterprise data operations through AI automation.

Develop high-performance backend systems for AI solutions.

Docker Engineer FastAPI Python

Remote Business Operations Analyst

Posted 54 days ago

Offer a 100% remote analyst role

Simplify insurance billing operations

Business Operations Communication Skills Data Analysis Microsoft Excel

Healthcare Data Architect

Posted 54 days ago

Revolutionize healthcare data management through scalable pipelines and real-time analytics.

Lead data strategy and architecture to enhance healthcare visibility and awareness.

Cloud-native architecture Data Migration Data Modeling Data Warehousing

Marketing Analytics Manager

Posted 54 days ago

Descriptive Analytics: Build and automate reporting dashboards, Analyze marketing campaign

ness; Diagnostic Analytics: Investigate factors influencing app rank position, Conduct ad-hoc

A/b Testing Data Analysis Data Visualization Tools Predictive Modeling

Data Lead: ETL & Analytics

Posted 54 days ago

Improve data infrastructure Optimize performance and accessibility Enable data-driven

g Collaborate with cross-functional teams Mentor and lead data

Airflow Analytics AWS BigQuery

Senior Data Scientist Role

Posted 54 days ago

Hire a remote Senior Data Scientist

Enhance product with data-driven insights

A/b Testing Big Data Communication Cross-functional Communication

SMB Sales Operations Manager

Posted 54 days ago

Hire experienced sales operations manager

Optimize SMB sales processes

Crm Management Data Analysis Excel Hubspot

Finance Strategy Senior Manager

Posted 54 days ago

Recruit a remote finance and strategy leader

Support product growth through financial insights

Cross-functional Collaboration Data Analysis Finance Financial Modeling

Remote Senior Data Engineer

Posted 54 days ago

Hiring a remote Senior Data Engineer for Apollo

Full-time position in Poland

AWS BigQuery Cloud Data

Senior Customer Success Engineer

Posted 54 days ago

Provide exceptional support to developers

Optimize app development using Apollo's tools

Agile Methodology Api Integration Cloud Computing Communication Skills

Backend Engineer

Posted 54 days ago

Design and implement scalable backend endpoints

Mentor team members on best practices

Ansible Api Development AWS Docker

Senior Backend Engineer

Posted 54 days ago

Develop scalable backend solutions

Mentor team members

Angular Api Development Architecture AWS

Staff Backend Engineer

Posted 54 days ago

Lead technical direction and complex initiatives

Architect and build scalable systems

Ai Tools Architecture Computer science Distributed systems

Staff AI Engineer

Posted 54 days ago

Building advanced AI systems powered by LLMs and intelligent agents

Developing scalable backend systems

A/b Testing Api Integration Architecture AWS