Senior Data Engineer Role

New

Skills

AWS (EMR, Lambda, S3) Batch Processing Cloud-Native Technologies Data Automation Data Modeling and Warehousing Data Pipeline Design Performance Tuning Python or Scala SQL Streaming Data

As a Senior Data Engineer, you will play a critical role in designing and building both batch and streaming data pipelines for ingestion and analytics. You will own the end-to-end delivery of complex data initiatives, including architecture, deployment, and monitoring. Your expertise will help evolve our data platform utilizing modern cloud-native technology.

Key Responsibilities
  • Design and build robust data pipelines for ingestion and analytics.
  • Own end-to-end delivery of complex data initiatives, including architecture and deployment.
  • Automate data operations such as validation, quality checks, alerts, backfills, and recovery.
  • Optimize cost, performance, and reliability of data workloads.
  • Collaborate with Data Science, Product, and Engineering teams to translate requirements into effective solutions.
Required Skills & Qualifications
  • 5+ years of experience in building production-grade data platforms and pipelines.
  • Proficiency in Python or Scala for data processing; SQL for analytics.
  • Experience with distributed data processing using Spark and performance tuning.
  • Familiarity with AWS technologies such as EMR, Lambda, and S3.
  • Understanding of data modeling and warehousing concepts, including partitioning.
  • Experience in monitoring, alerting, incident response, and ensuring the reliability of data pipelines.

No forms. Your profile is generated instantly.

Job Type: Remote

Salary: Not Disclosed

Experience: Entry

Duration: Months

Share this job:

Similar Jobs

Senior Data Engineer Role

Posted 21 days ago

Build and manage data pipelines.

Transform telemetry into datasets.

Batch Processing Cloud Computing (GCP) Data Engineering Data Governance

Data Infrastructure Engineer

Posted 14 days ago

Design and maintain scalable data pipelines.

Develop batch and streaming data systems.

Airflow Batch Processing Cloud Platforms (AWS/GCP) Data Modeling

Azure Migration Engineer

New

Deploy Azure cloud infrastructure.

Manage automation processes.

Automation Tools Azure Infrastructure Batch Processing CI/CD Pipelines

Principal Platform Architect

Posted 17 days ago

Lead the platform engineering team.

Build a foundational platform layer.

API Versioning Backend Engineering Cloud-Native Technologies Distributed Systems

VP Engineering Position

Posted 19 days ago

Lead a multi-director organization across various platforms.

Own and manage performance metrics and expectations.

Cloud-Native Technologies Code Quality Assurance Distributed Systems Event-Driven Architecture

Senior Software Engineer Role

Posted 21 days ago

Take ownership of complex initiatives.

Drive architectural decisions for platforms.

API Development Architectural Design Cloud-Native Technologies Developer Tooling

Safety Research Engineer

Posted 21 days ago

Enhance safety metrics fidelity.

Analyze urban driving data using distributed computing.

Collaboration Skills Data Automation Distributed Computing Human Behavior Data Analysis

Senior Compliance Analyst

Posted 20 days ago

Lead compliance audits for US public sector.

Manage DoD IL5 certification processes.

Cloud-Native Security Compliance-as-Code Compliance Auditing Continuous Monitoring

Intercompany Accounting Manager

Posted 12 days ago

Lead monthly close for intercompany transactions.

Define transfer pricing models with various departments.

Accounting Principles Data Automation Financial Auditing Foreign Exchange Analysis

GTM Compensation Operations Manager

Posted 3 days ago

Oversee GTM Incentive Compensation operations.

Lead and optimize Sales Performance Management processes.

Analytics Anaplan Commissions Management Communication Skills

Oracle EBS DBA Role

Posted 19 days ago

Recruit an experienced Oracle EBS DBA.

Manage Oracle EBS across development, test, and production systems.

Backup and Recovery Cloning Communication Skills DBA

Oracle EBS DBA Role

Posted 17 days ago

Seeking an experienced Oracle EBS DBA.

Role involves administration and maintenance of EBS environments.

Backup and Recovery Database Administration High Availability Oracle Applications

Database Engineer Role

Posted 25 days ago

Build and maintain a Postgres database layer.

Advise teams on feature design based on customer needs.

Automated Monitoring Tools Collaboration with Engineering Teams Database Management Indexing Strategies

Customer Success Engineer

Posted 17 days ago

Provide hands-on support for databases.

Diagnose and resolve production issues.

Clickhouse Cloud Infrastructure Linux MongoDB

Oracle EBS DBA Role

Posted 25 days ago

Administer and maintain Oracle EBS environments.

Optimize database performance and availability.

Communication Database Administration Database Optimization DBA

Oracle EBS DBA

Posted 22 days ago

Find an experienced Oracle EBS DBA.

Administer and optimize Oracle EBS environments.

Administration Cloning DBA High Availability

Senior Lead Engineer

Posted 19 days ago

Lead and manage a team of engineers.

Own the roadmap for storage durability and performance.

C++ Consensus Distributed Systems Go

Oracle EBS DBA Position

Posted 21 days ago

Urgently seeking an Oracle EBS DBA.

Role involves administering and maintaining EBS environments.

Cloning Operations Communication Skills Database Administration Database Security

Oracle EBS DBA Role

Posted 20 days ago

Find an experienced Oracle EBS DBA.

Administer and maintain EBS environments.

Cloning Communication Skills Database Administration DBA

Senior Software Engineer

Posted 20 days ago

Design and build core components of the system.

Shape architecture and development practices.

Agile Methodologies Cloud Technologies Database Internals Distributed Systems

Oracle EBS DBA Role

Posted 20 days ago

Administer Oracle EBS environments.

Ensure high availability and performance.

Cloning Operations Communication Skills Cross-Functional Collaboration Database Administration

Oracle EBS DBA Role

Posted 19 days ago

Administer and maintain Oracle EBS environments.

Ensure high availability and performance of systems.

Cloning Operations Communication Skills Cross-Functional Collaboration Database Administration

Senior Backend Engineer

Posted 7 days ago

Build and maintain core backend services.

Develop scalable systems using IPC mechanisms.

AWS Data Modeling Distributed Systems Go

Senior SQL Developer Role

Posted 6 days ago

Develop and optimize SQL databases.

Collaborate with teams for requirement gathering.

Collaboration Tools Database Design Database Management Systems Data Modeling

Remote AI Analyst

Posted 37 days ago

Drive customer experience automation

Optimize business processes with AI solutions

Ai Business Analyst Data Analysis Data Visualization

Pricing Strategy Analyst Role

Posted 37 days ago

Hire a remote pricing analyst

Optimize business pricing strategies

Data Analysis Data Visualization Excel Financial Modeling

Senior Marketing Analyst Role

Posted 37 days ago

Offer a remote full-time analyst position

Drive business growth through marketing analytics

Cross-functional Collaboration Customer Experience Data Analytics Digital Marketing

SAP DBA Project

Posted 37 days ago

Manage SAP ASE databases and HANA skills for clients globally.

Optimize database performance and ensure security compliance.

Cloud Technologies Hana Shell Scripting SQL

ML Engineer - AdTech

Posted 37 days ago

Design and implement ML systems|Apply optimization strategies|Collaborate with teams|Analyze data

r user behavior|Develop data

C++ Data Analysis Java Machine Learning

Transaction Monitoring Lead

Posted 37 days ago

Hiring a Transaction Monitoring Lead to enhance compliance capabilities

Optimizing TM rules and alert systems to reduce false positives

Automation Documentation Fraud Detection Monitoring

Transaction Monitoring Manager

Posted 37 days ago

Lead and scale transaction monitoring operations

Optimize and automate AML controls and alert logic

Automation Data Analysis Documentation Monitoring

Business Development Rep

Posted 37 days ago

Conduct regular outbound activities to key web3 prospects

Understand prospective customers' goals and assess how Allium.so can help

Blockchain Business Development Collaboration Tools Communication Skills

Blockchain Solutions Engineer

Posted 37 days ago

Engage with customers to understand blockchain data needs

Design and implement tailored data analytics solutions

Blockchain technology Data Analytics Data Security Documentation

Revenue Operations Lead

Posted 37 days ago

Optimize revenue operations for Allium.so's growth

Develop accurate revenue forecasting models

Bi tools Collaboration Tools Crm systems Data Analytics

Growth Engineer at Allium

Posted 37 days ago

Optimize internal customer support processes

Automate customer interactions for efficiency

Blockchain Collaboration Tools Documentation Engineer

Staff AI Backend Engineer

Posted 37 days ago

Architect and maintain high-performance backend infrastructure

Integrate advanced AI and LLM technologies into data workflows

AWS Azure Docker Engineer

Staff Software Engineer Role

Posted 37 days ago

Lead backend development for AI-powered data solutions

Architect scalable systems and APIs for enterprise clients

Agile Methodologies Angular AWS Azure

Staff Software Engineer, AI Backend

Posted 37 days ago

Design and build scalable AI-driven backend systems

Integrate advanced language models into data workflows

AWS Azure Docker FastAPI

Staff Software Engineer

Posted 37 days ago

Revolutionize enterprise data operations through AI solutions.

Automate and accelerate data tasks for overworked data teams.

Ai Airflow Ansible Api Development

AI-Powered Data Operations Revolution

Posted 37 days ago

Revolutionize enterprise data operations through AI automation.

Develop high-performance backend systems for AI solutions.

Docker Engineer FastAPI Python

Remote Business Operations Analyst

Posted 37 days ago

Offer a 100% remote analyst role

Simplify insurance billing operations

Business Operations Communication Skills Data Analysis Microsoft Excel

Remote Revenue Analyst Role

Posted 37 days ago

Recruit a remote Revenue Analyst

Enhance revenue strategies for SaaS products

Business Analyst Data Analysis Financial Reporting Microsoft Excel

Remote Marketing Analyst Role

Posted 37 days ago

Hire a remote marketing analyst

Analyze and optimize marketing efforts

A/b Testing Communication Communication Skills Data Analysis

Binance Data Analyst Program

Posted 37 days ago

Develop data models for core business operations

Utilize machine learning techniques for real-world challenges

Matplotlib Numpy Pandas Power Bi

Remote Data Analyst Positions

Posted 37 days ago

Aggregate remote data analyst job listings globally.

Include essential job details like company name and salary range.

Bi tools Data Analysis Data Visualization Excel

Fraud Strategy Analyst

Posted 37 days ago

Develop fraud detection rulesets and scoring to manage fraud risk, collaborate with investigations.

Designing, testing and implementing fraud detection rulesets and scoring to manage our fraud risk and enable business growth.

Bi tools Communication Skills Data Analysis Deadline Management

Revenue Forecasting Analyst

Posted 37 days ago

Create and maintain complex revenue models for forecasting, Support accurate revenue projections

budgeting, Analyze revenue trends and key metrics, Collaborate with cross-functional teams for

Financial Modeling Google Sheets Microsoft Excel Pivot Tables

Data Analyst

Posted 37 days ago

Operational Excellence Program Leadership Strategic Prioritization Cross-functional

aybook

Crm Cross-functional Collaboration Customer success Data Science