Streaming Observability Intern

New

Skills

Apache Beam Dataflow Data Movement Concepts Distributed Systems High Throughput Monitoring Integration Manager Java Kafka Python Streaming Metrics

As a Streaming Observability Intern, you will engage in the design and development of systems to observe streaming metrics utilizing Kafka I/O transforms. This role offers hands-on experience with modern technologies and integration into a collaborative engineering team.

Key Responsibilities
  • Design and build logic for observing streaming metrics.
  • Develop pipelines using Apache Beam for handling massive scale data.
  • Integrate observation metrics into the Integration Manager dashboard.
  • Test and validate to ensure monitoring integrity while maintaining throughput.
  • Participate in intern events, workshops, and meet with executives throughout the internship.
Required Skills & Qualifications
  • Currently enrolled in a college degree program.
  • Legally authorized to work in the United States.
  • Proficient in Java or Python, with experience in Beam.
  • Understanding of distributed systems and data movement concepts.
  • Familiarity with messaging systems, particularly Producer and Consumer models (Kafka is a bonus).

No forms. Your profile is generated instantly.

Job Type: Remote

Salary: Not Disclosed

Experience: Entry

Duration: Months

Share this job:

Similar Jobs

Machine Learning Engineer

Posted 3 days ago

Build and refine ML systems for promotional performance.

Optimize production ML models for efficiency.

Apache Beam Data Pipelines Google Cloud Platform (GCP) Java

AI Platform Lead Engineer

Posted 20 days ago

Design scalable AI data platforms

Optimize ML pipeline efficiency and resource allocation

Airflow BigQuery Dataflow Pyspark

Senior Google Data Engineer

Posted 20 days ago

Deliver expert support for Google Cloud data services

Build and optimize cloud-based data solutions

BigQuery Dataflow Engineer Google Cloud Platform

Software Engineer (Data Engineering)

Posted 20 days ago

Building and scaling data pipelines for large volumes of data processing

Implementing ETL processes for data integration

Databricks Data Engineering Dataflow EMR

Senior Data Engineer

Posted 3 days ago

Build scalable batch and streaming data pipelines.

Develop high-throughput, low-latency data processing systems.

Batch and Streaming Processing BigQuery Bigtable Dataflow

Software Engineer, Rider Pay

Posted 10 days ago

Write maintainable and testable code.

Participate in code reviews.

Automation AWS Code Review Debugging

Application Infrastructure Engineer

Posted 10 days ago

Architect ultra-reliable services for high performance.

Identify and resolve infrastructure bottlenecks.

AI Tools Asynchronous Messaging Cloud Computing Collaboration Tools

Software Architect Role

Posted 9 days ago

Modernize distributed architecture using DDD.

Create scalable and loosely coupled teams.

Cloud Architecture Data Consistency Distributed Systems Domain-Driven Design (DDD)

Software Engineering Manager

New

Lead the design and development of web applications.

Provide technical leadership and architecture guidance.

Agile/Scrum AWS Cloud-Native Design Distributed Systems

Principal Software Engineer

Posted 9 days ago

Design scalable and secure systems.

Lead technical solutions and influence organization.

AWS Backend Systems Collaboration Distributed Systems

Senior Software Engineer

New

Design and build core data infrastructure.

Own the architecture for data systems.

ClickHouse Data Pipelines Distributed Systems Kubernetes

Software Engineer, Activation Team

New

Lead the backend roadmap for high-impact users.

Build and operate scalable APIs and event pipelines.

API Design Backend Development Distributed Systems Event-driven Architecture

Security Software Engineer

Posted 9 days ago

Design security infrastructure for Starlink.

Develop security features for Starlink systems.

C++ Cross-Functional Collaboration Distributed Systems Golang

Senior Staff Software Engineer

New

Architect and deliver scalable platforms.

Transform large-scale challenges into execution plans.

Algorithm Design Big Data Processing Cloud Computing Database Internals

Principal Platform Architect

New

Lead the platform engineering team.

Build a foundational platform layer.

API Versioning Backend Engineering Cloud-Native Technologies Distributed Systems

Software Engineer, Marketing Tech

New

Architect and build scalable web systems.

Implement distributed caching strategies.

AI Tools Architecture Reviews Caching Strategies Distributed Systems

Senior Backend Engineer

Posted 8 days ago

Develop and maintain backend systems for promotional features.

Optimize existing systems for performance and scalability.

Async Programming Distributed Systems Kafka Kubernetes

Senior Product Manager

Posted 8 days ago

Lead the strategy for the configuration platform.

Design systems for safe data management.

AI-assisted Workflows APIs Automation Data Models

Backend Software Engineer

Posted 8 days ago

Design and expand the platform architecture.

Align project scopes with cross-team collaboration.

API Design AWS Backend Development Distributed Systems

Senior Backend Engineer

Posted 8 days ago

Design and scale backend systems for global merchants.

Collaborate with cross-functional teams on project scopes.

API Design AWS Backend Software Development Database Design

Software Engineering Manager

Posted 8 days ago

Lead the design and development of web applications.

Provide technical leadership and mentorship to engineering teams.

Agile/Scrum Methodologies AWS (compute storage networking)

Software Engineer, Marketing Tech

Posted 8 days ago

Build high-performance web systems.

Implement distributed caching strategies.

AI Tools in Development Architecture Reviews Caching Strategies Distributed Systems

Senior Software Engineer

Posted 8 days ago

Align middleware and safety design requirements.

Maintain an architecture view of the middleware stack.

Architecture Design Cross-Functional Collaboration Diagnostics Systems Distributed Systems

AI Security Engineer

Posted 8 days ago

Build a low-latency AI security plane.

Develop distributed, scalable systems.

async-std Distributed Systems gRPC LLM

Engineering Director, Product Platforms

Posted 8 days ago

Lead platform teams to enhance Aerospike Cloud.

Develop platforms for cloud product functionality.

Auto-scaling Backend Development Cloud Computing Distributed Systems

Senior SDET Role

New

Own end-to-end quality for agentic features.

Design automation tooling for AI/LLM systems.

AI/ML Systems Automation Testing CI/CD Integration Cloud-native Architectures

Senior Software Engineer

New

Design and develop scalable services.

Write technical design specifications.

Agile Development Caching CI/CD Systems Design Patterns

Lead AI Engineering Initiatives

New

Lead AI product initiatives from concept to production.

Define technical architecture for AI systems.

Agentic Workflows AI-native Development Tools AI Systems Architecture Distributed Systems

Staff Software Engineer

New

Define the architecture for the correctness layer.

Own and develop the core platform components.

APIs Development Architecture Design Cross-Functional Collaboration Distributed Systems

VP Engineering Position

New

Lead a multi-director organization across various platforms.

Own and manage performance metrics and expectations.

Cloud-Native Technologies Code Quality Assurance Distributed Systems Event-Driven Architecture

Health Data Platform Manager

Posted 4 days ago

Define long-term strategy for health data platform.

Collaborate on data ingestion and processing.

AI Pipelines APIs Cloud Architectures Data Governance

Senior Software Engineer

Posted 4 days ago

Design and develop data platform features.

Build distributed data pipelines in Go.

Algorithms Automation Clean Coding Practices Data Architecture

Security Software Engineer

Posted 4 days ago

Design and build security infrastructure for Starshield.

Develop security features for various Starshield systems.

C++ Cryptographic Services Distributed Systems Golang

Backend Software Engineer

Posted 4 days ago

Build backend systems for enterprise controls.

Design region-aware architectures for compliance.

Data Governance Distributed Systems Go Performance Optimization

Senior Lead Engineer

New

Lead and manage a team of engineers.

Own the roadmap for storage durability and performance.

C++ Consensus Distributed Systems Go

Senior Software Engineer

New

Lead backend architecture and system design.

Own the backend roadmap and technical decisions.

AI-assisted Development Tools Backend Roadmap Management Cloud-native Architectures Cross-functional Coordination

Workload Enablement Engineer

Posted 4 days ago

Port workloads to new platforms while ensuring stability.

Build benchmarks and stress tests for various hardware.

C++/CUDA/HIP Distributed Systems High-Performance Computing (HPC) Large-Scale Distributed Training

Senior DevOps Engineer

Posted 4 days ago

Build automation tools for resource delivery.

Collaborate with engineering teams for quality product delivery.

Automation Tools Cloud Infrastructure Containerization DevOps

Security Software Engineer

Posted 4 days ago

Design security-critical agents for network defense.

Leverage AI for security issue resolution.

AI/ML Automation C++ Cryptography

Security Software Engineer

Posted 4 days ago

Automate network and systems defense.

Leverage AI for security issue remediation.

AI Integration Automation C++ Distributed Systems

Staff Software Engineer

Posted 4 days ago

Architect and build scalable web systems.

Design distributed caching strategies.

AI Tools Caching Strategies Distributed Systems Frontend Development

Privacy and Identity Engineer

Posted 4 days ago

Build privacy-first distributed data systems.

Design high-throughput event-driven architectures.

Automation Tools Data Pipelines Distributed Systems Event-Driven Architecture

Principal Software Engineer

Posted 4 days ago

Lead scalable system architecture.

Drive technical strategy and patterns.

AWS Distributed Systems Google Cloud Microservices

Senior Software Engineer Role

Posted 4 days ago

Take ownership of complex initiatives.

Drive architectural decisions for platforms.

API Development Architectural Design Cloud-Native Technologies Developer Tooling

Software Engineering Manager

Posted 4 days ago

Lead the design and delivery of web applications.

Provide technical leadership and mentorship to engineering teams.

Agile/Scrum AWS (Compute Storage Networking)

Software Engineer - Marketing Tech

Posted 4 days ago

Architect and build scalable web systems.

Design distributed caching strategies.

AI Tools Caching Strategies Distributed Systems Full-Stack Engineering

Backend Software Engineer

Posted 3 days ago

Design and implement APIs for Model Serving.

Optimize performance of CPU/GPU systems.

Algorithms Autoscaling Containers CPU/GPU Optimization

Engineering Manager Role

Posted 3 days ago

Plan and manage software projects.

Align team goals with business objectives.

Agile Methodologies Backend Development Distributed Systems Mobile UI Development

Staff Software Engineer

Posted 3 days ago

Architect and build scalable web systems.

Implement distributed caching strategies.

AI Tools in Development Caching Strategies Distributed Systems Full-stack Engineering

Senior Software Engineer

Posted 3 days ago

Lead backend architecture and system design.

Own backend roadmap and drive technical decisions.

AI Coding Tools Backend Architecture Cloud-native Architecture Distributed Systems