AI Data Engineer Project

Job Description

IT Teams is seeking a Senior Data Engineer with expertise in Azure cloud services, Python, PySpark, and modern Data Modeling. The project involves integrating AI solutions, optimizing data solutions using Databricks, and working on advanced data platforms for AI projects. The ideal candidate will have experience in machine learning operations, familiarity with RAG pattern, and a collaborative mindset.

Description
• IT Teams is a Romanian company specialized in software outsourcing and remote staffing.
• Help integrate AI solutions into applications.
• Provide support to internal users and processes by addressing maintenance and data quality issues.
• Ensure the efficient operation of the organization’s systems.
• Identify and resolve issues related to data quality and system performance.
• If you meet the above requirements and are passionate about AI and cloud technologies, we would love to hear from you.

Requirements
• At least 4-5 years of experience in Data Engineering
• Expertise in Azure cloud service platform
• Proven experience with large databases and data warehouses
• Expertise in Databricks : Delta Tables, DLT, Unity Catalog, performance tuning, etc.
• Good knowledge in Azure services : Azure Data Factory, Azure SQL Database, Azure Key Vault, Azure OpenAI Service
• Proficiency in Python and PySpark
• Knowledge of modern Data Modeling and Design concepts
• Ability to design simplified E2E Azure solution architecture
• Agile - flexibility to execute available tasks in a rapidly changing environment
• Familiarity with authentication mechanisms in Azure
• Ability to use Version Control (Git) with Azure DevOps
• Nice to have: hands-on experience or theoretical knowledge: Generative AI Fundamentals/Basics: Understanding of how AI models are trained to generate data (e.g., text, images) and their practical applications in cloud environments.
• Familiarize with RAG pattern, Experience in prompt engineering.
• MLOps: Familiarity with machine learning operations practices, including model versioning, continuous integration, and deployment (CI/CD) pipelines tailored for AI solutions.
• Additional requirements: Nice to have experience in the automotive industry (Warranty)
• Capacity to work in an international environment using English
• Team player - having a sharing and collaborative mindset
• Takes ownership at work