Associate Principal - Data Engineering

Job Summary

Seeking an Associate Principal with 11 to 15 years of experience in AWS AI Services and Databricks to lead the design and implementation of scalable secure and innovative data solutions within the AWS ecosystem

Job Description

Lead the architecture and development of enterprisescale data platforms using AWS AI Services and Databricks Design develop and optimize endtoend data pipelines to support complex data processing and AIdriven analytics scenarios Architect secure scalable and highperformance data storage and processing solutions leveraging AWS cloud services Collaborate with crossfunctional teams to align data and AI solutions with business objectives and technical requirements Implement best practices for data governance security and compliance within AWS environments Ensure high availability performance and reliability of data platforms through continuous monitoring and tuning Stay updated on emerging AWS AI and Databricks technologies and tools to drive innovation and enhance platform capabilities

Roles and Responsibilities

Lead the design and implementation of AWSbased data integration and AI processing platforms focusing on Databricks

Mentor and guide data engineers and architects on best practices and technical solutions within AWS AI Services and Databricks

Collaborate with stakeholders to gather requirements and translate them into scalable secure technical architectures

Oversee data migration transformation and integration activities ensuring seamless and efficient data flow

Establish and enforce data architecture standards policies and procedures to maintain data quality and security

Conduct performance tuning troubleshooting and optimization of data pipelines and AI models

Manage AWS resource provisioning and configuration aligned with security and compliance standards

Drive adoption of DevOps practices including CICD pipelines for efficient code and model management

Serve as a technical advisor during project execution and provide strategic direction for data platform and AI evolution