…

Lead II - Data Engineering

UST · IT Services & Consulting

  • Hyderabad, Pune
  • On-site
  • Posted today
  • Data & AI

About the job

Role Overview: We are seeking a highly skilled and experienced Senior Data Engineer with 10+ years of experience in designing, developing, and maintaining enterprise-scale data platforms and ETL solutions. The ideal candidate will possess strong expertise in SQL Server, Azure Data Services, and modern data engineering technologies, along with proven experience in leading offshore teams, mentoring team members, and driving delivery excellence. The role requires a combination of hands-on technical expertise, solution design capabilities, stakeholder collaboration, and leadership responsibilities to support critical business data initiatives. Key Responsibilities: Technical Responsibilities Design, develop, and optimize scalable data pipelines, ETL/ELT processes, and data integration solutions. Develop and maintain data solutions using SQL Server, SSIS, Azure Data Factory (ADF), Azure SQL, and Azure Databricks. Build and support cloud-based data platforms and data warehousing solutions on Microsoft Azure. Implement data quality, validation, governance, and monitoring frameworks to ensure reliability and accuracy of enterprise data. Analyze and optimize database performance, execution plans, and query tuning for large-scale datasets. Collaborate with business stakeholders, architects, and cross-functional teams to translate business requirements into scalable data solutions. Support data migration, modernization, and cloud transformation initiatives. Contribute to solution architecture, technical design reviews, and best-practice implementation. Leadership & Team Management: Lead and manage offshore data engineering teams, ensuring high-quality and timely project delivery. Mentor, coach, and guide junior and mid-level data engineers on technical and professional growth. Drive sprint planning, task allocation, effort estimation, and resource management activities. Act as a technical escalation point for critical production issues and complex data challenges. Foster a culture of continuous improvement, operational excellence, and engineering best practices. Provide project status updates, risk mitigation plans, and stakeholder communications. Take ownership of additional responsibilities beyond core development activities, including process improvements, governance initiatives, and delivery management support. Required Skills & Experience: Mandatory Skills 10+ years of overall experience in Data Engineering, Data Integration, and Data Warehousing. 8+ years of hands-on experience with: Microsoft SQL Server SQL Development and Performance Tuning SSIS (SQL Server Integration Services) 5+ years of hands-on experience with: Azure SQL Database Azure Data Factory (ADF) Azure-based Data Engineering solutions 2+ years of hands-on experience with: Azure Databricks Spark-based data processing Strong understanding of ETL/ELT frameworks, data modeling, and database design principles. Experience working in Agile/Scrum delivery environments. Good-to-Have Skills: Working knowledge of Microsoft Fabric including Data Factory, Lakehouse, and Warehouse capabilities. Experience with Power BI for data modeling, reporting, dashboard development, and business intelligence solutions. Experience with Denodo for data virtualization, logical data modeling, and enterprise data integration. Exposure to Azure Synapse Analytics, Data Lake, and related Azure services. Knowledge of CI/CD pipelines, DevOps practices, and data engineering automation. Familiarity with data governance, security, and compliance frameworks. Preferred Qualifications: Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field. Microsoft Azure Data Engineering certifications preferred. Strong analytical, problem-solving, and communication skills. Ability to independently drive technical initiatives and collaborate effectively with global stakeholders