Azure Data Engineer (Lead)
Tenarai (formerly Infogain) · IT Services & Consulting
- Noida / Pune / Bangalore / Mumbai / Hyderabad / Chennai / Gurugram / Kochi, India
- On-site
- Posted today
- Data & AI
- Full-Time
About the job
<p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">We are looking for an experienced </span></span><strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Databricks Architect</span></span></strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);"> to lead the technical architecture and delivery for an enterprise </span></span><strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">SAP BW/EDW to Databricks migration programme</span></span></strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">.</span></span></p><h3><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Key Responsibilities</span></span></h3><ul><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Define and govern the </span></span><strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Databricks Lakehouse architecture</span></span></strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);"> for SAP BW/EDW migration.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Design </span></span><strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Bronze, Silver and Gold</span></span></strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);"> data layers and reusable data patterns.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Lead architecture decisions for </span></span><strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">SQL, PySpark and Scala</span></span></strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);"> based on transformation complexity and performance.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Define SAP-to-Databricks ingestion and integration patterns.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Review and guide re-engineering of complex </span></span><strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">BW/ABAP/EDW transformations</span></span></strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);"> into Databricks.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Establish standards for data modelling, security, performance, scalability and cost optimisation.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Work closely with SAP BW, Databricks, Azure and Power BI teams.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Provide technical leadership across multiple migration workstreams and ensure alignment with the existing GCC architecture.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Support technical estimation, design reviews, development governance and production readiness.</span></span></p></li></ul><h3><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Required Skills</span></span></h3><ul><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Strong </span></span><strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Databricks architecture and Lakehouse</span></span></strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);"> experience.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Deep knowledge of </span></span><strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Bronze/Silver/Gold architecture</span></span></strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Strong SQL and PySpark experience.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Experience with large-scale </span></span><strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">data migration / modernisation</span></span></strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);"> programmes.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Strong understanding of Azure data services and integration patterns.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Experience designing scalable and high-performance data platforms.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Strong understanding of data security, governance and performance optimisation.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Excellent architecture, stakeholder management and technical leadership skills.</span></span></p></li></ul><h3><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Good to Have</span></span></h3><ul><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">SAP BW / BW/4HANA migration experience.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">SAP S/4HANA / CDS / Datasphere.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Azure Data Factory / Synapse.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Power BI.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Unity Catalog.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">SAP BDC / Delta Sharing.</span></span></p></li><li><p><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Experience with SAP-to-Databricks migration.</span></span></p></li></ul><p><strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Key Profile:</span></span></strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);"><br></span></span><strong><span style="color:rgb(36, 36, 36);"><span style="background-color:rgb(255, 255, 255);">Databricks Architecture + Lakehouse + Azure + SQL/PySpark + Data Migration + Technical Leadership</span></span></strong></p>