…

Azure Data Engineer (Lead)

Tenarai (formerly Infogain) · IT Services & Consulting

  • Noida / Pune / Bangalore / Mumbai / Hyderabad / Chennai / Gurugram / Kochi, India
  • On-site
  • Posted today
  • Data & AI
  • Full-Time

About the job

&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtWe are looking for an experienced &lt/span&gt&lt/span&gt&ltstrong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtDatabricks Architect&lt/span&gt&lt/span&gt&lt/strong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gt to lead the technical architecture and delivery for an enterprise &lt/span&gt&lt/span&gt&ltstrong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtSAP BW/EDW to Databricks migration programme&lt/span&gt&lt/span&gt&lt/strong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gt.&lt/span&gt&lt/span&gt&lt/p&gt&lth3&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtKey Responsibilities&lt/span&gt&lt/span&gt&lt/h3&gt&ltul&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtDefine and govern the &lt/span&gt&lt/span&gt&ltstrong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtDatabricks Lakehouse architecture&lt/span&gt&lt/span&gt&lt/strong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gt for SAP BW/EDW migration.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtDesign &lt/span&gt&lt/span&gt&ltstrong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtBronze, Silver and Gold&lt/span&gt&lt/span&gt&lt/strong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gt data layers and reusable data patterns.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtLead architecture decisions for &lt/span&gt&lt/span&gt&ltstrong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtSQL, PySpark and Scala&lt/span&gt&lt/span&gt&lt/strong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gt based on transformation complexity and performance.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtDefine SAP-to-Databricks ingestion and integration patterns.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtReview and guide re-engineering of complex &lt/span&gt&lt/span&gt&ltstrong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtBW/ABAP/EDW transformations&lt/span&gt&lt/span&gt&lt/strong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gt into Databricks.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtEstablish standards for data modelling, security, performance, scalability and cost optimisation.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtWork closely with SAP BW, Databricks, Azure and Power BI teams.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtProvide technical leadership across multiple migration workstreams and ensure alignment with the existing GCC architecture.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtSupport technical estimation, design reviews, development governance and production readiness.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&lt/ul&gt&lth3&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtRequired Skills&lt/span&gt&lt/span&gt&lt/h3&gt&ltul&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtStrong &lt/span&gt&lt/span&gt&ltstrong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtDatabricks architecture and Lakehouse&lt/span&gt&lt/span&gt&lt/strong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gt experience.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtDeep knowledge of &lt/span&gt&lt/span&gt&ltstrong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtBronze/Silver/Gold architecture&lt/span&gt&lt/span&gt&lt/strong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gt.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtStrong SQL and PySpark experience.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtExperience with large-scale &lt/span&gt&lt/span&gt&ltstrong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtdata migration / modernisation&lt/span&gt&lt/span&gt&lt/strong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gt programmes.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtStrong understanding of Azure data services and integration patterns.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtExperience designing scalable and high-performance data platforms.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtStrong understanding of data security, governance and performance optimisation.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtExcellent architecture, stakeholder management and technical leadership skills.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&lt/ul&gt&lth3&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtGood to Have&lt/span&gt&lt/span&gt&lt/h3&gt&ltul&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtSAP BW / BW/4HANA migration experience.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtSAP S/4HANA / CDS / Datasphere.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtAzure Data Factory / Synapse.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtPower BI.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtUnity Catalog.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtSAP BDC / Delta Sharing.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&ltli&gt&ltp&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtExperience with SAP-to-Databricks migration.&lt/span&gt&lt/span&gt&lt/p&gt&lt/li&gt&lt/ul&gt&ltp&gt&ltstrong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtKey Profile:&lt/span&gt&lt/span&gt&lt/strong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gt&ltbr&gt&lt/span&gt&lt/span&gt&ltstrong&gt&ltspan style=&quotcolor:rgb(36, 36, 36);&quot&gt&ltspan style=&quotbackground-color:rgb(255, 255, 255);&quot&gtDatabricks Architecture + Lakehouse + Azure + SQL/PySpark + Data Migration + Technical Leadership&lt/span&gt&lt/span&gt&lt/strong&gt&lt/p&gt