Manager Databricks Pyspark Mumbai Engineering Data Modernization & Migration
Deloitte India (South Asia) · Consulting & Professional Services
- Mumbai, India
- Hybrid
- Posted today
- Data & AI
About the job
Role Overview: As a Manager, you will lead the technical strategy and delivery of Databricks-centric data platforms. You will bridge the gap between business requirements and technical architecture, ensuring that the Databricks ecosystem is scalable, cost-effective (FinOps), and perfectly integrated into the broader Azure data landscape.
Experience:
7–10 years of experience in data engineering, with significant experience architecting solutions on Azure Databricks.
Expertise in designing end-to-end Data Lakehouse architectures.
Proven experience in Databricks FinOps (managing DBU consumption and cluster policies).
Strong leadership experience in managing technical teams and project lifecycles.
Key Responsibilities: Technical Skills:
Architect large-scale, enterprise-grade data platforms using the Databricks Data Intelligence Platform.
Define and enforce technical standards for data modeling, Spark optimization, and coding patterns.
Drive Databricks FinOps initiatives by designing efficient cluster policies and optimizing resource utilization.
Lead the integration of Databricks with Azure Synapse, Power BI, and advanced Machine Learning workflows.
Oversee the implementation of enterprise-wide data governance and security frameworks.
Manage technical project delivery, ensuring alignment with business timelines and quality standards.
Soft Skills:
Strong leadership, mentorship, and people management abilities.
Strategic thinking and ability to translate business needs into technical roadmaps.
Excellent stakeholder management and communication skills.
Preferred Qualifications:
Bachelor’s or Master’s degree in Computer Science or related field.
Databricks Solutions Architect or Azure Solutions Architect certifications.
Job Details:
Location: Mumbai (Hybrid)