Associate III - Data Engineering
UST · IT Services & Consulting
- Pune
- On-site
- Posted today
- Data & AI
About the job
Senior Offshore PySpark Data Engineer - Contractor will play a key role in migrating and/or building ETL/ELT processes in Merck Palantir Foundry infrastructure under the Medicom project establishing Foundry as the primary Data Lake platform for The core Markets scope. Key responsibilities include: * Data Flow and Data Lake Structure Creation: Developing and optimizing data flows from Source systems to data lake structures within Foundry using PySpark * Creating documentation on Python code created by Contractor in client platform. * Estimation of tasks assigned via ticketing system to the Contractor and timely resolution of those assigned. * Participation in Scrum meetings of the team in order to plan the work and allow Contractor’s work review by Product Owner