…

Lead I - Data Engineering

UST · IT Services & Consulting

  • Gurugram, Bengaluru, Chennai, Mumbai
  • On-site
  • Posted yesterday
  • Data & AI

About the job

About the Role This role performs complex research, design, and software development assignments within a software functional area or product line. You will contribute to the design and delivery of scalable data and software solutions, mentor team members, and work closely with stakeholders to translate business requirements into technical outcomes. The position offers the opportunity to influence technical direction while supporting the growth and success of the engineering team. Responsibilities • Interface with other technical personnel or team members to finalize requirements. • Write and review portions of detailed specifications for the development of complex system components. • Complete complex bug fixes and work closely with other development team members to understand complex product requirements and translate them into software designs. • Successfully implement development processes, coding best practices, and code reviews. • Operate in various development environments (Agile, Waterfall, etc.) while collaborating with key stakeholders. Resolve complex technical issues as necessary. • Train entry-level software engineers as directed by department management, ensuring they are knowledgeable in critical aspects of their roles. • Design and work with complex data models. • Mentor less-senior software developers on development methodologies and optimization techniques and all other duties as assigned. Requirements • Must have expertise in Snowflake, PySpark, Python and SQL. • Hands on Experience in Github, Jetstream and AWS. • Knowledge on AI development tools and good to have knowledge in SDD (Spec Driven Development), AWS AI-DLC. • Excellent critical thinking and problem-solving skills with familiarity with databases, data warehousing, and ETL processes. • Experience with machine learning models or statistical analysis. • Advanced knowledge of software development methodologies (e.g., Agile, Waterfall). • Strong proficiency with data manipulation language including optimization techniques, understanding of normalized/dimensional data modeling principles, research skills, knowledge in industry best practices in development. • Ability to interface competently with other technical personnel or team members to finalize requirements to work well with internal and external technology resources. Write and review portions of detailed specifications for the development of complex system components, complete complex bug fixes. Our Commitment to Inclusion We welcome applications from individuals of all backgrounds, including underrepresented groups, people with disabilities, career changers, and candidates with non-traditional education or experience. If you require accommodations at any stage of the recruitment process, please let us know. We are committed to supporting your success. Primary Skills • Python • Pyspark/snowpark • SQL • Snowflake • ETL / ELT & Data Pipeline development • AWS / S3 Secondary Skills • Iceberg • Airflow • Terraform / Infrastructure as Code • GitHub Actions / CI/CD • Data modelling & data warehousing • Data quality / monitoring