Lead II - Data Engineering

We have an immediate requirement for hands-on technical resources who can contribute to Phase 2 and subsequent phases of our data platform transformation. The skillsets we are looking for are outlined below. Primary Skills • Scala and Apache Spark • AWS EMR, S3 and Glue Data Catalog • Apache Iceberg • DynamoDB data modelling and performance optimization • AWS Lambda and Step Functions • Spark SQL and data modelling • Apache Iceberg updates, merges, compaction, and performance tuning Secondary Skills • Core Java and Spring Boot • REST APIs and XML/JSON processing • Maven, Git and CI/CD • AWS CloudWatch, IAM and KMS • Linux and shell scripting • Terraform or CloudFormation We are looking for engineers with strong hands-on experience across the primary technologies, particularly those who have worked on large-scale data processing platforms and performance optimization.