Associate Data Architect I

JD : Pyspark & GoLang Developer We are seeking a highly experienced Senior PySpark & Golang Developer to design, develop, and optimize large-scale data processing platforms and cloud-native applications. The ideal candidate will have deep expertise in Apache Spark (PySpark), Golang, distributed data processing, microservices architecture, cloud platforms, and modern DevOps practices. The role involves building scalable data pipelines, developing high-performance backend services, and driving technical leadership across enterprise data modernization initiatives. Key Responsibilities Data Engineering & Analytics • Design and develop scalable batch and real-time data pipelines using PySpark. • Build and optimize ETL/ELT processes for large-scale data processing. • Develop solutions leveraging Spark, Delta Lake, Data Lakes, and Data Warehouses. • Improve pipeline performance, reliability, and scalability for enterprise-grade workloads. • Implement data quality, monitoring, lineage, and governance controls. Golang Development • Design and develop high-performance backend systems using Golang. • Build RESTful APIs, microservices, and event-driven services. • Develop integrations with enterprise platforms and third-party systems. • Optimize application performance, concurrency, and resource utilization. • Implement secure coding practices and API security standards. Cloud & Platform Engineering • Develop cloud-native solutions on AWS, Azure, or GCP. • Work with containerization technologies such as Docker and Kubernetes. • Build and maintain CI/CD pipelines for automated deployment and testing. • Collaborate with platform and DevOps teams to improve operational excellence. Required Skills Programming • Golang (Expert) • Python (Advanced) • PySpark (Expert) • SQL (Advanced) Data Technologies • Apache Spark • Delta Lake • Data Lake/Data Warehouse concepts Cloud & DevOps • AWS, Azure, or GCP • Docker • Kubernetes • Terraform (preferred) • Git, CI/CD tools Databases • PostgreSQL, MySQL, SQL Server • MongoDB, DynamoDB, Cassandra, or other NoSQL databases Soft Skills • Strong problem-solving and analytical skills. • Excellent stakeholder communication and collaboration abilities. • Ability to lead technical discussions and mentor engineering teams. • Strong ownership mindset and customer-focused approach.