Backend AI Engineer

Persistent Systems · IT Services & Consulting

PUNE
On-site
Posted today
Data & AI

About the job

About Persistent

We are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 20 Fortune 50 companies and 4 of the 5 top banks in both the US and India, and numerous innovators across the healthcare ecosystem.

Our disruptor's mindset, commitment to client success, and agility to thrive in the dynamic environment have enabled us to sustain our growth momentum. Persistent has been recognized across top industry platforms for innovation, leadership, and inclusion. We reported $1,654.4M FY26 revenue with 17.4% Y-o-Y growth. We have delivered 24 sequential quarters of growth with $436.0M in Q4 FY26 revenue, up 3.2% Q-o-Q and 16.2% Y-o-Y growth. Our 27,500+ global team members, located in 18 countries, have been instrumental in helping the market leaders transform their industries. We have been recognized as the Fastest Growing IT Services Brand Globally in the 2026 Brand Finance IT Services 25 Report . We named a Leader in the Everest Group Private Equity (PE) Services PEAK Matrix Assessment 2026 and Software Product Engineering PEAK Matrix Assessment 2026 .

About Position:

We are looking for a highly skilled Backend AI Engineer to design, build, and operate enterprise-grade AI and Agentic AI applications using TypeScript, Python, and Node.js. The ideal candidate will be responsible for developing scalable backend services that integrate Large Language Models (LLMs), AI Agent frameworks, enterprise systems, laboratory platforms, knowledge bases, vector databases, and cloud-native infrastructure.

Role: Backend AI Engineer

Location: All Persistent Locations

Experience: 4 to 8 Years

Job Type: Full-Time Employment

What You'll Do:

Design and develop backend AI services, APIs, orchestration layers, and integration components using TypeScript, Python, and Node.js.

Build scalable backend services supporting AI Agents, Copilots, Assistants, and workflow automation platforms.

Develop REST APIs, asynchronous services, event-driven workflows, background jobs, queues, WebSocket, and SSE streaming services.

Design robust service architectures that support enterprise-scale AI workloads.

Build and implement Agentic AI workflows using LangChain, LangChain.js, LangGraph, MCP SDK, Semantic Kernel, CrewAI, AutoGen, OpenAI-compatible APIs.

Develop intelligent agent capabilities including Tool Calling, Function Calling, Task Planning, Workflow Orchestration, Memory Management, Structured Outputs, Execution Monitoring, Error Recovery Mechanisms.

Design graph-based workflow automation and multi-agent systems.

Integrate cloud and on-premise LLMs including OpenAI Models, Qwen, DeepSeek, GLM, Other Enterprise-Approved Models.

Implement prompt engineering strategies and model optimization techniques.

Develop secure and scalable AI-powered applications and services.

Evaluate and improve LLM response quality and system performance.

Design and implement Model Context Protocol (MCP) integrations.

Develop MCP client and server implementations.

Manage using Tool Registration, Access Controls, Permissions Management, Service Onboarding, Logging & Monitoring, Secure Connectivity.

Integrate AI systems with enterprise applications and business workflows.

Build enterprise-grade RAG pipelines.

Develop Document Parsing, Chunking Strategies, Embedding Pipelines, Vector Search Frameworks, Knowledge Ingestion Pipelines, Retrieval Evaluation Mechanisms.

Improve knowledge quality, retrieval accuracy, and contextual reasoning capabilities.

Integrate AI systems with structured and unstructured enterprise knowledge sources.

Design semantic data structures supporting AI reasoning and intelligent workflows.

Build and maintain Knowledge Graphs, Metadata Models, Ontologies, Taxonomies, Entity Relationships, Graph Databases.

Implement hybrid Graph + Vector Search architectures.

Enable advanced semantic search and contextual AI capabilities.

Design and deploy cloud-native AI applications using AWS services.

Build containerized workloads using Docker and Kubernetes.

Implement CI/CD pipelines and deployment automation.

Develop scalable and resilient infrastructure supporting AI workloads.

Automate system provisioning, monitoring, and operational processes.

Implement monitoring, logging, and observability capabilities.

Build OpenTelemetry Instrumentation, Distributed Tracing, Performance Monitoring, Cost Tracking, AI Evaluation Frameworks.

Monitor model performance, latency, reliability, and operational health.

Troubleshoot production issues and optimize system performance.

Collaborate with AI Product Owners, Data Scientists, Software Engineers, Application Scientists, QA Teams, Support Teams, Business Stakeholders.

Participate in solution design workshops and architecture discussions.

Contribute to technical standards and engineering best practices.

Mentor junior engineers and support knowledge-sharing initiatives.

Expertise You'll Bring:

Experience working with laboratory, scientific, or automation environments.

Knowledge of Knowledge Graph technologies.

Experience with OpenTelemetry and observability platforms.

Exposure to MLOps and AI model lifecycle management.

Familiarity with multi-tenant architectures and SaaS platforms.

Experience implementing AI governance and security controls.

Knowledge of distributed systems and high-availability architectures.

Strong experience with TypeScript, Node.js, Python.

Expertise in asynchronous programming and backend service development.

Strong understanding of REST APIs, WebSockets, Server-Sent Events (SSE), Event-Driven Architectures, Microservices.

Hands-on experience with LangChain, LangChain.js, LangGraph, MCP SDK, LlamaIndex, Semantic Kernel, CrewAI, AutoGen.

Experience building AI Agents, AI Assistants, Copilots, Workflow Automation Solutions.

Strong understanding of Large Language Models (LLMs), Prompt Engineering, Tool Calling, Structured Outputs, Memory Management, Agent Orchestration, AI Evaluation.

Experience integrating OpenAI-compatible models and enterprise AI platforms.

Benefits:

Competitive salary and benefits package

Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications

Opportunity to work with cutting-edge technologies

Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards

Annual health check-ups

Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

We support hybrid work and flexible hours to fit diverse lifestyles.

Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.

If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

Apply on Persistent Systems