SRE / Reliability Engineer (Lead)
Tenarai (formerly Infogain) · IT Services & Consulting
- Bangalore, India
- On-site
- Posted today
- IT & Infrastructure
- Full-Time / Contract
About the job
<p><span style="color:rgb(0, 0, 0);">1. Key Responsibilities</span></p><p><span style="color:rgb(0, 0, 0);">New Relic as code</span></p><p><span style="color:rgb(0, 0, 0);">• Provider modules — Build reusable Terraform modules with the New Relic provider for dashboards, alert policies, NRQL conditions, workflows, destinations (Jira, Teams), synthetics, cloud-integration links and entity tags.</span></p><p><span style="color:rgb(0, 0, 0);">• Reverse-engineer click-ops — When New Relic SMEs or engineers build or modify dashboards/alerts in the UI (including tuned out-of-the-box dashboards), import and codify them so the state is recoverable.</span></p><p><span style="color:rgb(0, 0, 0);">• Per-technology packs — Package each proven pattern (e.g., MySQL, Airflow, EC2, Vault) as a module other teams can consume with a few variables.</span></p><p><span style="color:rgb(0, 0, 0);">Application &amp; infrastructure codification</span></p><p><span style="color:rgb(0, 0, 0);">• Agent rollout automation — Update onboarding scripts, AMIs/container images and Terraform so the New Relic agent replaces Datadog on Meridian nodes and every new per-client instance comes up instrumented.</span></p><p><span style="color:rgb(0, 0, 0);">• Cloud integration plumbing — Codify IAM roles, CloudWatch metric streams, Firehose and log subscriptions across the AWS account structure (AWS Control Tower / AFT), with Azure and GCP equivalents where needed.</span></p><p><span style="color:rgb(0, 0, 0);">• Pipeline hooks — Add New Relic change tracking/deployment markers into Jenkins and GitHub Actions deploy pipelines; support ECS/Fargate (COAL) and Argo CD deployments.</span></p><p><span style="color:rgb(0, 0, 0);">CI/CD, governance &amp; recovery</span></p><p><span style="color:rgb(0, 0, 0);">• GitHub Actions workflows — Plan/apply pipelines with PR review, policy checks, drift detection and environment promotion for all observability code.</span></p><p><span style="color:rgb(0, 0, 0);">• State &amp; secrets — Remote state, workspace strategy per account/environment; New Relic API keys and credentials managed in HashiCorp Vault.</span></p><p><span style="color:rgb(0, 0, 0);">• Disaster recovery drill — Demonstrate that a New Relic account configuration can be recreated from code.</span></p><p><span style="color:rgb(0, 0, 0);">• Backstage alignment — Expose observability modules as golden-path templates alongside the new platform automation (Terraform, GitHub Actions, Backstage, Argo CD, AFT, Control Tower).</span></p><p><span style="color:rgb(0, 0, 0);">Documentation &amp; enablement</span></p><p><span style="color:rgb(0, 0, 0);">• Module READMEs, usage examples and a contribution guide so Cyderes engineers can self-serve observability as part of the definition of done.</span></p><p><span style="color:rgb(0, 0, 0);">Environment the engineer will work in:</span></p><p><span style="color:rgb(0, 0, 0);">Service group Technologies</span></p><p><span style="color:rgb(0, 0, 0);">Meridian — Provision Docker, AWS ECR, AWS SSM, Jenkins CI/CD pipelines; SaaS Customer Manager, Update Manager (per-client provisioning)</span></p><p><span style="color:rgb(0, 0, 0);">Meridian — Ingress Tunnel-free and tunnel-dependent connector VMs (~800 connectors), tunnel proxy server, MySQL data cache on AWS EC2 (per-client containers)</span></p><p><span style="color:rgb(0, 0, 0);">Meridian — Process / Analyze Apache Airflow (scheduler/workers) with PostgreSQL backend, Action Manager; Python ML Merger; LLM VM (Ollama, IBM Granite)</span></p><p><span style="color:rgb(0, 0, 0);">Service group Technologies</span></p><p><span style="color:rgb(0, 0, 0);">Meridian — Visualize / Store Multi-tenant Web UI and API; Cloudflare (WAF/CDN/DNS/DDoS, R2); WorkOS (SSO/SAML); MongoDB Atlas; AWS S3</span></p><p><span style="color:rgb(0, 0, 0);">Meridian MCP Airflow + Merger (produce) ? S3 Uploader (export) ? AWS Step Functions / Lambda staging (transform) ? Amazon Neptune snapshot, bulk load, validation (load) ? Bedrock AgentCore Gateway, Lambda, Claude, MCP clients (consume)</span></p><p><span style="color:rgb(0, 0, 0);">Vault HashiCorp Vault (secrets storage and rotation; SaaS dependency for every service — agentless monitoring)</span></p><p><span style="color:rgb(0, 0, 0);">COAL (Deploy) AWS ECS, AWS Fargate; frontend, backend and worker services</span></p><p><span style="color:rgb(0, 0, 0);">Platform AWS Control Tower, AFT (Account Factory for Terraform) pipeline, Terraform, GitHub Actions, Argo CD, Backstage</span></p><p><span style="color:rgb(0, 0, 0);">Integrations Jira (incidents, on-call schedules, paging), Microsoft Teams, public status page, customer portal, Cyderes MCP</span></p><p><span style="color:rgb(0, 0, 0);">Clouds / legacy AWS (primary, growing under private pricing), Azure and GCP; legacy Prometheus, Thanos, Grafana, Loki, Datadog, Azure Monitor</span></p><p><span style="color:rgb(0, 0, 0);">3. Required Technical Skills</span></p><p><span style="color:rgb(0, 0, 0);">Area Expectation</span></p><p><span style="color:rgb(0, 0, 0);">Terraform (must) Modules, remote state, workspaces, import blocks, for_each/dynamic blocks, testing (terraform test / Terratest), version pinning</span></p><p><span style="color:rgb(0, 0, 0);">New Relic provider (must) newrelic_one_dashboard, alert policies and NRQL conditions, workflows and destinations, synthetics, cloud-account linking, tagging</span></p><p><span style="color:rgb(0, 0, 0);">GitHub Actions (must) Reusable workflows, OIDC to AWS, environments and approvals, plan-on-PR/apply-on-merge</span></p><p><span style="color:rgb(0, 0, 0);">AWS (must) IAM, Organizations, Control Tower and AFT, CloudWatch metric streams, Kinesis Firehose, EC2, ECS/Fargate, Lambda, S3</span></p><p><span style="color:rgb(0, 0, 0);">Platform tooling Argo CD, Backstage, Jenkins, Docker; HashiCorp Vault for secrets</span></p><p><span style="color:rgb(0, 0, 0);">Multi-cloud Terraform for Azure (Azure Monitor) and GCP (Cloud Logging/Monitoring) for cross-cloud workflows and migrations to AWS</span></p><p><span style="color:rgb(0, 0, 0);">Scripting Python, Bash, HCL; NRQL literacy to review conditions and dashboards</span></p><p><span style="color:rgb(0, 0, 0);">Policy &amp; quality tflint, checkov/tfsec or OPA, pre-commit; semantic versioning of modules</span></p><p><span style="color:rgb(0, 0, 0);">4. Domain &amp; Functional Knowledge</span></p><p><span style="color:rgb(0, 0, 0);">• Observability-as-code — treating dashboards, alerts and notification routing as versioned, reviewable artifacts.</span></p><p><span style="color:rgb(0, 0, 0);">• GitOps and platform engineering — golden paths, self-service templates, landing-zone account structures.</span></p><p><span style="color:rgb(0, 0, 0);">• Change and release governance in a security company — least-privilege IAM, auditable changes, secrets never in code.</span></p><p><span style="color:rgb(0, 0, 0);">• Disaster-recovery thinking — reproducible configuration, drift detection, tool-failure scenarios.</span></p><p><span style="color:rgb(0, 0, 0);">• Multi-cloud migration awareness — applications moving from GCP to AWS may need their telemetry wiring rebuilt.</span></p><p><span style="color:rgb(0, 0, 0);">5. Experience &amp; Qualifications</span></p><p><span style="color:rgb(0, 0, 0);">• 6–9 years in DevOps, platform or cloud engineering, with 4+ years writing production Terraform.</span></p><p><span style="color:rgb(0, 0, 0);">• Hands-on experience with the New Relic Terraform provider (or Datadog/Grafana providers with clear transferability).</span></p><p><span style="color:rgb(0, 0, 0);">• Built and operated GitHub Actions-based infrastructure pipelines in a multi-account AWS organization.</span></p><p><span style="color:rgb(0, 0, 0);">• Experience importing and codifying existing, manually built configuration.</span></p><p><span style="color:rgb(0, 0, 0);">• Bachelor&aposs degree in Computer Science/Engineering or equivalent experience.</span></p>