Senior Observability Engineer (New Relic Consolidation)

We are seeking an experienced Senior Observability Engineer to take ownership of the multi-tenant New Relic consolidation layer that aggregates telemetry across our agent estate, as part of an Enterprise Agent Development Platform that empowers engineering teams to define, orchestrate, deploy, and observe AI agents at scale throughout the organization.
Responsibilities
Operate and administer the multi-tenant New Relic consolidation layer across the agent estate
Consolidate telemetry from multiple project tenants through cross-account NRQL queries
Develop and maintain dashboards-as-code and alert-policy-as-code via Terraform and Crossplane
Set up New Relic alert policies routed to Opsgenie, with future migration to ServiceNow
Handle OpenTelemetry / ADOT ingestion into New Relic through OTLP and Firehose pipelines
Architect metric dimensions and low-cardinality facets for large-scale agent estates
Define cross-account and cross-tenant telemetry aggregation and reporting processes
Preserve segregation across Technical, Business, and Audit observability models
Partner with engineering teams to standardize agent observability practices across the platform
Requirements
5+ years of experience in observability or SRE engineering
Hands-on background in consolidating observability/telemetry for AI agent estates in a production agentic AI project, such as multi-tenant New Relic aggregation, cost/token attribution for GenAI workloads, or AgentCore GenAI Observability integration
Expertise in New Relic administration at scale, covering management account setup and cross-account configuration
Proficiency in NRQL for cross-account queries that aggregate telemetry from multiple project tenants
Skills in dashboards-as-code and alert-policy-as-code with Terraform New Relic provider and Crossplane
Knowledge of New Relic alert policies routed to Opsgenie, along with familiarity with ServiceNow
Understanding of OpenTelemetry / ADOT consumption fundamentals, covering OTLP and Firehose ingestion into New Relic
Competency in metric dimension design for large agent estates, ensuring stable, low-cardinality facets
Background in running New Relic or equivalent SaaS observability platforms as a multi-tenant consolidation layer
Experience operating within a Technical / Business / Audit observability segregation model
English proficiency at an Upper-Intermediate level (B2) or higher
Nice to have
Familiarity with AWS Bedrock AgentCore observability, covering Transaction Search and GenAI Observability
Understanding of Kinesis Firehose metric and log forwarding pipelines from CloudWatch to New Relic
Expertise in cost/token attribution modeling for GenAI workloads
Knowledge of Crossplane-based provisioning of observability resources
We offer
CONTINUOUS UPSKILLING, LEARNING & DEVELOPMENT
Diversity of tasks and projects
Assessment center for objective review of competency level
Personal development plan
Mentoring programs and leadership development
Certification and professional development support
Access to learning platforms including more than 2,500 internal courses
English courses taught by certified teachers
CORPORATE BENEFITS
Extra leave days
Referral bonuses
COMPENSATION PACKAGE
Competitive compensation paid in USD
Regular salary and performance reviews
MEDICAL & HEALTHCARE
Private health insurance
Well-being events
WORKING ENVIRONMENT
Recreation areas and kitchens
Tea, coffee and snacks
Sports equipment and game consoles
IT Equipment
Microsoft’s Software Assurance Home Use Program (HUP)
Please note that our Talent Attraction Team reviews applications and CVs submitted in English.
EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.

Work arrangement
Yes