Live opening · Posted 7 days ago
The key details from the original listing.
Live timing from JobBeeper.
Description supplied by the original job listing.
About the Client
Our client is a large global enterprise operating across multiple markets, with a complex technology landscape and a strong focus on digital transformation and innovation. The organization is actively investing in modern cloud, data, and AI capabilities to enable scalable, secure, and highly automated solutions across its business.
About the Project
The project is focused on building an enterprise-grade AI Agent Platform from the ground up. The platform will provide a standardized foundation for developing, deploying, orchestrating, securing, and observing AI agents across multiple teams and use cases.
The initiative covers the full agent lifecycle and brings together agent orchestration, observability, security, governance, integrations, evaluation, and platform engineering. Engineers joining the project will have an opportunity to influence key architectural and technical decisions and contribute to a new platform rather than maintaining an existing solution.
What you will do
Design and implement behavioral monitoring dashboards and alerts using New Relic and NRQL.
Define and monitor behavioral signals including anomalies, drift, safety events, and policy denials.
Build auditability views that surface relevant governance and compliance evidence.
Maintain clear segregation between technical observability and audit/security evidence across monitoring systems.
Configure, tune, and validate alerts based on production agent telemetry.
Verify dashboard accuracy and telemetry consistency to ensure monitoring data is reliable.
Develop Python-based utilities for metrics emission, validation, and observability testing.
Implement monitoring patterns for AI agent anomaly and behavioral drift detection.
Validate that sensitive information, including PII, is appropriately handled in telemetry and traces.
Incorporate security and governance signals, such as policy decisions and access denials, into behavioral monitoring.
Collaborate with security and governance stakeholders to support enterprise compliance and audit requirements.
What you need for this
Skills:
• New Relic and NRQL for behavioral dashboards and alert conditions
• Behavioral monitoring signals (anomaly detection, drift, safety signals, policy denials)
• Auditability views surfacing governance evidence for consumption
• Observability domain segregation (Technical in CloudWatch/New Relic vs Audit in dedicated evidence/SIEM stores)
• Alert validation and dashboard data-accuracy verification
• Python (metrics emission and validation)
Experience:
• 4+ years of observability engineering
• Behavioral / anomaly monitoring and alert tuning on production telemetry
• Working in environments with formal audit/compliance evidence requirements
Nice to have:
• Anomaly/drift detection techniques for agent telemetry
• PII redaction validation in traces surfaced through dashboards
• Cedar policy decisions / Contract-Policy Engine denials as monitoring inputs
• Enterprise security/compliance standards mapping
Work arrangement
Yes
Recently tracked roles with full details and direct application links.