To be considered for this position, applications and resumes are accepted only through our careers site by directly applying to the posted job. We do not accept unsolicited resumes or sales solicitations from staffing agencies. Any OCC employee wishing to submit a referral must do so through their Workday account. Any resume submitted outside of an active job posting will not be considered for employment.
What You'll Do:
Leads the enterprise monitoring function, owning the day-to-day management, health, and continuous improvement of the tools and practices that monitor Production systems. Ensures monitoring and alerting are aligned to the reliability standards and priorities set by the Executive Director, SRE, so SRE and partner teams have accurate, timely insight into system health. Manages the monitoring team, platforms, and vendor relationships to sustain enterprise monitoring coverage.
Primary Duties and Responsibilities:
To perform this job successfully, an individual must be able to perform each primary duty satisfactorily.
Strategy and governance
Define and execute the multiyear enterprise monitoring and observability strategy and roadmap, including target architecture, tooling direction and investment priorities.
Own monitoring standards, coverage requirements, documentation and runbooks, and recommend changes to reliability standards to the Executive Director, SRE.
Translate reliability standards and service level objectives (SLOs) set by SRE leadership into monitoring, alerting and dashboard configurations.
Define monitoring readiness criteria and recommend that a release or change not proceed to Production when those criteria are not met.
Platform operations and resilience
Manage the operation, maintenance and upgrades of enterprise monitoring tools and platforms to ensure they are available, performing and covering all Production systems.
Ensure the resilience of the monitoring platforms themselves, including high availability, disaster recovery and monitoring of the monitoring tools.
Extend monitoring coverage across infrastructure, networks, storage, databases and applications, including hybrid, cloud and containerized workloads such as Kubernetes and Kafka platforms.
Maintain accurate service-to-infrastructure mapping with the owners of the configuration management database (CMDB) so alerts reflect business service impact and reach the correct support teams.
Partner with Information Security so monitoring and log data supports security operations and enforce access control and log retention requirements on monitoring tools.
Alert quality and observability
Own alert quality by tuning thresholds, reducing false and duplicate alerts, and ensuring alerts route to the correct support teams.
Define service level indicators (SLIs) with SRE and development teams and implement SLO-based and business-service-level monitoring, including error budget reporting.
Introduce event correlation, anomaly detection and other AIOps capabilities where they reduce noise and speed detection.
Engineering and automation
Automate monitoring onboarding, configuration and reporting to reduce manual effort and improve consistency.
Advance monitoring as code through infrastructure-as-code such as Terraform practices and integration with continuous integration and continuous delivery (CI/CD) pipelines so new services are monitored by default.
Maintain monitoring coverage standards and partner with Release Management and Change Management so new and changed applications and infrastructure are monitored before entering Production.
Incident, problem and change support
Support Incident, Problem and Change processes by ensuring monitoring data is available during incidents and closing monitoring gaps identified in post-incident reviews.
Serve as an escalation point for monitoring tools and alert behavior during Production incidents, including after-hours coverage in line with the on-call model defined with the Executive Director, SRE.
Provide…