Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch reliability and observability for our most critical platforms.
As a Senior Lead Site Reliability Engineer at JPMorgan Chase within the Commercial & Investment Bank, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Drive significant business impact through your capabilities and contributions, and apply deep technical expertise and problem-solving methodologies to tackle a diverse array of reliability, observability, and performance challenges that span multiple technologies and applications.
Job responsibilities
- Regularly provides technical guidance and direction on site reliability practices to support the business and its technical teams, contractors, and vendors
- Develops secure and high-quality production code for reliability tooling and telemetry pipelines, and reviews and debugs code written by others
- Drives decisions that influence reliability design, observability architecture, application functionality, and technical operations and processes
- Serves as a function-wide subject matter expert in one or more areas of site reliability, observability, or telemetry engineering
- Leads resiliency design reviews and breaks up complex reliability problems into digestible work for other engineers, acting as a technical lead for large-sized products
- Acts as the main point of contact during major incidents, demonstrating the skills to identify and solve issues quickly to avoid financial losses, and champions blameless postmortem culture
- Collaborates with team members and stakeholders to define comprehensive service level indicators, service level objectives, and error budgets
- Designs, implements, and maintains operational reliability for large-scale OpenTelemetry pipelines on hybrid on-prem/cloud environments, supporting telemetry ingestion, processing, and export to backends such as InfluxDB, Prometheus, Elasticsearch, and OpenSearch
- Drives the assessment, refactoring, and incremental migration of custom legacy telemetry collection code to standardized OpenTelemetry instrumentation, reducing technical debt while maintaining system stability
- Actively contributes to the engineering community as an advocate of firmwide frameworks, tools, and practices, and influences peers and project decision-makers to consider the use and application of leading-edge observability and reliability technologies
- Adds to the team culture of diversity, opportunity, inclusion, and respect
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and advanced applied experience delivering system design, application development, testing, and operational stability
- Advanced knowledge of reliability, scalability, performance, security, enterprise system architecture, toil reduction, and other site reliability best practices, with considerable in-depth knowledge in one or more technical disciplines (e.g., cloud, observability, distributed systems, etc.)
- Advanced proficiency in one or more programming languages (e.g., Java, Python, Go, etc.)
- Advanced proficiency and experience in observability such as white and black box monitoring, SLO alerting, and telemetry collection using tools such as Grafana, Dynatrace, Prometheus, Datadog, Splunk, Elasticsearch, etc.
- Proficiency in continuous integration and continuous delivery tools (e.g., Jenkins, GitLab, Terraform, etc.)
- Experience with container and container orchestration (e.g., ECS, Kubernetes, Docker, etc.)
- Hands on experience with the design, deployment, and operation of OpenTelemetry collectors in production environments, focusing on technical aspects such as configuring, optimizing, and troubleshooting OTLP endpoints and receivers
- Ability to tackle reliability design and functionality problems independently with little to no oversight
- Practical cloud native experience
- Ability to expand and collaborate across different levels and stakeholder groups
Preferred qualifications, capabilities, and skills
- Knowledge of distributed tracing, metrics, and logging best practices
- Certification in AWS, Kubernetes, or relevant technologies
- Proven track record in system health monitoring, capacity management, and blameless postmortems for high-availability services
- Deep understanding of distributed system design principles, networking (TCP/IP, DNS, load balancing), and Linux internals
- Contributions to open-source observability or telemetry projects
- Experience working with agent control planes and management protocols; hands on knowledge of OpAMP is highly desirable