About the Role
Chronosphere, a Palo Alto Networks company, is seeking Principal Engineers to drive the future of their observability platform. This role offers the opportunity to solve complex distributed systems problems at scale, build developer velocity tools, and define platform standards. The position is remote, allowing for collaboration across geographies.
Responsibilities
- Solve complex distributed systems problems at the largest scales in the world.
- Scale production infrastructure and architecture globally using Kubernetes, GCP, and AWS.
- Use Go to build and operate highly scalable, resilient backend services.
- Develop internal tools to monitor, alert, and optimize the live production footprint.
- Design high-scale developer tooling, dynamic testing environments, and CI/CD pipelines in a 100% modern, containerized microservices ecosystem.
- Define and manage entire ephemeral environments using declarative IaC (Terraform).
- Identify and eliminate systemic bottlenecks across the development lifecycle through architectural changes, advanced tooling, and near-real-time telemetry processing.
- Own massive technical initiatives from inception to delivery, balancing feature velocity with long-term technical debt.
- Define platform standards and reference architectures that span a 1–3 year horizon.
- Act as the 'glue' across the organization, consulting on infrastructure best practices and up-leveling the team through dedicated mentorship.
Requirements
- 8–10+ years of relevant experience in high-scale infrastructure, production engineering, systems architecture, or developer platform roles.
- 7 + years of experience in at least one backend language (e.g., Go, Python, Java, C++, C#, or Rust).
- 5 + years of deep expertise building and debugging systems that deal with CAP theorem trade-offs, eventual consistency, and distributed tracing.
- Robust experience working with AWS or GCP and navigating Kubernetes clusters.
- Deep knowledge of Linux internals, process management, resource isolation, and networking protocols (OSI model, load balancing, service meshes).
- Proven track record of estimating complex work effectively, debugging distributed architectures via logs/traces, and proactively identifying design edge cases.
Skills
- Go
- Python
- Java
- C++
- C#
- Rust
- Kubernetes
- GCP
- AWS
- Terraform
- Linux internals
- Process management
- Resource isolation
- Networking protocols
- OSI model
- Load balancing
- Service meshes
- AI coding assistants
Location
- Remote
Work Type
- Remote
- Hybrid
Experience Level
- Principal Engineer
- 8-10+ years
Salary/Compensations
- $147,000.00 - $237,500.00/yr
Benefits
- Restricted stock units
- Bonus
About the Company
- Palo Alto Networks® is united by a shared mission to protect our digital way of life.
- We thrive at the intersection of innovation and impact, solving real-world problems with cutting-edge technology and bold thinking.
- Our employees work to trailblaze the path and shape the future of our industry, defined by our values: Disruption, Collaboration, Execution, Integrity, and Inclusion.
- We weave AI into the fabric of everything we do and use it to augment the impact every individual can have.
- Chronosphere is the observability platform built for control in the modern, containerized world.
- Chronosphere empowers customers to focus on the data and insights that matter by reducing complexity, optimizing costs, and remediating issues faster.
- Chronosphere reduces data volumes and associated costs by 84% on average while saving developers thousands of hours.
- Recognized as a leader by major analyst firms, Chronosphere is trusted by the world's most innovative brands, including DoorDash, Affirm, and Zillow.
- Our Infrastructure organization is scaling rapidly.
- We are trailblazers that dream big, take risks, and challenge cybersecurity’s status quo.
- We are committed to providing reasonable accommodations for all qualified individuals with a disability.
Equal Opportunity
- Palo Alto Networks is an equal opportunity employer.
- We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.
- All your information will be kept confidential according to EEO guidelines.
