Senior/Staff/Principal SWE- Observability Engineering

3 hours, 2 minutes ago
Full-time
Lead
Software Development
Appgate

Appgate

Appgate is the secure access company empowering secure connections with Zero Trust principles for people, devices, and systems.

Professional Services
251-1K
Founded 2020

Description

  • Architect the observability platform, including telemetry schema, correlation model, transport, and sampling strategies across client devices, controllers, and gateways.
  • Build telemetry SDKs and the LogForwarder pipeline using OpenTelemetry.
  • Implement enrichment, redaction, batching, and tail-sampling for high-volume telemetry processing.
  • Design and support a high-cardinality ingestion and routing layer that can scale to 100M+ events per day.
  • Develop end-to-end distributed tracing across login and session establishment flows.
  • Enable on-demand packet capture workflows that are observable through logs and traces.
  • Define and validate integration standards for OTLP, Prometheus, and JSON logs.
  • Test and validate the observability system at customer-scale environments with large deployments and high concurrency.
  • Collaborate with product, R&D, and customers to shape requirements and deliver outcomes.
  • Mentor engineers, establish engineering patterns and review practices, and help grow the observability discipline at AppGate.

Requirements

  • 8+ years of engineering experience, including at least 4 years in observability, telemetry, or large-scale data infrastructure.
  • Deep OpenTelemetry expertise, including OTLP, the OTel Collector, semantic conventions, context propagation, and head/tail sampling.
  • Experience designing or significantly contributing to a distributed tracing system in production.
  • Hands-on experience with high-throughput systems ingesting 100M+ events per day.
  • Strong systems programming experience with production Go and/or Rust preferred.
  • Comfort working across the stack from agent code to backend services.
  • Knowledge of networking and security fundamentals, including TLS, DNS, TCP, and identity protocols.
  • Prior ZTNA, SASE, or SD-WAN experience is a strong plus.
  • Pragmatic, opinionated, and impact-driven mindset.
  • Experience with observability platforms such as Datadog, Splunk, Elastic, Honeycomb, New Relic, or Grafana Labs, or equivalent.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Tech Lead, Web Core Product & Chrome Extension - Malmö, Sweden

Speechify 51-250 Internet Software & Services

Speechify is hiring a web product engineer to help ship user-facing features for its distributed text-to-speech platform used by millions of people.

Firebase JavaScript React TypeScript
1 hour, 14 minutes ago

Tech Lead, Web Core Product & Chrome Extension - Alexandria, Egypt

Speechify 51-250 Internet Software & Services

Speechify is hiring a web product engineer to help build and ship user-facing features for its distributed text-to-speech products used by millions of people.

Firebase JavaScript React TypeScript
2 hours, 24 minutes ago

Tech Lead, Web Core Product & Chrome Extension - Fresno, CA, USA

Speechify 51-250 Internet Software & Services

Speechify is hiring a web product engineer to build and ship user-facing features for its widely used text-to-speech platform in a fully remote, fast-moving environment.

Firebase JavaScript React TypeScript
3 hours, 7 minutes ago

Tech Lead, Android Core Product - Portland, OR, USA

Speechify 51-250 Internet Software & Services

Speechify is hiring a Senior Android Engineer to help scale its text-to-speech Android app and build new user-facing features for a global, fully distributed product team.

Android iOS Jetpack Compose JUnit Kotlin Node.js
3 hours, 10 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers