RemoteLeaf Logo
Log in Sign up

Senior/Staff/Principal SWE- Observability Engineering

1 month, 3 weeks ago
United States
Full-time
Lead
Technical Lead
Software Development
Datadog DNS Elasticsearch Go Honeycomb JSON LLM New Relic OpenTelemetry Prometheus Rust Splunk TLS
Apply Now
Appgate

Appgate

Appgate is the secure access company empowering secure connections with Zero Trust principles for people, devices, and systems.

Professional Services
251-1K
Founded 2020
View All Jobs 13

Description

  • Architect the observability platform, including telemetry schema, correlation model, transport, and sampling strategies across client devices, controllers, and gateways.
  • Build telemetry SDKs and the LogForwarder pipeline using OpenTelemetry.
  • Implement enrichment, redaction, batching, and tail-sampling for high-volume telemetry processing.
  • Design and support a high-cardinality ingestion and routing layer that can scale to 100M+ events per day.
  • Develop end-to-end distributed tracing across login and session establishment flows.
  • Enable on-demand packet capture workflows that are observable through logs and traces.
  • Define and validate integration standards for OTLP, Prometheus, and JSON logs.
  • Test and validate the observability system at customer-scale environments with large deployments and high concurrency.
  • Collaborate with product, R&D, and customers to shape requirements and deliver outcomes.
  • Mentor engineers, establish engineering patterns and review practices, and help grow the observability discipline at AppGate.

Requirements

  • 8+ years of engineering experience, including at least 4 years in observability, telemetry, or large-scale data infrastructure.
  • Deep OpenTelemetry expertise, including OTLP, the OTel Collector, semantic conventions, context propagation, and head/tail sampling.
  • Experience designing or significantly contributing to a distributed tracing system in production.
  • Hands-on experience with high-throughput systems ingesting 100M+ events per day.
  • Strong systems programming experience with production Go and/or Rust preferred.
  • Comfort working across the stack from agent code to backend services.
  • Knowledge of networking and security fundamentals, including TLS, DNS, TCP, and identity protocols.
  • Prior ZTNA, SASE, or SD-WAN experience is a strong plus.
  • Pragmatic, opinionated, and impact-driven mindset.
  • Experience with observability platforms such as Datadog, Splunk, Elastic, Honeycomb, New Relic, or Grafana Labs, or equivalent.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

SPD Technology

ML Engineering Lead

SPD Technology Internet Software & Services

SPD Technology is hiring a Machine Learning Engineering Lead to build and deliver production-grade ML services for PitchBook, bridging data science and enterprise software engineering on a collaborative, flexible team.

Moldova Poland Romania Bulgaria Spain Ukraine Full-time Lead Machine Learning Engineer Technical Lead
Agile AWS Elasticsearch FastAPI GCP GitOps Grafana Java Kafka Kubeflow Machine Learning Microservices MLflow Prometheus Python PyTorch Redis SageMaker Scrum SQL TensorFlow
16 hours, 14 minutes ago
Coforge

QE Lead – Test Automation (B2-C1 English)

Coforge 10K-50K IT Services

Coforge is hiring a remote QE Lead – Test Automation to lead distributed quality engineering efforts for a freight transportation client and drive automation delivery across web, mobile, and API testing.

Colombia Costa Rica Latin America Peru Mexico Full-time Lead SDET (Software Development Engineer in Test) Technical Lead
Appium CI/CD Espresso Generative AI GitHub Actions GitLab CI Java JavaScript Jenkins LLM Newman Playwright Postman Python TypeScript
16 hours, 29 minutes ago
Nortal

(1425) Lead Frontend (JavaScript/TypeScript & React) Engineer - Work from Home

Nortal 251-1K Internet Software & Services

Nortal is hiring a Senior Web Technical Lead to lead a distributed web engineering team building consumer-facing 3D web applications and driving the architecture, roadmap, and quality of the flagship web platform.

Latin America Full-time Lead Frontend Engineer / Web Developer Technical Lead
JavaScript Microservices React TypeScript
16 hours, 29 minutes ago
Resilient Co

Fullstack Tech Lead

Resilient Co 11-50 Professional Services

Fullstack Tech Lead for a live Django/JavaScript enterprise reporting application, embedded with the client to stabilize operations, modernize Excel-based workflows, and guide technical delivery and data/reporting improvements.

Chile Colombia Costa Rica Paraguay Peru Uruguay Mexico Argentina Brazil Contract Lead Full-stack Engineer Technical Lead
Azure CI/CD Django Git GitHub Actions JavaScript Power BI Python Secrets Management SQL SQL Server Windows Server
16 hours, 44 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers