RemoteLeaf Logo
Log in Sign up

Senior/Staff/Principal SWE- Observability Engineering

2 months, 1 week ago
United States
Full-time
Lead
Technical Lead
Software Development
Datadog DNS Elasticsearch Go Honeycomb JSON LLM New Relic OpenTelemetry Prometheus Rust Splunk TLS
Apply Now
Appgate

Appgate

Appgate is the secure access company empowering secure connections with Zero Trust principles for people, devices, and systems.

Professional Services
251-1K
Founded 2020
View All Jobs 12

Description

  • Architect the observability platform, including telemetry schema, correlation model, transport, and sampling strategies across client devices, controllers, and gateways.
  • Build telemetry SDKs and the LogForwarder pipeline using OpenTelemetry.
  • Implement enrichment, redaction, batching, and tail-sampling for high-volume telemetry processing.
  • Design and support a high-cardinality ingestion and routing layer that can scale to 100M+ events per day.
  • Develop end-to-end distributed tracing across login and session establishment flows.
  • Enable on-demand packet capture workflows that are observable through logs and traces.
  • Define and validate integration standards for OTLP, Prometheus, and JSON logs.
  • Test and validate the observability system at customer-scale environments with large deployments and high concurrency.
  • Collaborate with product, R&D, and customers to shape requirements and deliver outcomes.
  • Mentor engineers, establish engineering patterns and review practices, and help grow the observability discipline at AppGate.

Requirements

  • 8+ years of engineering experience, including at least 4 years in observability, telemetry, or large-scale data infrastructure.
  • Deep OpenTelemetry expertise, including OTLP, the OTel Collector, semantic conventions, context propagation, and head/tail sampling.
  • Experience designing or significantly contributing to a distributed tracing system in production.
  • Hands-on experience with high-throughput systems ingesting 100M+ events per day.
  • Strong systems programming experience with production Go and/or Rust preferred.
  • Comfort working across the stack from agent code to backend services.
  • Knowledge of networking and security fundamentals, including TLS, DNS, TCP, and identity protocols.
  • Prior ZTNA, SASE, or SD-WAN experience is a strong plus.
  • Pragmatic, opinionated, and impact-driven mindset.
  • Experience with observability platforms such as Datadog, Splunk, Elastic, Honeycomb, New Relic, or Grafana Labs, or equivalent.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

ELEKS

SoV Team, Technical Lead, JR285

ELEKS 1K-5K Construction & Engineering

ELEKS is hiring a Senior .NET Technical Lead in the US to lead delivery for an insurance and investment banking client’s software engineering work.

United States Lead Backend Engineer Technical Lead
Azure C# CI/CD Databricks Datadog Docker Kubernetes Microservices .NET Redis REST API SQL Server Terraform
1 day, 18 hours ago
Bitly

Staff Engineer, AI Platform & Architecture (R5449)

Bitly 51-250 Internet Software & Services

Shield AI is hiring a Staff Engineer, AI Engineering to shape enterprise AI platform architecture and governance for production use across the company’s engineering and business teams.

United States Full-time Lead AI Engineer Technical Lead
$190k-$290k
Databricks Generative AI LLM MLOps Snowflake
1 day, 18 hours ago
airSlate

Team Lead PHP Engineer

airSlate 251-1K Professional Services

airSlate is seeking a Team Lead PHP Engineer to join its Payments Systems core team and own the development, optimization, and integration of payment infrastructure that powers the user payment experience.

Poland Full-time Lead Backend Engineer Technical Lead
Argo CD CI/CD Docker Git GitHub Actions GitOps Go Kubernetes Laravel MySQL PHP PostgreSQL
1 day, 18 hours ago
Huge

Freelance Technology Lead

Huge 251-1K Media

Huge is hiring a remote freelance Technology Lead in Canada to support a short-term WordPress security remediation initiative for an enterprise platform.

United States Canada Contract Senior Security Engineer Technical Lead
$0k-$0k
PHP WordPress
2 days, 17 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers