RemoteLeaf Logo
Log in Sign up

Senior/Staff/Principal SWE- Observability Engineering

3 weeks, 6 days ago
United States
Full-time
Lead
Technical Lead
Software Development
Datadog DNS Elasticsearch Go Honeycomb JSON LLM New Relic OpenTelemetry Prometheus Rust Splunk TLS
Apply Now
Appgate

Appgate

Appgate is the secure access company empowering secure connections with Zero Trust principles for people, devices, and systems.

Professional Services
251-1K
Founded 2020
View All Jobs 13

Description

  • Architect the observability platform, including telemetry schema, correlation model, transport, and sampling strategies across client devices, controllers, and gateways.
  • Build telemetry SDKs and the LogForwarder pipeline using OpenTelemetry.
  • Implement enrichment, redaction, batching, and tail-sampling for high-volume telemetry processing.
  • Design and support a high-cardinality ingestion and routing layer that can scale to 100M+ events per day.
  • Develop end-to-end distributed tracing across login and session establishment flows.
  • Enable on-demand packet capture workflows that are observable through logs and traces.
  • Define and validate integration standards for OTLP, Prometheus, and JSON logs.
  • Test and validate the observability system at customer-scale environments with large deployments and high concurrency.
  • Collaborate with product, R&D, and customers to shape requirements and deliver outcomes.
  • Mentor engineers, establish engineering patterns and review practices, and help grow the observability discipline at AppGate.

Requirements

  • 8+ years of engineering experience, including at least 4 years in observability, telemetry, or large-scale data infrastructure.
  • Deep OpenTelemetry expertise, including OTLP, the OTel Collector, semantic conventions, context propagation, and head/tail sampling.
  • Experience designing or significantly contributing to a distributed tracing system in production.
  • Hands-on experience with high-throughput systems ingesting 100M+ events per day.
  • Strong systems programming experience with production Go and/or Rust preferred.
  • Comfort working across the stack from agent code to backend services.
  • Knowledge of networking and security fundamentals, including TLS, DNS, TCP, and identity protocols.
  • Prior ZTNA, SASE, or SD-WAN experience is a strong plus.
  • Pragmatic, opinionated, and impact-driven mindset.
  • Experience with observability platforms such as Datadog, Splunk, Elastic, Honeycomb, New Relic, or Grafana Labs, or equivalent.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

CI&T

[Job - 29861] Tech Lead .NET , Brazil

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Tech Lead .NET in Brazil to lead two backend teams supporting the evolution and ongoing maintenance of a digital account and Pix platform for a strategic client expansion area.

Brazil Full-time Lead Technical Lead
.NET
1 hour, 27 minutes ago
Cato Networks

Team Lead - AI Security for Coding Agents

Cato Networks 251-1K Diversified Telecommunication Services

Cato Networks is hiring a hands-on Software Engineering Team Lead to own its AI Security product for coding agents and lead a full-stack team building cloud-based security and governance capabilities for enterprise development workflows.

Israel Lead AI (Artificial Intelligence) Technical Lead
AWS Go Kubernetes Node.js Python
1 hour, 27 minutes ago
teamified.com

AI Principal Engineer

teamified.com Hotels, Restaurants & Leisure

Teamified is hiring a hands-on Principal Engineer to lead an AI-first engineering pod building and modernizing a secure payments platform for business B2B transactions.

India Full-time Lead AI Engineer Technical Lead
AWS C# CI/CD Git GitHub Actions Go Java Jenkins JIRA Microservices .NET Python React SQL Server TypeScript
1 hour, 27 minutes ago
Pixelogic Media

Backend Team Lead (Ruby on Rails)

Pixelogic Media 1K-5K Media

mediafellows, the German subsidiary of Pixelogic Media, is hiring a Backend Team Lead in Colombia to establish and lead a development hub for its SaaS platform serving audiovisual content marketing and distribution.

Colombia Contract Lead Backend Engineer Technical Lead
AWS ClickHouse Elasticsearch Git GitHub Kubernetes PostgreSQL Redis REST API RSpec Ruby on Rails
1 hour, 42 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers