RemoteLeaf Logo
Log in Sign up

Senior Software Engineer, Ingestion Team

2 hours, 14 minutes ago
United States
Full-time
Senior
Software Engineer
Software Development
Apache Airflow AWS Azure Docker GCP Go Helm Kafka Kubernetes NLP Prefect Python RabbitMQ Terraform
Apply Now
Pryon

Pryon

Pryon delivers instant AI-powered answers from enterprise content, improving productivity and enhancing customer experiences.

Internet Software & Services
51-250
Founded 2017
$159M raised
View All Jobs 3

Description

  • Design and build pipeline stages for document intake, transformation, enrichment, embedding generation, and index writing.
  • Contribute to the design of next-generation ingestion architecture as the system evolves.
  • Improve system stability and scale by identifying bottlenecks, reducing failure rates, and adding observability.
  • Work with workflow orchestration tools to manage multi-step document processing with retries, error handling, and state management.
  • Handle diverse document types, including PDFs, HTML, Office formats, images, and structured or semi-structured data.
  • Collaborate with the Connectors team and Retrieval team to ensure clean data flow across system boundaries.
  • Participate in the migration from legacy systems while maintaining operational stability.
  • Support the processing backbone that enables accurate and reliable enterprise AI.

Requirements

  • 5+ years of software engineering experience, with meaningful time on data processing pipelines, ETL systems, or similar infrastructure.
  • Strong proficiency in Python and/or Go.
  • Experience with workflow orchestration tools such as Temporal, Airflow, Prefect, Step Functions, or similar.
  • Understanding of distributed systems patterns, including queues, workers, backpressure, idempotency, and retry strategies.
  • Hands-on experience with Kubernetes, Docker, Terraform, and Helm.
  • Familiarity with message brokers and event streaming tools such as Kafka, RabbitMQ, or SQS.
  • Comfort working across cloud providers, including AWS, Azure, and GCP.
  • Self-driven and comfortable operating with autonomy inside a structured team.
  • Strong communication skills and the ability to collaborate in a remote-first environment.
  • Authorization to work in the United States; sponsorship is not available at this time.

Benefits

  • $175,000 - $200,000 annual salary.
  • Remote-first organization.
  • 100% company-paid Health, Dental, and Vision coverage for employees and dependents.
  • Life insurance, short-term disability, and long-term disability coverage.
  • 401(k) plan.
  • Unlimited PTO.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Scripta Insights

Senior/Staff Software Engineer

Scripta Insights 11-50 Internet Software & Services

Scripta Insights is hiring a Staff Software Engineer to lead the design and evolution of backend systems for its core products in a Java-based platform that is expanding into Python.

United States Full-time Lead Software Engineer Technical Lead
AWS Azure GCP Java Microservices Python REST API Spring System Design
14 minutes ago
Wati.io

Agentic Engineer - CAB LATAM

Wati.io 11-50 Internet Software & Services

Wati is hiring an Agentic Engineer in Rio de Janeiro to lead regional custom engineering for LATAM enterprise clients by turning bespoke business needs into scalable integrations, workflows, and features.

Brazil Full-time Senior AI Engineer Software Engineer
Microservices
14 minutes ago
Everbridge

Senior Software Engineer ,Frontend

Everbridge 1K-5K Internet Software & Services

Senior Software Engineer, Frontend at Everbridge for a remote India R&D team, building web and mobile product experiences that support the company’s critical event management platform.

India Full-time Senior Software Engineer
Agile CI/CD CSS Dart Figma Firebase Flutter Grafana HTML JavaScript JSON React REST API
29 minutes ago
FMX

Senior Software Developer

FMX 51-250 Internet Software & Services

FMX is hiring a Senior Software Developer to build and refine features across its cloud-based facility maintenance and management platform while helping shape the company’s technical direction.

United States Full-time Senior Software Engineer
AWS Azure Blazor C# Entity Framework Git JavaScript jQuery .NET New Relic Terraform
29 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers