RemoteLeaf Logo
Log in Sign up

Senior AI Software Engineer, Python

4 weeks, 1 day ago
United States
Full-time
Senior
AI Engineer
Software Development
Azure OpenTelemetry Python
Apply Now
Scorpion

Scorpion

Scorpion is a client-focused company that provides technology and services to help local businesses thrive. They offer a range of marketing solutions, blending AI with human expertise to assist customers in understanding market dynamics, optimizing mar...

Media
1K-5K
Founded 2001
$100M raised
View All Jobs 9

Description

  • Own the reliability of the event-driven messaging layer, including backpressure management, idempotency, dead-letter handling, and retry strategies.
  • Build and operate infrastructure for LLM orchestration workloads at scale.
  • Own the operational data layer for the CI runtime, including state management, session persistence, and real-time data access patterns.
  • Implement observability for the platform, including structured logging, distributed tracing, and error tracking.
  • Maintain and harden interfaces between the CI platform and downstream systems through contract testing, versioning, and failure handling.
  • Conduct code reviews and mentor team members on Python engineering practices and production readiness.
  • Own production support for CI infrastructure, including on-call duties and incident response.
  • Design and operate distributed, event-driven systems in a production environment.

Requirements

  • 5+ years of experience or relevant experience.
  • Experience developing production-grade Python services at scale.
  • Experience operating real-time or high-throughput infrastructure supporting AI/ML workloads.
  • Experience with distributed, event-driven systems in production.
  • Deep knowledge of Python internals, including async/await lifecycle, event loop mechanics, GIL implications, and memory profiling.
  • Production experience with Pydantic, type systems, and structured data modeling in high-throughput services.
  • Hands-on experience operating LLM inference infrastructure at scale.
  • Deep experience with NoSQL data modeling, including partition strategy, consistency tradeoffs, query cost optimization, and hot-partition avoidance.
  • Experience with observability tooling such as OpenTelemetry and Sentry.
  • Experience with Azure cloud platform services.
  • Ability to negotiate technical boundaries with upstream and downstream teams.
  • Clear, direct communication skills for design discussions, incident response, and code review.

Benefits

  • Base salary range of $135,000 to $175,000, exclusive of fringe benefits.
  • Potential incentive compensation through discretionary bonuses or commissions.
  • 100% employer-paid medical, dental, and vision insurance.
  • Flexible paid time off.
  • Paid parental leave.
  • Paid cell phone and service.
  • Remote office allowance.
  • Professional development support, including development courses and regular manager check-ins through Lattice.
  • Flexible work arrangements, including in-office, hybrid, and remote options.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Fireworks AI

Member of Technical Staff, Cloud Infrastructure, Singapore

Fireworks AI 1-10 Internet Software & Services

Fireworks AI is hiring a Backend Software Engineer to design and develop the backend systems that power its generative AI infrastructure platform.

Singapore Full-time Mid Level Backend Engineer Infrastructure Engineer
$133k-$185k
Machine Learning PyTorch
22 minutes ago
INFUSE

AI Automation Team Lead (Remote, Contract)

INFUSE 251-1K Professional Services

SoftDev is hiring a cross-functional transformation team member to identify inefficiencies, redesign workflows, and implement AI-powered solutions that drive measurable business impact across the organization.

Romania Contract Lead AI Engineer Technical Lead
Python SQL
22 minutes ago
Capco

AI Engineer | Banking

Capco 5K-10K Internet Software & Services

Capco is hiring an AI Engineer in Hong Kong to develop production AI solutions for financial services and insurance clients, focusing on intelligent, compliant systems that improve efficiency and customer experience.

Hong Kong Mid Level AI Engineer Machine Learning Engineer
Agile Apache Spark AWS Azure BERT CI/CD Docker GCP Git GPT Hadoop Java Kubernetes LLM Machine Learning MLOps Neural Networks Node.js Python React SQL
22 minutes ago
Capco

Python Data Analyst

Capco 5K-10K Internet Software & Services

Capco, a Wipro company, is seeking a Python Data Analyst/Backend Developer to build scalable API-driven applications for financial services clients, with a focus on backend development, data handling, and secure integrations.

India Mid Level Backend Engineer Data Analyst
AWS Azure CI/CD Django Docker FastAPI GCP JWT Kafka Kubernetes Microservices MySQL NumPy OAuth Pandas PostgreSQL Python RabbitMQ REST API SQL SQL Server
36 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers