RemoteLeaf Logo
Log in Sign up

Lead Data Platform Engineer - 11623

1 day, 17 hours ago
United States
Full-time
Lead
Data Engineer
DevOps and Infrastructure
Ansible Apache Spark AWS Azure Bash Chef DNS Docker Generative AI Git Helm Java Jenkins Linux LLM Looker Machine Learning MLOps MySQL Python Terraform
Apply Now
Coupa Software

Coupa Software

Coupa Software is the premier cloud-based finance platform, empowering companies worldwide to optimize spend, boost profits, and reduce costs with a comprehensive suite of modules.

Internet Software & Services
1K-5K
Founded 2006
View All Jobs 65

Description

  • Manage end-to-end data pipelines and ETL jobs within agreed SLAs.
  • Administer AWS core and big data services such as S3, IAM, EMR, and Redshift.
  • Run applications in containers using ECS and Docker.
  • Lead day-2 operations for ML and GenAI infrastructure, including production LLM serving platforms.
  • Design, deploy, and maintain high-availability AI inference platforms with automated scaling and self-healing.
  • Collaborate with product development and engineering teams to build AI-driven features.
  • Automate platform maintenance and standardize infrastructure configurations across multi-cloud environments.
  • Manage AWS infrastructure as code using tools such as Terraform and Chef.
  • Administer Linux-based applications and support product releases and ECS/Linux cluster patching.
  • Enable monitoring and observability for applications and infrastructure, including on-call support for ETL and data pipeline incidents.
  • Participate in design reviews, code reviews, troubleshooting, and incident response.
  • Write, review, and maintain root cause analyses (RCAs) for production issues.

Requirements

  • Bachelor's degree and 8+ years of experience managing big data technologies and data pipelines.
  • 5+ years of experience managing cloud infrastructure and platforms such as AWS and Azure.
  • Strong Linux administration and troubleshooting experience.
  • Familiarity with the generative AI engineering landscape and a strong interest in AI-related technologies.
  • Strong expertise in MLOps and production-grade LLM operations, including high-availability inference clusters and model lifecycle automation.
  • Bash or Python scripting experience.
  • Experience with containerization technologies such as Amazon ECS, EKS, or Azure AKS.
  • Experience with automation and orchestration tools such as Chef, Ansible, Jenkins, or Rundeck.
  • Experience with Git and complex branching strategies.
  • Experience with infrastructure as code tools such as Terraform and Helm charts.
  • Good understanding of DNS and load balancer setup and troubleshooting.
  • Experience with big data platforms or data lakes and BI tools such as Looker.
  • Knowledge of Apache Spark architecture and Java application troubleshooting.
  • Basic understanding of MySQL Server and general database concepts.
  • Excellent written and verbal communication skills.
  • Ability to own and deliver projects independently in a high-pressure environment.
  • Deep experience in day-2 cloud operations, including automated incident remediation, capacity planning, and large-scale production environment management.

Benefits

  • Remote work designation (#LI-Remote).
  • Inclusive and welcoming work environment with equal employment opportunity practices.
  • Opportunity to work with pioneering technology in a global-impact environment.
  • Collaborative culture focused on transparency, openness, and teamwork.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

DaCodes

Senior Data Engineer (Graph Databases & Databricks) - LATAM/Mexico - English Req

DaCodes 51-250 Internet Software & Services

DaCodes is hiring a Senior Graph Data Engineer to evaluate and benchmark enterprise knowledge graph technologies through hands-on data engineering, graph database implementation, and performance analysis for large-scale workloads.

Chile Colombia Guatemala Paraguay Uruguay Mexico Contract Senior Database Administrator Data Engineer
ArangoDB AWS Databricks Git Kubernetes Neo4j PostgreSQL SQL
16 hours, 40 minutes ago
Zscaler

Senior Manager, Data Engineering

Zscaler 1K-5K Internet Software & Services

Zscaler is hiring a Senior Manager, Enterprise Data Platform to lead the strategy, architecture, and evolution of its modern enterprise data platform in a remote US role.

United States Full-time Lead Data Engineer
$196k-$245k
CI/CD dbt Git Python Snowflake SQL
16 hours, 40 minutes ago
Mindrift.ai: Be the “I” in AI

Senior Python Data Scraping Engineer (Freelance)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking a Senior Python Data Scraping Engineer for the Tendem project to support hybrid AI + human data extraction work on complex websites and deliver accurate structured datasets.

Greece Portugal Italy Part-time Senior Backend Engineer Data Engineer
Up to $83k
AJAX AWS Docker GitHub HTML JavaScript JSON LLM Python Selenium
16 hours, 40 minutes ago
Goods & Services

Senior Data Engineer

Goods & Services 51-250 Media

Goods & Services is hiring a Senior Data Engineer to lead and scale core data infrastructure by transforming raw source data into governed, business-ready data marts and a consistent semantic layer.

Mexico Colombia Senior Data Engineer
Apache Spark AWS CI/CD Databricks dbt Git Python Snowflake SQL
16 hours, 40 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers