RemoteLeaf Logo
Log in Sign up

Senior Software Engineer II (Data Pipelines)

8 hours, 25 minutes ago
United States
Full-time
Senior
Data Engineer
Software Development
Agile Apache Airflow CI/CD dbt GCP Git GitHub Actions Grafana Hive Kubernetes Looker PostgreSQL Prometheus Python Scrum SQL Terraform
Apply Now
Wpromote

Wpromote

Wpromote is The Challenger Agency, specializing in digital marketing and customer acquisition that exceeds expectations.

Media
251-1K
Founded 2001
View All Jobs 39

Description

  • Act as the technical leader and subject matter expert for data pipeline automation and workflow orchestration.
  • Design, implement, maintain, and automate reliable data solutions using Airflow, dbt, and Google Cloud products.
  • Manage a large portfolio of dbt models using macros, reusable DRY patterns, and dbt tests.
  • Monitor, troubleshoot, and optimize data pipeline and workflow performance.
  • Architect scalable solutions and reusable technical patterns aligned with business needs.
  • Advocate for test-driven development and support robust CI/CD and quality assurance processes.
  • Provide implementation, configuration, deployment, and architecture documentation.
  • Ensure data security, governance, compliance, and adherence to privacy requirements.
  • Mentor engineers, participate in agile ceremonies, and foster technical excellence.
  • Identify issues, implement innovative solutions, and stay current with data engineering technologies.

Requirements

  • 7+ years of software development experience, including extensive work with Python, SQL, and data pipelines.
  • Expertise building and automating ETL/ELT pipelines with Airflow and DAG-based workflow management; Airbyte experience is preferred.
  • Deep experience managing dbt models, macros, and dbt tests.
  • Strong Python or comparable scripting, API integration, and software architecture skills.
  • Experience with PostgreSQL and BigQuery, including query optimization for performance and cost.
  • Experience with Google Cloud Platform, Kubernetes, Terraform, and infrastructure as code.
  • Understanding of business intelligence tools such as Looker or comparable platforms.
  • Proficiency with Parquet, Avro, Hive, JSONL, and data integration techniques.
  • Experience with monitoring and logging tools such as Prometheus and Grafana is preferred.
  • Familiarity with Git, GitHub Actions, CI/CD, agile methodologies, test-driven development, technical leadership, and cross-functional collaboration.

Benefits

  • Annual salary range of $155,000–$180,000, plus benefits.
  • Unlimited PTO and an extended winter holiday break.
  • 100% paid parental leave.
  • 401(k) matching.
  • Medical, dental, vision, life, pet, short-term disability, and voluntary insurance options.
  • Annual Class Pass credits.
  • Remote work available in most U.S. states, with office hubs in Los Angeles, Chicago, and New York.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

CI&T

[Job - 31429] Data Engineer Specialist

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Data Engineer to own the Foundation Pod’s end-to-end data platform, building reliable pipelines, governed models, and analytics solutions for enterprise transformation initiatives.

Colombia Brazil Full-time Lead Data Engineer
Azure CI/CD Power BI Terraform
8 hours, 25 minutes ago
TTEC Digital

Director, Data Engineering - GCP

TTEC Digital 1K-5K Professional Services

TTEC Digital is seeking a Director of Data Engineering (GCP) to lead its Google Cloud data engineering practice and build scalable data platforms supporting analytics, AI/ML, governance, and digital transformation initiatives.

Canada Full-time Executive Cloud Engineer Data Engineer
$155k-$178k
Agile Apache Airflow Apache Spark CI/CD GCP Generative AI Machine Learning Python SQL Terraform Vertex AI
8 hours, 25 minutes ago
Inca Digital

Mid/Senior-level GoLang Data Engineer (EU)

Inca Digital 11-50 Internet Software & Services

Inca Digital is seeking a Golang Backend Engineer to build and operate data infrastructure that transforms blockchain, financial, social, and web data into intelligence products for digital-asset risk, surveillance, and investigations.

Europe Full-time Mid Level Backend Engineer Data Engineer
AWS CI/CD Docker Git Go gRPC Kafka Kubernetes Microservices MongoDB NLP PostgreSQL RabbitMQ Redis REST API SQL Terraform
8 hours, 25 minutes ago
Pingwind

Database/ETL Engineer Senior

Pingwind 51-250 Internet Software & Services

PingWind is seeking an Intermediate Database Analyst to modernize and optimize secure, high-volume ETL pipelines supporting U.S. Army Human Resources Command data in a remote role based in Ft. Knox, Kentucky.

United States Full-time Senior Data Engineer
$84k-$117k
Cybersecurity HTML PostgreSQL SQL SQL Server XML
8 hours, 40 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers