RemoteLeaf Logo
Log in Sign up

Lead Data Engineer

1 month, 1 week ago
United Kingdom
Full-time
Lead
Data Engineer
Software Development
Apache Airflow AWS CI/CD DynamoDB Git Kanban Microservices Pandas PostgreSQL Prefect Python Scrum SQL
Apply Now
AND Digital

AND Digital

AND Digital: Leading digital product development company accelerating world-class capabilities for ambitious businesses.

Internet Software & Services
1K-5K
Founded 2014
$26M raised
View All Jobs 4

Description

  • Lead the technical practice for the Luna data team and own the data platform migration roadmap.
  • Design and implement Python-based ETL pipelines to move data from DynamoDB to Postgres OLTP and then to Postgres OLAP.
  • Optimize Postgres transactional and analytics environments for performance and cost efficiency.
  • Establish and enforce DataOps standards, including Git-based version control, CI/CD, and schema migration practices.
  • Mentor and coach data team members in Python, Git, engineering workflows, and production-ready DataOps practices.
  • Conduct detailed code reviews and provide educational feedback to raise team quality standards.
  • Support the definition and implementation of AI tooling and engineering practices for the data team.
  • Break down larger reporting and migration initiatives into epics and stories within an Agile delivery framework.
  • Work with business stakeholders to gather requirements and translate them into scalable technical roadmaps.
  • Support the Data Product Owner with technical context to prioritize the team backlog.

Requirements

  • 7 to 10 years of experience building and supporting full-stack data pipelines from source to reporting.
  • 5+ years of deep AWS experience, ideally including administration and optimization of RDS/Aurora (Postgres) and Redshift.
  • 5+ years of expert-level Python experience, including ETL pipelines and libraries such as Pandas.
  • Experience with orchestration tools such as Airflow or Prefect.
  • 5+ years of expert-level SQL and PostgreSQL database architecture experience, including partitioning and indexing for OLTP and OLAP.
  • 3+ years of expertise in Git, including branching workflows and version control practices.
  • Experience with schema migration tools such as Liquibase, Flyway, or Drizzle.
  • Experience working in Agile environments using Scrum and Kanban.
  • Ability to work mostly remotely with occasional travel to a clubhouse or office location in London, Birmingham, Manchester, Bristol, Reading, Edinburgh, or Leeds.
  • Experience helping teams adopt DataOps practices or mentor engineers and analysts is preferred.

Benefits

  • 25 days of holiday plus bank holidays.
  • Share scheme.
  • £1,000 flexifund to spend on personalized benefits such as gym membership, Cycle to Work, or health, dental, and optical cash plan.
  • 6% pension contribution.
  • Remote-first blended working model with flexibility across home, clubhouse, and client locations.
  • Annual training and upskilling budget with allocated study days.
  • Monthly and quarterly team socials paid for by the company.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Flatgigs

Python Data Engineer

Flatgigs Professional Services

FlatGigs is hiring a Python Data Engineer to build and maintain reliable, scalable data pipelines and ETL workflows that support analytics and data-driven decision-making.

Pakistan Full-time Mid Level Data Engineer
Apache Airflow AWS Azure Docker GCP Kubernetes MongoDB NumPy Pandas PostgreSQL Python SQL
2 hours, 16 minutes ago
ClickHouse

Senior Software Engineer - Data Integration & JVM Ecosystem

ClickHouse 51-250 IT Services

ClickHouse is hiring a Senior Software Engineer to own JVM-based data connectors and integrations that connect its high-performance analytics platform to the broader data ecosystem.

Israel Full-time Senior Backend Engineer Data Engineer
Apache Airflow Apache Spark ClickHouse dbt Grafana HTTP Java Kafka Metabase Pandas Power BI Python SQL Tableau TCP/IP
3 hours, 34 minutes ago
Lingaro

SAP BW Lead

Lingaro 5K-10K IT Services

SAP BW Lead for Poland’s CC Data Engineering & Management team at SAP, responsible for leading SAP BW-related data engineering work in a full-time remote role.

Poland Full-time Lead Data Engineer
4 hours, 52 minutes ago
Alex Staff Agency

Lead Data / Rating Engineer

Alex Staff Agency 11-50 Professional Services

Rating Production Lead at a product company building scalable rating systems to improve creator monetization and information navigation, with the goal of turning existing algorithms and data methods into a production-ready system.

Europe Armenia Poland Serbia Georgia Kazakhstan Cyprus Full-time Lead Data Engineer Data Scientist
Up to $84k
Machine Learning Python SQL Statistics
6 hours, 11 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers