Principal Data Engineer

8 hours, 13 minutes ago
Full-time
Lead
Software Development
Arbor

Arbor

Arbor is the leading cloud MIS provider in the UK, empowering schools and MATs to collaborate effectively, save time, and enhance pupil achievement through centralized data management and insightful analytics.

IT Services
51-250

Description

  • Define and promote target architectures that connect transactional, analytical, and AI systems.
  • Lead the end-to-end data lifecycle, including OLTP schema design, migrations, OLAP governance, platform, and analytics.
  • Partner with Technical Leads to support feature delivery, tech debt reduction, and architecture improvements.
  • Collaborate with Product Directors to translate product vision into delivery plans aligned to commercial and engineering goals.
  • Drive Arbor’s shift to an AI-first way of working and build data foundations that enable AI capabilities in products.
  • Architect infrastructure for LLM orchestration, Retrieval-Augmented Generation (RAG), and real-time model inference at scale.
  • Mentor and coach Technical Leads and Senior Engineers to raise architectural and engineering standards and support career growth.
  • Lead architectural reviews and ensure designs meet quality, reliability, security, and compliance standards.
  • Work with Staff Engineers, Principal Engineers, and Engineering Management to shape broader technology strategy and remove systemic bottlenecks.

Requirements

  • Extensive experience overseeing data architecture and delivering iterative outcomes across one or more OLAP domains.
  • Strong understanding of data modelling techniques such as Star and Medallion, and distributed data systems in cloud-native environments such as Snowflake.
  • Experience building and leveraging unstructured data across disparate systems to support product development.
  • Strong communication and influencing skills across technical and non-technical audiences.
  • Ability to support the growth of engineers and technical leads while delivering value across distributed, cross-functional teams.
  • Experience working in an ownership culture where quality, performance, observability, and security are core responsibilities.
  • Understanding of how AI-first engineering will change the data ecosystem and ways of working, ideally with worked examples.
  • Experience contributing to or leading technical communities of practice such as chapters, guilds, or architecture councils.
  • Practical knowledge of DataOps principles, including CI/CD for data and orchestration of complex pipelines using AWS, Debezium, Git, and infrastructure as code.
  • Commercial knowledge of data security standards, encryption at rest and in transit, and relevant compliance laws.
  • Experience optimising SaaS platform spend and using forecasting models.
  • Bonus: AI/ML engineering and MLOps experience, including model deployment, serving, and monitoring.
  • Bonus: Experience with federated learning and/or privacy-enhancing technologies (PETs).
  • Bonus: Direct experience with LLM Ops, including prompt engineering at scale and token cost optimisation.

Benefits

  • Remote working arrangement.
  • Salary of £100,000 to £120,000.
  • 32 days holiday, including 25 days annual leave plus 7 company-wide days over Easter, Summer, and Christmas.
  • Life assurance at 3x annual salary.
  • Private dental insurance with Bupa.
  • Comprehensive wellness support through AIG Smart Health, including 24/7 virtual GP access, mental health support, counselling, and health checks.
  • Enhanced maternity and adoption leave of 20 weeks full pay, plus 6 weeks full pay paternity leave.
  • Dedicated professional development budget for CPD courses, upskilling resources, and professional memberships.
  • Flexible working arrangements.
  • Volunteer day each year for a charity of your choice.
  • Access to Calm and Bippit financial wellbeing coaching.
  • Dog-friendly offices.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Staff Data Engineer

SmithRx 1K-5K Pharmaceuticals

SmithRx is seeking a Data Engineering leader to design and scale the data platforms that support pharmacy benefits analytics, governance, and machine learning in a fast-growing health-tech environment.

Apache Airflow Apache Spark C# C++ dbt Go Java LLM Looker Python Scala Snowflake SQL Superset
6 hours, 58 minutes ago

Data Engineer

Jenzabar 251-1K Internet Software & Services

The Data Engineer V at Jenzabar leads the design and optimization of scalable data pipelines and analytics platforms that support business insights across product, analytics, and engineering teams.

Agile Apache Spark Azure Databricks Git Power BI Python Scrum SQL SQL Server
8 hours, 13 minutes ago

[Job 29911] Mid/Senior Data Developer, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Mid/Senior Data Developer in Brazil to build and evolve data lake and analytics layers through reliable integrations, stable transformation pipelines, and governed market data organization in a remote-first environment with some on-site presence required for Campinas metro residents.

Apache Airflow AWS CI/CD CloudFormation dbt FastAPI Git GitHub Actions GitLab CI Grafana Kafka Kubernetes Microservices Pandas PostgreSQL Prometheus Python Snowflake SQL Terraform
8 hours, 13 minutes ago

Databricks Solution Architect

Bounteous 1K-5K Internet Software & Services

Bounteous is seeking a Lead Databricks Engineer/Architect to own the design and delivery of a cloud-based lakehouse data platform that supports analytics, data science, and machine learning at petabyte scale.

Apache Spark AWS Azure CI/CD Databricks GCP Git Kafka MLflow Python Scala SQL Terraform
8 hours, 13 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers