Data Engineer - Fixed Term Contract

1 hour, 58 minutes ago
Full-time
Mid Level
Software Development
Livestock Information

Livestock Information

Livestock Information Ltd is a leading provider of livestock data services, specializing in digital recording of livestock movements through the Livestock Information Service. Collaborating with Defra and the livestock industry, our mission is to estab...

Professional Services
11-50
Founded 2019

Description

  • Design and implement Azure data storage solutions and schemas for specific use cases.
  • Build and maintain data pipelines for data movement, transformation, and orchestration.
  • Use Azure Data Factory and Azure Databricks to integrate, process, and load data into Azure storage.
  • Test and validate data at each stage of the pipeline to ensure quality and accuracy.
  • Tune and monitor data pipelines to improve performance, scalability, and reliability.
  • Develop and maintain data models and schemas optimized for business needs.
  • Collaborate with Product Owners, Business Analysts, Developers, Testers, and other teams to deliver data for analytics and reporting.
  • Ensure data streamed and processed on Azure meets security and privacy requirements, including GDPR.
  • Work with very large datasets and perform data analysis as needed.
  • Stay current with Azure features, updates, and best practices and apply them where appropriate.

Requirements

  • Proven experience in Python programming for data engineering and analytics.
  • Strong proficiency in SQL, including Microsoft T-SQL.
  • Hands-on experience with Azure data storage solutions.
  • Practical knowledge of Azure Databricks and Azure Data Factory.
  • Solid understanding of data modelling concepts and schema design best practices.
  • Strong analytical and problem-solving skills with excellent attention to detail.
  • Effective communication skills and the ability to work collaboratively in cross-functional teams.
  • Experience with Azure Synapse is part of the modern data stack used in this role.
  • Must be able to work on a 12-month fixed-term contract.
  • Work visa sponsorship is not available.
  • Ability to apply knowledge of data security and privacy requirements such as GDPR.

Benefits

  • Salary of £50,000.
  • Fully remote and flexible working setup.
  • 25 days annual leave, increasing by 1 day per year of service up to 30 days, plus Bank Holidays.
  • 1 Privilege Day.
  • Life assurance at 4x annual salary.
  • Market-leading pension scheme through Legal & General.
  • Enhanced family-friendly policies.
  • Excellent learning, training, and career development opportunities.
  • 24/7 access to an Employee Assistance Programme.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Manager, Data Platform & Integrations

CrossCountry 251-1K Professional Services

CrossCountry Consulting is hiring a Manager, Data Platform & Integrations to lead its enterprise data platform, unify core business systems, and build a centralized Snowflake-based warehouse that supports analytics, reporting, and operational decision-making.

Salesforce Snowflake SQL
13 minutes ago

Staff Data Engineer (Regulatory)

RecargaPay 251-1K Capital Markets

RecargaPay is seeking a Staff Data Engineer to lead regulatory data architecture and delivery for scalable reporting solutions within its AI-first, 100% remote Brazilian payments platform.

Apache Airflow Apache Spark AWS CI/CD Databricks Git Kafka SQL
13 minutes ago

Data Engineer

Borrowell 51-250 Banks

Borrowell is hiring a Data Engineer to build and maintain the data infrastructure that powers analytics, data-driven applications, and machine learning use cases for its Canadian financial platform.

Apache Airflow AWS Azure Dagster dbt Docker GCP Machine Learning Python Snowflake SQL
13 minutes ago

Marketing Automation Engineer

UpGuard 51-250 Professional Services

UpGuard is hiring a Marketing Automation Engineer to architect and optimize the technical systems behind its marketing engine for a high-growth B2B SaaS cyber risk platform.

GCP HubSpot JavaScript Node.js Segment SQL
28 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers