Data Engineer

3 hours, 8 minutes ago
Full-time
Mid Level
Software Development
PartnerOne

PartnerOne

PartnerOne specializes in enterprise software solutions that manage extensive data environments through hyper automation, virtualized cloud storage, artificial intelligence, and metadata analytics, serving many of the world's largest corporations.

Media
51-250

Description

  • Design and build extraction, transformation, and loading (ETL) pipelines using Microsoft Fabric or equivalent tools.
  • Write optimized SQL queries and transformations for data ingestion from source systems.
  • Apply data quality rules, validation logic, and ongoing checks throughout the pipeline lifecycle.
  • Implement incremental loads, refresh schedules, and other performance optimizations.
  • Develop dimensional models, aggregation logic, and data structures aligned with analytics needs.
  • Troubleshoot pipeline failures, performance issues, and data discrepancy reports, coordinating resolution as needed.
  • Document transformation logic, lineage, assumptions, data sources, and transformation specifications.
  • Support user acceptance testing for new data sources and transformation logic.
  • Maintain data quality dashboards, SLA monitoring, and capacity planning for Fabric environments.
  • Collaborate with the Lead on semantic models, calculated metrics, and architectural decisions.

Requirements

  • Advanced SQL skills, including query optimization, window functions, performance tuning, and debugging complex transformations.
  • Proficiency with Microsoft Fabric tools such as Dataflow Gen2, Notebooks, and Lakehouse, or equivalent ETL tools like Python, dbt, Talend, or Informatica.
  • Strong understanding of relational database design and dimensional modeling.
  • Experience with Power Query / M for complex data shaping, merging, error handling, and transformation logic.
  • Python or a similar scripting language for data manipulation and pipeline automation.
  • Basic Git/version control knowledge for collaborating on code and tracking changes.
  • Experience with data quality and testing frameworks, including unit tests, assertions, and validation rules.
  • Ability to interpret business requirements and design efficient data solutions.
  • Data governance mindset with an understanding of data lineage, documentation, and quality standards.
  • Mortgage or lending domain familiarity is preferred, with a willingness to learn the domain required.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Lead Data Platform Engineer

PR Newswire 1K-5K Internet Software & Services

INFOnline, part of saas.group, is seeking a Lead Data Platform Engineer to own and evolve its GCP-native data platform that powers digital audience measurement for the German and Austrian media industry.

CI/CD dbt Docker GCP Go Serverless SQL Terraform
2 hours, 23 minutes ago

OFSAA - Basel Technical Consultant

Unison Group Technology consulting

An experienced OFSAA Basel Technical Consultant is needed to design, develop, and support Basel regulatory reporting solutions for Oracle Financial Services Analytical Applications at a banking environment.

2 hours, 38 minutes ago

Data Engineer for AI Product

Qonto 1K-5K Banks

Qonto is hiring a Data Engineer for AI Product to build the data layer and production infrastructure that powers machine learning products for its finance workspace serving SMEs across Europe.

Apache Airflow Apache Spark CI/CD dbt Machine Learning Python
2 hours, 53 minutes ago

Senior Azure Data Consultant

Trility Consulting 51-250 Internet Software & Services

Trility Consulting is hiring a Senior Azure Data Consultant to work remotely with U.S. clients and lead data architecture and engineering efforts from initial discovery through production delivery.

Agile Azure CI/CD Databricks SQL
2 hours, 53 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers