Data Engineer

3 weeks, 6 days ago
Contract
Junior
Software Development
PartnerOne

PartnerOne

PartnerOne specializes in enterprise software solutions that manage extensive data environments through hyper automation, virtualized cloud storage, artificial intelligence, and metadata analytics, serving many of the world's largest corporations.

Media
51-250

Description

  • Design and build ETL pipelines using Microsoft Fabric tools or equivalent technologies.
  • Write optimized SQL queries and transformations for data ingestion from source systems.
  • Apply data quality rules and validation logic throughout pipeline stages.
  • Implement incremental loads and manage refresh schedules to improve performance.
  • Define and maintain data quality checks at ingestion, transformation, and output stages.
  • Validate pipeline outputs against business logic and source system expectations.
  • Identify, document, and escalate data quality issues with root cause analysis.
  • Build and maintain data transformations using Power Query, SQL, or Python as appropriate.
  • Develop dimensional models and aggregation logic aligned with analytics requirements.
  • Troubleshoot pipeline failures and performance issues, and coordinate resolution with IT/Engineering.

Requirements

  • Advanced SQL experience, including query optimization, window functions, performance tuning, and debugging complex transformations.
  • Proficiency with Microsoft Fabric, including Dataflow Gen2, Notebooks, and Lakehouse, or equivalent ETL tools such as Python, dbt, Talend, or Informatica.
  • Strong understanding of relational database design and dimensional modeling.
  • Experience with Power Query / M for complex data shaping, merging, error handling, and transformation logic.
  • Experience with Python or a similar scripting language for data manipulation and pipeline automation.
  • Basic Git/version control knowledge for collaborating on code and tracking changes.
  • Experience with data quality and testing frameworks, including unit tests, assertions, and validation rules.
  • Ability to interpret business requirements and design efficient data solutions.
  • Mortgage or lending domain familiarity is preferred, with willingness to learn the domain required.
  • Ability to work within defined standards and escalate architectural questions to a lead.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Data Engineer

Cortex 11-50 Internet Software & Services

Cortex is hiring a Senior Data Engineer to own internal data systems and pipelines that power company-wide reporting, product analytics, and AI-driven operations from a fully remote US-based team.

ClickHouse dbt GCP OpenTelemetry Python Segment SQL
16 hours, 19 minutes ago

Data Solutions Engineer

Standard Metrics 11-50 Capital Markets

Standard Metrics is hiring a Data Solutions Engineer to own customer-facing data workflows, integrations, and AI-driven automation for a financial data platform serving investors and portfolio companies.

dbt LLM Python REST API Snowflake SQL
1 day, 16 hours ago

Senior Data Engineer (R13923)

Oportun 1K-5K Banks

Oportun is hiring a Senior Data Engineer to design and deliver scalable data platforms and solutions that support business and analytical needs across cross-functional initiatives.

Agile Apache Airflow Apache Spark AWS Azure Databricks GCP Hadoop Java Jenkins Kafka Kanban MariaDB PostgreSQL Python Scala Scrum SQL
2 days, 16 hours ago

AWS Senior DevOps Engineer

Xebia 1K-5K Internet Software & Services

Xebia is hiring a Senior DevOps Engineer to provision and operate a multi-region AWS environment for a US expansion while maintaining parity with the existing EU setup and supporting analytics and security operations.

AWS CI/CD Penetration Testing PostgreSQL
2 days, 17 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers