Senior Fabric Data Engineer

1 hour, 15 minutes ago
Contract
Senior
Software Development
Spirit Omega

Spirit Omega

Spirit Omega (formerly Spirit Staffing & Consulting) is an Indigenous-Women owned business, committed to providing quality service and professional staff for temporary, contract or direct-hire roles. We have qualified Placement Specialists who conduct intense evaluations and reference checks to ensure complete client satisfaction, and our extensive database includes experienced technical and administrative employees. Our successful team is honored to be the recipient of numerous business awards. Spirit Omega currently operates out of Calgary, AB but places contractors and employees all across Canada! We have established partnerships across Canada to service national contracts and our new partnership has enabled international expansion. We also have an Industrial Labour and Safety Training Divison, Fast Labour Solutions, which was created in 2000 to provide Industrial Staffing Services including non-skilled and skilled tradespeople. Follow our industrial and safety training division @Fast Labour Solutions!

human resources
11-50
Founded 1998

Description

  • Design and implement data solutions using Microsoft Fabric components such as OneLake, Fabric Pipelines, Lakehouse, Warehouse, and Notebooks.
  • Build and optimize scalable ingestion and transformation pipelines with PySpark, Python, and SQL.
  • Migrate and harmonize data from Saba, Cura, and related enterprise systems.
  • Develop API-driven and scheduled workflows to ingest data from internal and external sources.
  • Implement business rules for learning history, certifications, compliance, skills, and learner profile data.
  • Build curated, analytics-ready datasets for dashboards, reporting, and downstream integrations.
  • Perform SQL development and tuning for reporting and operational consumption.
  • Implement data quality checks, reconciliations, monitoring, exception handling, and audit logging.
  • Enforce secure access controls using Azure AD, RBAC, managed identities, and secure connectivity patterns.
  • Support CI/CD, code promotion, release management, and operational monitoring in an Agile environment.

Requirements

  • 7+ years of experience in data engineering and enterprise data integration.
  • Strong hands-on experience with Microsoft Fabric and related Azure data services.
  • Strong experience with PySpark, SparkSQL, Python, and SQL/T-SQL.
  • Experience building ingestion and transformation pipelines from APIs, files, databases, and third-party platforms.
  • Experience with curated data layers, data modeling, and analytics-ready datasets.
  • Experience tuning data pipelines for scale, resiliency, and cost optimization.
  • Working knowledge of security, access controls, and data governance practices.
  • Experience with Azure DevOps and Git-based deployment automation.
  • Strong analytical, troubleshooting, and communication skills.
  • Experience with learning, HR, or talent data domains preferred.
  • Familiarity with ADF, Synapse, Databricks, Azure Functions, or Logic Apps preferred.
  • Exposure to AI tools such as GitHub Copilot and Claude preferred.
  • Experience with data governance tooling such as Purview preferred.
  • Exposure to AI/ML-ready data preparation and feature engineering practices preferred.
  • Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field.
  • Ability to work independently and proactively in a fast-paced delivery environment.
  • Comfortable operating in remote or hybrid teams with cross-functional coordination.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Business Systems Engineer

TLATech Specialized Consumer Services

Syllo is hiring a Senior Business Systems Engineer to connect internal systems, third-party tools, and data pipelines that support operations across Revenue Operations, Finance, and Customer Success.

CRM FastAPI GCP Microservices Python React
45 minutes ago

Senior Data Engineer

Xebia 1K-5K Internet Software & Services

Xebia is hiring Data Engineers for an AWS-based data mesh platform project where product engineering teams will own and run the data they produce and consume.

AWS Azure Databricks DynamoDB Flink GCP Generative AI Kafka Kubernetes Python Snowflake SQL
1 hour ago

Data Platform Engineer III

Mozn 51-250 Internet Software & Services

Mozn is hiring a Data Platform Engineer III to design, operate, and improve the data infrastructure that powers analytics, real-time processing, and AI workloads across cloud-native and hybrid environments.

Apache Spark AWS Azure Bash ClickHouse Druid Flink GCP GitOps Go Grafana Helm Kafka Kubernetes MySQL OpenSearch PostgreSQL Presto Prometheus Python SQL Terraform Trino
1 hour, 15 minutes ago

Principal Software Engineer - Data Platform (Iceberg/Trino)

Innovaccer 1K-5K IT Services

Innovaccer is hiring a Principal Software Engineer to design and own the on-premise lakehouse engine architecture for its healthcare data platform.

Apache Spark AWS GCP Java Kubernetes Microservices Python REST API Snowflake SQL Trino
1 hour, 15 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers