RemoteLeaf Logo
Log in Sign up

Lead Data Consultant (Microsoft Fabric)

3 hours, 40 minutes ago
United States
Full-time
Senior
Data Engineer
DevOps and Infrastructure
Apache Spark Azure CI/CD Git GitHub Actions Oracle REST API SQL
Apply Now
Trility Consulting

Trility Consulting

Trility Consulting is a consulting firm that specializes in providing integrated AI solutions to mid-market and enterprise-sized businesses, helping them define, design, and implement comprehensive technology strategies that address significant challen...

Internet Software & Services
51-200
Founded 2017
View All Jobs

Description

  • Evaluate and refine the Microsoft Fabric architecture, metadata structures, event triggering, and reusable ingestion patterns.
  • Design and implement a metadata-driven ingestion framework for configuration-based onboarding of tables and data sources.
  • Migrate prioritized data sources and workloads from Azure Synapse to Microsoft Fabric.
  • Develop and orchestrate Fabric data pipelines and Spark notebooks using PySpark and Spark SQL.
  • Analyze existing Synapse pipelines and dependencies to translate processing logic into Fabric solutions.
  • Build data validation and reconciliation processes, including duplicate detection, key alignment, and record-level comparisons.
  • Recommend full-load, incremental, and change data capture strategies based on source-specific requirements.
  • Implement Git-based CI/CD and automated environment promotion for Fabric pipelines and notebooks.
  • Use Claude Code to define implementation specifications, accelerate development, and review generated code.
  • Partner with client engineers through paired development, code reviews, and knowledge sharing to establish sustainable engineering practices.

Requirements

  • 5+ years of experience with Azure Data Services, including Microsoft Fabric, Azure Data Factory, Databricks, or Synapse.
  • Hands-on production experience with Microsoft Fabric lakehouses, pipelines, notebooks, medallion architecture, workspaces, and capacity management.
  • Experience building production ETL/ELT pipelines and reusable, metadata-driven ingestion frameworks.
  • Experience developing Spark notebooks and transformation workflows with PySpark and Spark SQL.
  • Strong SQL skills for transformation, validation, performance tuning, and interpreting existing T-SQL logic.
  • Experience analyzing Azure Synapse pipelines and complex data-processing dependencies.
  • Experience implementing Git-based CI/CD for data-platform artifacts with GitHub Actions, Azure DevOps, or similar tools.
  • Hands-on experience using Claude Code for AI-assisted development and critically reviewing generated code.
  • Experience validating data migrations and integrating REST APIs, relational databases, and structured or semi-structured sources.
  • Must reside in an approved U.S. hiring state, be authorized to work in the U.S. without current or future sponsorship, and pass a background check.

Benefits

  • Remote work anywhere in the United States with flexible work hours.
  • Paid time off, company holidays, and floating holidays.
  • Comprehensive benefits with employer premium contributions.
  • 401(k) plan.
  • Sponsored and supported learning opportunities.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

BlueCloud

Senior Snowflake Data Engineer - Talent Pipeline

BlueCloud 201-500 Internet Software & Services

BlueCloud is hiring a Senior Snowflake Data Engineer to build, modernize, and optimize secure, scalable data platforms for enterprise clients migrating to AI-ready Snowflake environments.

Not Available Senior Data Engineer
Agile Apache Airflow AWS Azure CI/CD dbt GCP Git Kafka Python Snowflake SQL Terraform
3 hours, 25 minutes ago
BlueCloud

Data Engineer

BlueCloud 201-500 Internet Software & Services

Join BlueCloud to build lasting relationships and contribute to cloud transformation initiatives for enterprise clients.

Europe Mid Level Data Engineer
AWS Azure GCP Snowflake
3 hours, 25 minutes ago
BlueCloud

#5 Senior Data Engineer- Costa Rica, LATAM

BlueCloud 201-500 Internet Software & Services

BlueCloud is seeking a Senior Data Engineer to architect, build, and govern scalable Snowflake-based data solutions for enterprise transformation clients.

Costa Rica Senior Data Engineer
Apache Airflow AWS Azure dbt GCP Python Snowflake SQL
3 hours, 25 minutes ago
HITCONTRACT

Freelance Senior Data Engineer

HITCONTRACT 11-50 Professional Services

Senior Data Engineer for a banking project, designing and modernizing end-to-end data solutions across AWS and on-premises data environments for a cross-functional Agile team.

Estonia Latvia Lithuania Poland Freelance Senior Data Engineer
$70k-$116k
Agile Apache Airflow AWS Azure CI/CD Cybersecurity dbt GCP Python SQL
3 hours, 40 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers