Lead Data Engineer (Azure)

6 days, 12 hours ago
Full-time
Lead
Software Development
3Pillar Global

3Pillar Global

3Pillar Global is an innovative product development company that builds breakthrough software products to power digital businesses. They offer a range of services including product strategy, management, user experience design, and software engineering ...

Internet Software & Services
1K-5K
Founded 2006
$26M raised

Description

  • Understand client requirements and lead the creation of robust data platforms using data lakehouse architectures.
  • Design and implement scalable data models, ETL/ELT pipelines, and analytics layers in cloud environments.
  • Architect Microsoft Fabric reporting solutions, including medallion layering, capacity planning, freshness governance, and CDC/mirroring from Azure SQL.
  • Enforce data-layer segregation, multi-tenant isolation, and compliance with long-term regulated data retention policies.
  • Lead migration efforts from legacy systems such as Airtable and Smartsheet to Microsoft Fabric.
  • Own analytics projects end to end, from requirements gathering through deployment.
  • Mentor junior team members, perform code reviews, and uphold quality standards.
  • Collaborate with engineering, product, and business stakeholders to align data strategy with business goals.
  • Develop and optimize SQL queries, Power BI semantic models, dashboards, and reports.
  • Troubleshoot performance bottlenecks, data inconsistencies, and integration issues.
  • Drive innovation in reporting and analytics by recommending and implementing new tools, frameworks, and practices.
  • Define best practices, coding standards, and governance for analytics projects.
  • Build and oversee AI-ready data pipelines for embeddings, vector stores, feature stores, and GenAI-enabled products.
  • Promote AI-assisted data engineering practices, including copilots, automated testing, and documentation.

Requirements

  • 7–10 years of relevant experience in data engineering and business intelligence.
  • At least 2 years of hands-on experience with Azure SQL, Microsoft Fabric, and Power BI.
  • Advanced SQL skills and understanding of data lakehouse, medallion architecture, star/snowflake schemas, and dimensional modeling.
  • Proficiency in Python for data engineering, ETL/ELT workflows, and automation.
  • Experience designing and maintaining enterprise-grade data pipelines in Azure environments.
  • Proven track record of leading analytics projects and delivering scalable data solutions.
  • Ability to operate as a player-coach, leading while contributing hands-on.
  • Strong understanding of data governance, security, PII handling, multi-tenant architectures, and performance optimization.
  • Strong communication skills and ability to explain complex technical concepts to business stakeholders.
  • Experience with DBT is preferred.
  • Experience with other BI tools is preferred.
  • Experience with GenAI tools or technologies is preferred.

Benefits

  • Medical insurance benefits as per company policy.
  • Life insurance as per company policy.
  • 15 days of paid vacation, sick leave, and paid holidays as per local law.
  • Paternity and maternity leave as per local law.
  • Marriage, bereavement, and graduation leave as per company policy.
  • Christmas and mid-year bonuses as per local law.
  • Monthly productivity bonus as per local law.
  • Discounts at local shops.
  • Direct payroll deposit.
  • Paid professional certifications.
  • Flexible, remote-first work environment.
  • Fitness offerings and mental health plans, depending on country.
  • Generous time off and wellbeing-focused support.
  • Career growth and development opportunities across projects, offerings, and industries.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Conversion Software Engineer

Career TEAM 251-1K Professional Services

Career Team is hiring a Data Conversion Software Engineer to build data transformation and integration software for government-funded workforce development programs across the United States.

Agile Angular CI/CD Docker Express.js JavaScript JSON MongoDB NestJS Next.js Node.js React Scrum TypeScript XML
11 hours, 42 minutes ago

Sr. Associate Data Platform - Remote

TWO95 International 51-250 Internet Software & Services

Sr. Associate Data Platform is a contract role with a Los Angeles-based team supporting Adobe analytics and data platform implementation work across on-site and remote locations.

CSS Digital Marketing HTML JavaScript jQuery Vue.js
11 hours, 57 minutes ago

Freelance Data Scraping Engineer (Python)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a part-time remote Python Data Scraping Engineer for the Tendem project to deliver accurate, structured data extraction and processing within a hybrid AI-plus-human workflow.

AJAX GitHub JavaScript JSON LLM Python Selenium
11 hours, 57 minutes ago

Freelance Data Scraping Engineer (Python)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a part-time freelance Python Data Scraping Engineer for the Tendem project to build and oversee data extraction workflows in a hybrid AI + human environment.

AJAX GitHub JavaScript JSON LLM Python Selenium
11 hours, 57 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers