RemoteLeaf Logo
Log in Sign up

Lead Data Engineer - R01568940

2 hours, 31 minutes ago
United States
Full-time
Lead
Data Engineer
Software Development
Apache Spark Azure Databricks Feature Engineering LLM SQL
Apply Now
Brillio

Brillio

Brillio is a global leader in Enterprise Digital Transformation Solutions, partnering with companies to drive business improvement and competitiveness through innovative technology solutions.

IT Services
1K-5K
Founded 2014
View All Jobs 10

Description

  • Build ETLs and data pipelines using Databricks, Azure Synapse Analytics, Azure Data Explorer, and Data Factory.
  • Develop scalable data models and state-of-the-art pipelines that support studio decision-making.
  • Work on large-scale lakehouse and warehouse analytics systems that process both real-time and batch data feeds.
  • Help shape how data is captured to improve test-driven methodologies and data-driven development.
  • Partner with business, design, test, and development teams to support their data needs.
  • Build and support a high-quality modern data architecture at scale.
  • Apply modern engineering practices and attention to detail in data engineering work.

Requirements

  • 5+ years of experience with SQL.
  • 5+ years of experience designing and implementing scalable ETL processes, including data movement and quality tools.
  • 3+ years of experience with modern big data analytics using Data Lake, Spark, and formats like Parquet.
  • 2+ years of experience building cloud-hosted data systems, with Azure highly preferred.
  • Experience building data pipelines in Azure Databricks, Fabric, or Spark (preferred).
  • Experience working with Delta Lake format and Azure Data Explorer/Kusto (preferred).
  • Experience applying AI/ML to data engineering use cases, including feature engineering, feature stores, and model monitoring pipelines (preferred).
  • Experience preparing and governing datasets for AI applications such as LLM/RAG, experimentation/A-B testing, and privacy-aware data access (preferred).
  • Experience with AKS, Event Hub, Azure DevOps, Cosmos DB, and Azure Functions (primary skills).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Bluelight Consulting

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is seeking a Data Engineer to design and maintain cloud-based data pipelines and Snowflake data solutions for client projects in a fast-growing software consultancy.

Paraguay Full-time Senior Data Engineer
Agile Apache Spark Azure CI/CD Git Machine Learning Power BI Python REST API Snowflake SQL Tableau Terraform
2 hours, 16 minutes ago
Bluelight Consulting

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is seeking a Data Engineer to design and support cloud-based data pipelines and Snowflake solutions for client projects in a fast-growing software consultancy.

Colombia Latin America Full-time Senior Data Engineer
Agile Apache Spark Azure CI/CD Git Power BI Python REST API Snowflake SQL Tableau Terraform
2 hours, 16 minutes ago
Bluelight Consulting

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is hiring a Data Engineer to build and optimize Snowflake-based cloud data pipelines and warehousing solutions for client projects in a fast-growing software consultancy.

Colombia Full-time Senior Data Engineer
Agile Apache Spark Azure CI/CD Git Power BI Python REST API Snowflake SQL Tableau Terraform
2 hours, 16 minutes ago
Bluelight Consulting

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is seeking a Data Engineer to design and maintain cloud-based data pipelines and Snowflake-driven analytics solutions for client projects in a fast-growing software consultancy.

Mexico Full-time Senior Data Engineer
Agile Apache Spark Azure CI/CD Git Machine Learning Power BI Python REST API Snowflake SQL Tableau Terraform
2 hours, 16 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers