RemoteLeaf Logo
Log in Sign up

Lead Data Engineer

1 hour, 43 minutes ago
India
Full-time
Lead
Data Engineer
Software Development
JSON MongoDB MySQL Python Snowflake
Apply Now
3Pillar Global

3Pillar Global

3Pillar Global is an innovative product development company that builds breakthrough software products to power digital businesses. They offer a range of services including product strategy, management, user experience design, and software engineering ...

Internet Software & Services
1K-5K
Founded 2006
$26M raised
View All Jobs 66

Description

  • Understand business requirements and translate them into technical data solutions.
  • Write code and implement proposed data engineering solutions.
  • Create and manage versioned data pipelines, including change management.
  • Develop ETL and ELT processes to extract and transform data from multiple sources.
  • Design, build, and maintain batch and real-time data pipelines in production.
  • Automate data workflows for ingestion, aggregation, and ETL processing.
  • Add logging and instrumentation to pipelines and services.
  • Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
  • Flatten and normalize complex nested JSON data from MongoDB into relational tables.
  • Build reliable ETL pipelines to ingest data from MongoDB, process data in Snowflake, and load it into MySQL.
  • Design, index, and tune MySQL databases for performance and data integrity.
  • Train and mentor junior engineers.

Requirements

  • Proficiency with MongoDB, MySQL, and Snowflake SQL.
  • Experience building ETL/ELT pipelines and data workflows.
  • Ability to work with Snowflake's variant handling capabilities for semi-structured data.
  • Knowledge of versioned data pipelines and change management.
  • Experience flattening and normalizing nested JSON data into relational structures.
  • Python experience, including ETL frameworks such as Rivery or Informatica, is preferred.
  • Experience designing, indexing, and tuning relational databases is preferred.
  • Background in data engineering or related software development work.

Benefits

  • Flexible work environment with office, home, or hybrid options.
  • Remote-first approach from interviews through onboarding.
  • Global team collaboration with opportunities to work across cultures.
  • Fitness offerings and wellness-focused initiatives.
  • Mental health plans, depending on country.
  • Generous time off.
  • Career growth and development opportunities across projects, offerings, and industries.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Helsing

Head of SAP Finance & Data

Helsing 51-250 Aerospace & Defense

Helsing is hiring a Head of SAP Finance & Data to own and improve its SAP S/4HANA finance landscape, accelerate finance operations, and shape how data and automation support the company’s scaling finance function.

Germany Full-time Lead Controller Data Engineer
Python SAP SQL
30 minutes ago
Lyra Health

Sr. Data Engineer

Lyra Health 1K-5K Health Care Providers & Services

Lyra Health is seeking a Senior Data Engineer to build and scale the data infrastructure that powers analytics, research, and product decisions for its mental health care platform.

United States Full-time Senior Data Engineer
$128k-$176k
Apache Airflow dbt Python Snowflake SQL Tableau Terraform
33 minutes ago
ZoomInfo

Forward Deployed Data Engineer

ZoomInfo 1K-5K Professional Services

ZoomInfo is hiring a Forward Deployed Engineer to work directly with strategic enterprise customers and turn complex go-to-market data problems into repeatable, customer-specific intelligence applications.

United States Full-time Lead Data Engineer Solutions Engineer
$172k-$270k
CRM Databricks ERP GCP GraphQL HubSpot JWT Microservices OAuth Postman Python REST API Salesforce Snowflake SQL
1 hour, 13 minutes ago
Ellevation Education

Data Integration Engineer II

Ellevation Education 51-250 Diversified Consumer Services

Ellevation is hiring a remote Data Integration Engineer II to build and maintain data pipelines that transform and support K–12 district data for its educational products.

United States Full-time Mid Level Data Engineer
$70k-$100k
CSS Git HTML JSON Python SQL YAML
1 hour, 28 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers