RemoteLeaf Logo
Log in Sign up

Lead Data Engineer (Contract, Full-Time) [HR208]

9 hours, 33 minutes ago
India
Contract
Lead
Data Engineer
Software Development
Apache Airflow Apache Spark AWS Azure Elasticsearch GCP Kafka Machine Learning MongoDB MySQL OpenSearch Pandas PostgreSQL Python SQL
Apply Now
Smart Working

Smart Working

Smart Working is a company that specializes in software development outsourcing and staff augmentation. They offer nearshore software development services, outsourcing solutions, and staff augmentation with a focus on providing highly skilled Indian de...

Internet Software & Services
View All Jobs 24

Description

  • Architect and build scalable data pipelines and infrastructure for AI and product systems.
  • Design and maintain data ingestion, transformation, and storage architectures.
  • Develop and manage batch and real-time data pipelines.
  • Build and optimize vector search, retrieval, and machine-learning data workflows.
  • Ensure data reliability, security, governance, and quality across the platform.
  • Collaborate with AI and backend engineers on training, inference, and product features.
  • Implement monitoring, observability, and data-quality frameworks.
  • Optimize large-scale datasets and query-system performance.
  • Define technical architecture, engineering standards, culture, and hiring practices as the founding data hire.
  • Partner with founders and product leadership to inform product decisions with data capabilities.

Requirements

  • 7+ years of professional experience, primarily in dedicated data engineering roles.
  • Strong experience designing data pipelines and distributed data systems.
  • Experience with relational databases, preferably PostgreSQL; MySQL or similar is acceptable.
  • Experience with NoSQL and vector databases.
  • Strong Python programming experience.
  • Experience building scalable backend systems and designing data models and storage architectures.
  • Ability to make and justify architectural decisions.
  • Strong understanding of data-processing performance and optimization.
  • Experience with Apache Spark, Apache Airflow, Kafka, Elasticsearch, or OpenSearch is highly desirable.
  • Experience with PostgreSQL, MongoDB, Qdrant, Milvus, pgvector, Pandas, or Polars is highly desirable.
  • Experience with AI or machine-learning platforms, stream processing, event-driven architectures, cloud infrastructure, or early-stage startups is preferred.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Coderio

Senior Data Engineer

Coderio 51-250 Internet Software & Services

Coderio is seeking a Senior Data Engineer to build and optimize scalable data platforms that process high-volume financial and transactional data for international clients.

Argentina Uruguay Brazil Contract Senior Data Engineer
Apache Airflow Apache Spark AWS CI/CD Databricks dbt Docker GCP Git GitHub Actions GitLab CI Java Kafka Microservices Python Scala Snowflake SQL Terraform
9 hours, 18 minutes ago
Bounteous

CDP Data Engineer

Bounteous 1K-5K Internet Software & Services

Bounteous is seeking a CDP Engineer to configure and operate Adobe Real-Time CDP and Adobe Experience Platform for a large telecommunications client, enabling reliable ingestion, identity resolution, profile creation, segmentation, and activation.

United States Contract Mid Level Data Engineer
AWS Azure GCP JavaScript Python Segment Snowflake SQL
9 hours, 18 minutes ago
PadSplit

Data Engineer (Fully Remote)

PadSplit 51-250 Family Services

PadSplit is seeking a hands-on Data Engineer to build, maintain, and support reliable analytics pipelines and data models across Dagster or Airflow, dbt, Snowflake, Python, Airbyte, and AWS.

United States Full-time Mid Level Data Engineer
$150k-$165k
Apache Airflow AWS Dagster dbt PostgreSQL Python REST API Snowflake Terraform
10 hours, 3 minutes ago
TTEC Digital

Director, Data Engineering (Google Cloud Platform)

TTEC Digital 1K-5K Professional Services

TTEC Digital is seeking a Director of Data Engineering (GCP) to lead its Google Cloud data engineering practice, delivering scalable data platforms, real-time analytics, AI infrastructure, and enterprise governance for client transformations.

United States Full-time Executive Cloud Engineer Data Engineer
$165k-$195k
Agile Apache Airflow Apache Spark CI/CD GCP Generative AI Machine Learning Python SQL Terraform Vertex AI
10 hours, 3 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers