RemoteLeaf Logo
Log in Sign up

FBS - Elasticsearch Data Engineer (Medallion Architecture)

4 months, 1 week ago
India
Full-time
Senior
Data Engineer
Software Development
Apache Airflow Apache Spark AWS dbt Elasticsearch ELK Stack Java Jenkins JSON Kibana Kubernetes Logstash Looker Python Spring Boot
Apply Now
Capgemini

Capgemini

Capgemini is a global leader in consulting, technology services, and digital transformation, empowering businesses with innovative solutions and expertise to thrive in a rapidly evolving market.

Internet Software & Services
100K+
Founded 1967
$93M raised
View All Jobs 35

Description

  • Design, build, and manage end-to-end data pipelines across the bronze, silver, and gold layers of the medallion architecture.
  • Ingest and process raw data using Spark and Amazon EMR for scalable distributed computation.
  • Develop and automate data transformations for the base vault using DBT.
  • Support business vault and gold-layer data modeling to produce curated datasets.
  • Work with orchestration tools such as Airflow or AWS Step Functions to run and manage data workflows.
  • Use Amazon S3 and Apache Iceberg to store and manage data assets.
  • Collaborate on data architecture practices that support governance, quality, and reusable data products.
  • Maintain and optimize Elasticsearch-related data engineering components, including indexing, query performance, and administration.

Requirements

  • At least 5 years of experience as an Elasticsearch Data Engineer with ELK stack expertise.
  • Strong experience with Elasticsearch cluster optimization, query development, data modeling, performance tuning, and administration (4–6 years).
  • Deep experience with Spark, Python, ETLs, and Amazon EMR.
  • Hands-on experience with DBT for data transformation and modeling.
  • Experience with Apache Airflow, AWS Step Functions, or similar orchestration tools.
  • Expert knowledge of Amazon S3 and Apache Iceberg for data storage and management.
  • Experience with Kubernetes for container orchestration.
  • Experience with Dremio, Looker, or equivalent semantic layer/business view technologies.
  • Intermediate AWS Cloud experience, including AWS Lambda, Step Functions, IAM, SNS, API Gateway, VPC, and Transit Gateway.
  • BS in Computer Science, Data Engineering, Data Modeling, or a similar field; Big Data or AWS certification is a plus.
  • Full English fluency.
  • Strong analytical, problem-solving, and communication skills.
  • Java Spring Boot and IBM ACE programming experience.

Benefits

  • Competitive salary with performance-based bonuses.
  • Comprehensive benefits package.
  • Private health insurance.
  • Pension plan.
  • Paid time off.
  • Career development, training, and development opportunities.
  • Flexible work arrangements, including remote and/or office-based options.
  • Dynamic and inclusive work culture within a globally recognized group.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

RevStar

Databricks Engineer

RevStar 51-250 Internet Software & Services

RevStar is seeking a remote, US-based Databricks Engineer to build and optimize cloud-agnostic Lakehouse data pipelines and MLOps frameworks for enterprise AI projects across AWS, Azure, and GCP.

United States Mexico Argentina Brazil Chile Colombia Venezuela Contract Mid Level Data Engineer
Agile Apache Airflow Apache Spark AWS Azure CI/CD Databricks Feature Engineering HIPAA Kafka MLflow MLOps Prefect Python SQL Terraform
6 hours, 56 minutes ago
phData

Senior Data Engineer

phData 251-1K IT Services

Data Engineer at phData, a remote-first global data and AI consultancy, designing and delivering secure, scalable cloud data solutions for enterprise clients.

India Full-time Mid Level Data Engineer
Apache Airflow Apache Spark AWS Azure Cassandra Databricks dbt Elasticsearch GCP Hadoop HDFS Kafka Luigi Python REST API Scala Snowflake Solr SQL System Design
1 day, 6 hours ago
Abacus Insights

Forward Deployed Data Engineer

Abacus Insights 51-250 Insurance

Abacus Insights is hiring a Forward Deployed Data Engineer to work alongside health plan clients, building governed data foundations, pipelines, and integrations that turn fragmented payer data into analytics-ready products.

United States Full-time Senior Data Engineer
Apache Spark Databricks Snowflake SQL
1 day, 6 hours ago
Azumo

Data Engineer

Azumo 51-250 Internet Software & Services

Azumo is hiring a fully remote Latin America-based Data Engineer to build and operate production ingestion, transformation, storage, warehouse, and retrieval infrastructure that supports client AI systems.

Mexico Argentina Brazil Chile Colombia Peru Full-time Senior Data Engineer
Apache Airflow Apache Spark AWS Azure CI/CD Dagster Databricks dbt Docker Flink GCP Git GitHub Actions HIPAA Jupyter Kafka Prefect Python Snowflake SQL Terraform
1 day, 6 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers