RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

1 hour, 31 minutes ago
India
Full-time
Mid Level
Data Engineer
Software Development
Apache Airflow Apache Spark AWS Azure Cassandra Databricks dbt Elasticsearch GCP Hadoop HDFS Java Kafka Luigi Python Scala Snowflake Solr SQL
Apply Now
phData

phData

phData specializes in providing comprehensive data engineering, data strategy, and machine learning services, offering end-to-end managed data solutions that facilitate data migrations, integrations, and the development of modern data products and appl...

IT Services
251-1K
View All Jobs 42

Description

  • Develop end-to-end technical solutions and help move them into production.
  • Ensure solutions meet performance, security, scalability, and data integration standards.
  • Write, debug, and optimize SQL queries.
  • Create detailed presentations for clients and stakeholders.
  • Produce solution documentation, including proofs of concept, roadmaps, sequence diagrams, class hierarchies, and logical system views.
  • Collaborate in client-facing engagements with clear written and verbal communication.
  • Work across multiple cloud data platforms and data integration environments.
  • Support the full software development lifecycle, including design, documentation, implementation, testing, and deployment.

Requirements

  • At least 4+ years of experience as a Software Engineer, Data Engineer, or Data Analyst.
  • Programming expertise in Java, Python, and/or Scala.
  • Experience with core cloud data platforms such as Snowflake, AWS, Azure, Databricks, and GCP.
  • Strong SQL skills with the ability to write, debug, and optimize queries.
  • Client-facing written and verbal communication experience.
  • Experience creating detailed presentations.
  • Ability to produce detailed solution documentation.
  • Bachelor's degree in Computer Science or a related field.
  • Preferred experience in production environments with core data platforms including Snowflake, AWS, Azure, GCP, Hadoop, and Databricks.
  • Preferred experience with cloud and distributed data storage such as S3, ADLS, HDFS, GCS, Kudu, ElasticSearch/Solr, Cassandra, or other NoSQL systems.
  • Preferred experience with data integration technologies such as Spark, Kafka, Streamsets, Matillion, Fivetran, NiFi, AWS Data Migration Services, Azure DataFactory, Informatica Intelligent Cloud Services, or Google DataProc.
  • Preferred experience working with multiple data sources, including queues, relational databases, files, search, and APIs.
  • Preferred full software development lifecycle experience, including design, documentation, implementation, testing, and deployment.
  • Preferred experience with automated data transformation and curation tools such as dbt, Spark, Spark streaming, and automated pipelines.
  • Preferred experience with workflow management and orchestration tools such as Airflow, AWS Managed Airflow, Luigi, and NiFi.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

NEORIS

Arquitecto de datos

NEORIS 5K-10K Internet Software & Services

NEORIS busca un Arquitecto de Datos para una compañía líder del sector seguros/financiero, responsable de conectar las necesidades del negocio con soluciones de arquitectura de datos escalables y habilitar capacidades avanzadas de analítica e Inteligencia Artificial.

Colombia Full-time Mid Level Data Architect Data Engineer
Agile Databricks Generative AI LLM
1 minute ago
NEORIS

Data Engineer Midel

NEORIS 5K-10K Internet Software & Services

EPAM NEORIS is hiring a Mid Data Engineer to build and support production data systems and knowledge-graph-based solutions for clients in a fast-paced, cross-functional environment.

Colombia Full-time Mid Level Data Engineer
AWS Azure GCP Generative AI LLM Neo4j Python SQL
16 minutes ago
Sumo Logic

Software Engineer II - Core Ingest

Sumo Logic 251-1K Internet Software & Services

Sumo Logic is hiring a Software Engineer II for its Core Ingest team to build and evolve large-scale distributed data processing systems that ingest and analyze massive volumes of customer data.

United States Full-time Junior Backend Engineer Data Engineer
$116k-$136k
Agile Docker Java Kafka Kubernetes Linux Microservices Scala Unix
16 minutes ago
Fundraise Up

Senior Data Engineer

Fundraise Up 51-250 Capital Markets

Fundraise Up is hiring a Senior Data Engineer to own and evolve the data platform behind its global nonprofit fundraising product, with a focus on scalable pipelines, analytics infrastructure, and data quality.

Cyprus Europe Full-time Senior Data Engineer
$6k-$7k
Apache Airflow AWS ClickHouse Docker Elasticsearch Git Kafka Koa MLflow MongoDB NestJS Node.js Python React Redis TypeScript Vue.js
48 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers