RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

5 hours, 49 minutes ago
United States
Full-time
Senior
Data Engineer
Software Development
Apache Spark AWS Cassandra CI/CD CloudFormation Docker Kubernetes Python Serverless Terraform
Apply Now
Kunai

Kunai

Kunai is a leading digital product development consultancy for fintech, delivering innovative solutions trusted by Fortune 500 companies and startups worldwide.

Professional Services
51-250
Founded 2001
View All Jobs 4

Description

  • Design, build, and maintain scalable data pipelines using Python and AWS DynamoDB.
  • Implement ETL/ELT processes for batch and streaming workloads.
  • Develop and optimize DynamoDB data models, indexing strategies, and capacity planning.
  • Build cloud-native and serverless data storage solutions for cost-efficient scale.
  • Contribute to distributed data processing and analytics with Apache Spark where applicable.
  • Monitor and optimize pipeline performance, scalability, and latency.
  • Establish data validation, monitoring, and alerting to ensure data quality and reliability.
  • Collaborate with data scientists, analysts, backend engineers, and other stakeholders on data access, governance, compliance, and security.
  • Participate in architectural discussions and code reviews.
  • Mentor junior team members and promote knowledge sharing across the engineering organization.

Requirements

  • 5+ years of professional experience in data engineering or software engineering roles focused on data-centric solutions.
  • Expert-level Python programming skills for data processing and pipeline development.
  • Deep experience with AWS DynamoDB, including data modeling, performance tuning, and capacity planning.
  • Strong understanding of cloud computing fundamentals, with AWS preferred.
  • Experience building high-scale ETL/ELT pipelines for both batch and streaming data.
  • Familiarity with distributed data processing frameworks; Apache Spark experience is a significant plus but not required.
  • Experience with NoSQL databases such as DynamoDB, Cassandra, or similar.
  • Ability to design schema and optimize query patterns in key-value and document stores.
  • Strong verbal and written communication skills with the ability to explain technical concepts to non-technical stakeholders.
  • Bachelor’s degree required; in lieu of a degree, 3 years of specialized training and/or progressively responsible technology work experience for each missing year of college.
  • Unable to provide sponsorship for this role.
  • Hands-on experience with Apache Spark or other big data processing frameworks (preferred).
  • Familiarity with AWS services such as Lambda, Kinesis, Glue, or Redshift (preferred).
  • Prior experience in financial services or payments industry data platforms (preferred).
  • Exposure to Docker or Kubernetes (preferred).
  • Experience with CI/CD pipelines and infrastructure-as-code tools such as Terraform or CloudFormation (preferred).

Benefits

  • Competitive compensation.
  • Professional development opportunities.
  • Flexible work arrangements.
  • A collaborative, creative, and continuous-learning culture.
  • An environment where employees feel valued and have a voice.
  • Tools and support to grow personally and professionally.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Innodata

Data Platform Engineer (GCP)

Innodata 1K-5K IT Services

Innodata is hiring a hands-on GCP/Data Platform Engineer to support and improve large-scale production data platforms on Google Cloud, with a focus on reliability, troubleshooting, and operational enhancement.

Canada Mid Level Data Engineer
$64k-$120k
Apache Airflow CI/CD GCP Generative AI LLM Python SQL Terraform Vertex AI
5 hours, 34 minutes ago
ZoomInfo

Senior Software Engineer - Crawler

ZoomInfo 1K-5K Professional Services

ZoomInfo is hiring a Senior Software Engineer to help build its large-scale web crawling and data extraction infrastructure for the Web Data team.

United States Full-time Senior Data Engineer Software Engineer
$140k-$220k
Apache Airflow AWS GCP HTML Java Kafka Kubernetes LLM Python Snowflake Terraform Trino Vertex AI
5 hours, 49 minutes ago
Dragos

Staff Data Engineer - Integrations

Dragos 251-1K Professional Services

Dragos is hiring a remote-first Data Engineer to work on data pipeline and structure design for critical-infrastructure cybersecurity products.

United States Full-time Lead Data Engineer
$192k-$192k
Cybersecurity Docker Go Kubernetes Node.js Python SIEM Splunk
6 hours, 4 minutes ago
Feedzai

Senior Data Engineer - Product

Feedzai 251-1K Diversified Financial Services

Feedzai is hiring a Senior Data Engineer to design, build, and operate the core data platform that powers its AI-driven financial crime detection products.

Portugal Full-time Senior Data Engineer
Apache Airflow Apache Spark AWS CI/CD Java Jupyter Kafka Kubernetes Linux Machine Learning Microservices Python Snowflake Trino
6 hours, 4 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers