RemoteLeaf Logo
Log in Sign up

Data Engineer II

1 month, 2 weeks ago
India
Full-time
Senior
Data Engineer
Software Development
Apache Airflow Apache Spark CI/CD Java Kafka Kubernetes Python Scala Snowflake SQL
Apply Now
Zafin

Zafin

Zafin is a provider of relationship banking software solutions to the financial services industry. Their transformative solutions range from core modernization to innovative platforms in billing, analytics, and rates & fees to quote to cash, empowering...

Internet Software & Services
251-1K
Founded 2002
$47M raised
View All Jobs 5

Description

  • Design, build, and maintain scalable data pipelines for batch and real-time data processing.
  • Integrate data from diverse sources while ensuring reliability, scalability, and efficiency.
  • Design and implement optimized data models, warehouse schemas, and tables for analytics and reporting.
  • Manage and optimize data platforms and infrastructure such as Spark, Snowflake, Kafka, Airflow, and Kubernetes.
  • Ensure high availability, scalability, and fault tolerance of data systems.
  • Implement data validation frameworks, automated testing, monitoring systems, and alerting for data freshness, accuracy, and completeness.
  • Enforce data governance standards including access controls, data lineage, and compliance.
  • Ensure secure handling of sensitive data such as PII in line with regulatory requirements.
  • Optimize queries, partitioning strategies, file formats, and compute resources to improve performance and reduce costs.
  • Develop CI/CD pipelines, internal tools, reusable frameworks, and automation to improve engineering productivity.

Requirements

  • 5–8 years of experience in data engineering or a related field.
  • Strong programming skills in Python, Scala, or Java.
  • Advanced proficiency in SQL and data modeling concepts.
  • Hands-on experience with Apache Spark.
  • Hands-on experience with Snowflake or similar cloud data warehouses.
  • Hands-on experience with Kafka or other streaming platforms.
  • Hands-on experience with Airflow or similar orchestration tools.
  • Hands-on experience with Kubernetes.
  • Proven experience building both batch and real-time data pipelines.
  • Strong understanding of data quality, observability, and governance frameworks.

Benefits

  • Competitive salaries with annual bonus potential.
  • Generous paid time off.
  • Paid volunteering days.
  • Wellness benefits.
  • Robust opportunities for professional growth and career advancement.
  • Accommodation support for candidates with disabilities during the selection process.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Career TEAM

Data Conversion Software Engineer

Career TEAM 251-1K Professional Services

Career Team is hiring a Data Conversion Software Engineer to build data transformation and integration software for government-funded workforce development programs across the United States.

United States Full-time Mid Level Data Engineer Software Engineer
$60k-$100k
Agile Angular CI/CD Docker Express.js JavaScript JSON MongoDB NestJS Next.js Node.js React Scrum TypeScript XML
13 hours ago
TWO95 International

Sr. Associate Data Platform - Remote

TWO95 International 51-250 Internet Software & Services

Sr. Associate Data Platform is a contract role with a Los Angeles-based team supporting Adobe analytics and data platform implementation work across on-site and remote locations.

United States Contract Senior Data Engineer
CSS Digital Marketing HTML JavaScript jQuery Vue.js
13 hours, 15 minutes ago
Mindrift.ai: Be the “I” in AI

Freelance Data Scraping Engineer (Python)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a part-time remote Python Data Scraping Engineer for the Tendem project to deliver accurate, structured data extraction and processing within a hybrid AI-plus-human workflow.

Kuwait Qatar Saudi Arabia Turkey Israel Jordan Part-time Junior Backend Engineer Data Engineer
Up to $37k
AJAX GitHub JavaScript JSON LLM Python Selenium
13 hours, 15 minutes ago
Mindrift.ai: Be the “I” in AI

Freelance Data Scraping Engineer (Python)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a part-time freelance Python Data Scraping Engineer for the Tendem project to build and oversee data extraction workflows in a hybrid AI + human environment.

United States Part-time Mid Level Backend Engineer Data Engineer
AJAX GitHub JavaScript JSON LLM Python Selenium
13 hours, 15 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers