RemoteLeaf Logo
Log in Sign up

Data Engineer II

4 weeks ago
India
Full-time
Senior
Data Engineer
Software Development
Apache Airflow Apache Spark CI/CD Java Kafka Kubernetes Python Scala Snowflake SQL
Apply Now
Zafin

Zafin

Zafin is a provider of relationship banking software solutions to the financial services industry. Their transformative solutions range from core modernization to innovative platforms in billing, analytics, and rates & fees to quote to cash, empowering...

Internet Software & Services
251-1K
Founded 2002
$47M raised
View All Jobs 3

Description

  • Design, build, and maintain scalable data pipelines for batch and real-time data processing.
  • Integrate data from diverse sources while ensuring reliability, scalability, and efficiency.
  • Design and implement optimized data models, warehouse schemas, and tables for analytics and reporting.
  • Manage and optimize data platforms and infrastructure such as Spark, Snowflake, Kafka, Airflow, and Kubernetes.
  • Ensure high availability, scalability, and fault tolerance of data systems.
  • Implement data validation frameworks, automated testing, monitoring systems, and alerting for data freshness, accuracy, and completeness.
  • Enforce data governance standards including access controls, data lineage, and compliance.
  • Ensure secure handling of sensitive data such as PII in line with regulatory requirements.
  • Optimize queries, partitioning strategies, file formats, and compute resources to improve performance and reduce costs.
  • Develop CI/CD pipelines, internal tools, reusable frameworks, and automation to improve engineering productivity.

Requirements

  • 5–8 years of experience in data engineering or a related field.
  • Strong programming skills in Python, Scala, or Java.
  • Advanced proficiency in SQL and data modeling concepts.
  • Hands-on experience with Apache Spark.
  • Hands-on experience with Snowflake or similar cloud data warehouses.
  • Hands-on experience with Kafka or other streaming platforms.
  • Hands-on experience with Airflow or similar orchestration tools.
  • Hands-on experience with Kubernetes.
  • Proven experience building both batch and real-time data pipelines.
  • Strong understanding of data quality, observability, and governance frameworks.

Benefits

  • Competitive salaries with annual bonus potential.
  • Generous paid time off.
  • Paid volunteering days.
  • Wellness benefits.
  • Robust opportunities for professional growth and career advancement.
  • Accommodation support for candidates with disabilities during the selection process.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

PR Newswire

Lead Data Platform Engineer

PR Newswire 1K-5K Internet Software & Services

INFOnline, part of saas.group, is seeking a Lead Data Platform Engineer to own and evolve its GCP-native data platform that powers digital audience measurement for the German and Austrian media industry.

Europe Full-time Lead Data Engineer
CI/CD dbt Docker GCP Go Serverless SQL Terraform
10 hours, 46 minutes ago
U

OFSAA - Basel Technical Consultant

Unison Group Technology consulting

An experienced OFSAA Basel Technical Consultant is needed to design, develop, and support Basel regulatory reporting solutions for Oracle Financial Services Analytical Applications at a banking environment.

India Full-time Senior Database Administrator Data Engineer
11 hours, 1 minute ago
Qonto

Data Engineer for AI Product

Qonto 1K-5K Banks

Qonto is hiring a Data Engineer for AI Product to build the data layer and production infrastructure that powers machine learning products for its finance workspace serving SMEs across Europe.

France Germany Spain Italy Full-time Senior Data Engineer
Apache Airflow Apache Spark CI/CD dbt Machine Learning Python
11 hours, 16 minutes ago
Trility Consulting

Senior Azure Data Consultant

Trility Consulting 51-250 Internet Software & Services

Trility Consulting is hiring a Senior Azure Data Consultant to work remotely with U.S. clients and lead data architecture and engineering efforts from initial discovery through production delivery.

United States Full-time Senior Data Engineer
Agile Azure CI/CD Databricks SQL
11 hours, 16 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers