RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

3 weeks, 2 days ago
Poland
Lead
Data Engineer
Software Development
Agile Apache Airflow Apache Spark AWS Cassandra CI/CD Elasticsearch GCP Hadoop Hive Java MySQL PostgreSQL Python Scala SQL Teradata
Apply Now
Exadel

Exadel

Exadel is an enterprise software development and consulting company that provides custom software solutions and digital transformation services to Fortune 500 clients worldwide.

Internet Software & Services
1K-5K
Founded 1998
View All Jobs 24

Description

  • Design and develop high-volume batch and streaming data ingestion pipelines across AWS and GCP data platforms.
  • Conceive, code, and launch next-generation data ingestion and curation platforms.
  • Participate in requirements gathering and system and data architecture discussions.
  • Technically lead and mentor junior engineers on software development and data engineering best practices.
  • Collaborate with cross-functional agile teams, including software engineers, data engineers, ML experts, and data analysts, to build new product features.
  • Investigate and resolve ETL, data lineage, data leakage, data quality, and backfill issues.
  • Design, implement, and support production services with tight SLAs.
  • Develop distributed applications with central logging, metrics, monitoring, and alerting.
  • Drive independent resolution, communication, and follow-ups on production and data issues.

Requirements

  • BS/MS in Computer Science or a related field.
  • 10+ years of experience in distributed systems, data engineering, software engineering, or similar fields.
  • Strong coding skills in Python, Java, and/or Scala.
  • Experience with SQL and NoSQL databases such as BigQuery, Teradata, MySQL, Postgres, and Cassandra.
  • Experience with big data technologies such as Hadoop, Hive, and Apache Spark.
  • Experience with Airflow or another orchestration tool.
  • Experience building batch and streaming data pipelines.
  • Experience with both software development and data engineering.
  • Experience with GCP or AWS cloud technologies, especially for data processing at scale.
  • Experience designing, implementing, and supporting production services with tight SLAs.
  • Experience developing distributed applications with logging, metrics, monitoring, and alerting tools such as Elasticsearch and Wavefront.
  • Strong understanding of testing methodologies, CI/CD, and industry best practices.
  • Excellent written and oral communication skills.
  • Upper-Intermediate English level.
  • Preferred: Strong coding skills in Python.
  • Preferred: Experience with Google Data Streams and Google Dataproc.
  • Preferred: Experience with change data capture (CDC) technologies.
  • Preferred: Experience with modern data warehouse technology such as Delta Lake.

Benefits

  • International projects.
  • Flexible work options, including in-office, hybrid, or remote arrangements.
  • Medical healthcare coverage.
  • Recognition program.
  • Ongoing learning and reimbursement support.
  • Well-being program.
  • Team events and local benefits.
  • Sports compensation.
  • Referral bonuses.
  • Top-tier equipment provision.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

D

Cyber Data Engineer

D2 Technical Services 11-50 IT services and consulting

D2 Technical Services is hiring a systems engineer to support national security cybersecurity operations by managing infrastructure, data pipelines, and SIEM environments.

United States Full-time Senior Data Engineer Security Engineer
$140k-$145k
AWS Bash Cybersecurity DHCP DNS Elasticsearch GCP Linux PowerShell Python SIEM Splunk
17 hours, 47 minutes ago
Voyager

Senior DataOps Engineer

Voyager Life Sciences Tools & Services

Voyager Technologies is hiring a remote US-based DataOps Engineer to own cloud-to-data platform migration and operations for mission-critical analytics in a regulated national security environment.

United States Full-time Senior Data Engineer
$150k-$180k
Ansible Apache Airflow Apache Spark AWS Azure Cassandra CloudFormation dbt Docker Git GitHub GitHub Actions GitLab GitLab CI Kafka Kubernetes MongoDB Pandas PostgreSQL PowerShell Python Redis Scala SQLAlchemy SQL Server Terraform
18 hours, 17 minutes ago
Dragos

Data Engineering Manager

Dragos 251-1K Professional Services

Dragos is seeking a Data Engineering Manager to lead the team building the core data layer that supports its cybersecurity products and threat-focused engineering work.

United States Full-time Lead Data Engineer Engineering Manager
$220k-$220k
Agile Apache Airflow ClickHouse Cybersecurity dbt Docker Kubernetes PostgreSQL Rust SOC
18 hours, 17 minutes ago
Movement Labs

Senior Data Engineers

Movement Labs 11-50 Media

Movement Labs is hiring Senior and Mid-level Data Engineers to support its progressive political data platform, with a focus on building and operating systems for voter outreach, experimentation, and election readiness.

United States Contract Senior Data Engineer
$90k-$119k
Apache Airflow Dagster dbt GCP Python SQL
18 hours, 32 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers