AWS Data Engineer

3 months, 1 week ago
Full-time
Lead
Software Development
qode

qode

qode is a company that focuses on unlocking global opportunities and unleashing potential through no-code solutions. They provide tools and services to help individuals and businesses develop software without the need for traditional coding skills.

Internet Software & Services

Description

  • Lead and support delivery of data platform modernization projects.
  • Design, develop, and maintain scalable data pipelines using AWS native services.
  • Optimize ETL processes and data transformation workflows for performance and efficiency.
  • Migrate workflows from on-premises systems to AWS cloud while preserving data quality and consistency.
  • Design automations and integrations to resolve data inconsistencies and quality issues.
  • Perform system testing and validation to ensure successful integration and functionality.
  • Implement security and compliance controls in the cloud environment.
  • Validate data quality before and after migration, addressing completeness, consistency, and accuracy issues.
  • Collaborate with data architects and lead developers to document manual data movement workflows and define automation strategies.

Requirements

  • 10+ years of experience in data engineering using AWS native technologies such as AWS Glue, Python, Snowflake, S3, and Redshift.
  • Experience designing and developing robust, scalable data pipelines on AWS.
  • Proficiency with Snowflake for data transformations, ETL optimization, and scalable data processing.
  • Experience with both streaming and batch data pipeline architectures.
  • Familiarity with DataOps concepts, source control, and CI/CD pipeline setup on AWS.
  • Hands-on experience with Databricks and willingness to expand capabilities.
  • Experience with data engineering and storage solutions including AWS Glue, EMR, Lambda, Redshift, and S3.
  • Strong problem-solving and analytical skills.
  • Knowledge of Dataiku is required.
  • Graduate or post-graduate degree in Computer Science or a related field.
  • Experience with AWS S3 for data storage, export, and recall.
  • Experience with Athena for querying data lakes.
  • Experience integrating data pipelines with external systems such as FHIR.
  • Experience with secure data handling tools such as KMS and Macie.
  • Experience with cloud-native analytics, multi-account, multi-region data architecture, and BI tools such as Power BI, Tableau, and QuickSight.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Engineer IV (6249)

Dan.com - a GoDaddy brand Internet Software & Services

itD is hiring a Data Engineer IV to build and optimize AWS-based data infrastructure and pipelines that support AI infrastructure and inference initiatives in a remote role.

AWS
14 hours, 41 minutes ago

Senior Data Engineer (GCP)

Xebia 1K-5K Internet Software & Services

Xebia is hiring a data engineer to support a BigQuery migration by building and maintaining scalable data pipelines for production reporting, analytics, and business intelligence solutions.

Apache Airflow CI/CD Databricks dbt Git Python Snowflake SQL
14 hours, 41 minutes ago

Staff Data Engineer (Coupang Pay)

Coupang 1K-5K Internet Software & Services

쿠팡페이 핀테크 데이터 플랫폼 팀의 Staff Data Engineer로서 실시간 결제·주문 데이터를 기반으로 데이터 파이프라인과 분석 인프라를 구축·고도화하는 역할입니다.

Apache Spark AWS ClickHouse Flink Hive Java Presto Python Scala SQL Tableau
14 hours, 56 minutes ago

Data Migration Engineer (SQL Server / TSQL)

Cresteo 51-200 information technology & services

Cresteo is hiring a Data Migration Engineer to own end-to-end SQL Server data migrations from legacy schemas into reconciled, production-ready data for US-based clients and international teams.

JSON SQL Server
14 hours, 56 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers