AWS Data Engineer

1 hour, 54 minutes ago
Full-time
Lead
Software Development
qode

qode

qode is a company that focuses on unlocking global opportunities and unleashing potential through no-code solutions. They provide tools and services to help individuals and businesses develop software without the need for traditional coding skills.

Internet Software & Services

Description

  • Lead and support delivery of data platform modernization projects.
  • Design, develop, and maintain scalable data pipelines using AWS native services.
  • Optimize ETL processes and data transformation workflows for performance and efficiency.
  • Migrate workflows from on-premises systems to AWS cloud while preserving data quality and consistency.
  • Design automations and integrations to resolve data inconsistencies and quality issues.
  • Perform system testing and validation to ensure successful integration and functionality.
  • Implement security and compliance controls in the cloud environment.
  • Validate data quality before and after migration, addressing completeness, consistency, and accuracy issues.
  • Collaborate with data architects and lead developers to document manual data movement workflows and define automation strategies.

Requirements

  • 10+ years of experience in data engineering using AWS native technologies such as AWS Glue, Python, Snowflake, S3, and Redshift.
  • Experience designing and developing robust, scalable data pipelines on AWS.
  • Proficiency with Snowflake for data transformations, ETL optimization, and scalable data processing.
  • Experience with both streaming and batch data pipeline architectures.
  • Familiarity with DataOps concepts, source control, and CI/CD pipeline setup on AWS.
  • Hands-on experience with Databricks and willingness to expand capabilities.
  • Experience with data engineering and storage solutions including AWS Glue, EMR, Lambda, Redshift, and S3.
  • Strong problem-solving and analytical skills.
  • Knowledge of Dataiku is required.
  • Graduate or post-graduate degree in Computer Science or a related field.
  • Experience with AWS S3 for data storage, export, and recall.
  • Experience with Athena for querying data lakes.
  • Experience integrating data pipelines with external systems such as FHIR.
  • Experience with secure data handling tools such as KMS and Macie.
  • Experience with cloud-native analytics, multi-account, multi-region data architecture, and BI tools such as Power BI, Tableau, and QuickSight.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Rust Engineer - Data Interoperability (Remote EU)

Retinai 11-50 Internet Software & Services

Ikerian AG is hiring a Rust Engineer to develop robust data interoperability systems that support healthcare screening and monitoring through high-performance AI and data management solutions.

Computer Vision DNS Git GraphQL Python REST API Rust TCP/IP TLS
9 minutes ago

AWS Data Engineer (Senior)

Mactores 51-250 IT Services

Mactores is hiring a Senior AWS Data Engineer in Seattle/remote to build and support modern data platforms and pipelines that enable automated, secure data solutions for customer digital transformation initiatives.

Agile Apache Airflow Apache Spark AWS Presto Snowflake SQL
9 minutes ago

Data Engineer

MUTT DATA 51-250 Internet Software & Services

Mutt Data is hiring a remote Data Engineer in Argentina to build and improve cloud-based data systems and machine learning solutions for clients across forecasting, e-commerce, and automation use cases.

Apache Airflow Apache Spark AWS Azure CI/CD Databricks dbt Docker GCP Jupyter NumPy Pandas Prefect Python SQL
9 minutes ago

Senior Developer - Vulcan

SynMax 11-50 Diversified Telecommunication Services

SynMax is hiring a Senior Developer for its remote Houston engineering team to build the core software behind AI-powered analytics platforms for the maritime and energy sectors.

Apache Airflow Apache Spark AWS Azure CI/CD Dagster GCP GitHub Actions Microservices MLOps Python REST API SQL
9 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers