AWS Data Engineer

1 month, 1 week ago
Full-time
Lead
Software Development
qode

qode

qode is a company that focuses on unlocking global opportunities and unleashing potential through no-code solutions. They provide tools and services to help individuals and businesses develop software without the need for traditional coding skills.

Internet Software & Services

Description

  • Lead and support delivery of data platform modernization projects.
  • Design, develop, and maintain scalable data pipelines using AWS native services.
  • Optimize ETL processes and data transformation workflows for performance and efficiency.
  • Migrate workflows from on-premises systems to AWS cloud while preserving data quality and consistency.
  • Design automations and integrations to resolve data inconsistencies and quality issues.
  • Perform system testing and validation to ensure successful integration and functionality.
  • Implement security and compliance controls in the cloud environment.
  • Validate data quality before and after migration, addressing completeness, consistency, and accuracy issues.
  • Collaborate with data architects and lead developers to document manual data movement workflows and define automation strategies.

Requirements

  • 10+ years of experience in data engineering using AWS native technologies such as AWS Glue, Python, Snowflake, S3, and Redshift.
  • Experience designing and developing robust, scalable data pipelines on AWS.
  • Proficiency with Snowflake for data transformations, ETL optimization, and scalable data processing.
  • Experience with both streaming and batch data pipeline architectures.
  • Familiarity with DataOps concepts, source control, and CI/CD pipeline setup on AWS.
  • Hands-on experience with Databricks and willingness to expand capabilities.
  • Experience with data engineering and storage solutions including AWS Glue, EMR, Lambda, Redshift, and S3.
  • Strong problem-solving and analytical skills.
  • Knowledge of Dataiku is required.
  • Graduate or post-graduate degree in Computer Science or a related field.
  • Experience with AWS S3 for data storage, export, and recall.
  • Experience with Athena for querying data lakes.
  • Experience integrating data pipelines with external systems such as FHIR.
  • Experience with secure data handling tools such as KMS and Macie.
  • Experience with cloud-native analytics, multi-account, multi-region data architecture, and BI tools such as Power BI, Tableau, and QuickSight.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Software Engineer - Data Integration & JVM Ecosystem

ClickHouse 51-250 IT Services

ClickHouse is hiring a Senior Software Engineer to own JVM-based data connectors and integrations that connect its high-performance analytics platform to the broader data ecosystem.

Apache Airflow Apache Spark ClickHouse dbt Grafana HTTP Java Kafka Metabase Pandas Power BI Python SQL Tableau TCP/IP
36 minutes ago

SAP BW Lead

Lingaro 5K-10K IT Services

SAP BW Lead for Poland’s CC Data Engineering & Management team at SAP, responsible for leading SAP BW-related data engineering work in a full-time remote role.

1 hour, 55 minutes ago

Python Data Engineer

Flatgigs Professional Services

FlatGigs is hiring a Python Data Engineer to build and maintain reliable, scalable data pipelines and ETL workflows that support analytics and data-driven decision-making.

Apache Airflow AWS Azure Docker GCP Kubernetes MongoDB NumPy Pandas PostgreSQL Python SQL
1 hour, 59 minutes ago

Lead Data / Rating Engineer

Alex Staff Agency 11-50 Professional Services

Rating Production Lead at a product company building scalable rating systems to improve creator monetization and information navigation, with the goal of turning existing algorithms and data methods into a production-ready system.

Machine Learning Python SQL Statistics
3 hours, 14 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers