AWS Data Engineer

1 month, 2 weeks ago
Full-time
Lead
Software Development
qode

qode

qode is a company that focuses on unlocking global opportunities and unleashing potential through no-code solutions. They provide tools and services to help individuals and businesses develop software without the need for traditional coding skills.

Internet Software & Services

Description

  • Lead and support data platform modernization projects.
  • Design and develop scalable data pipelines using AWS native services.
  • Optimize ETL processes for efficient data transformation and processing.
  • Migrate workflows from on-premise systems to AWS cloud environments.
  • Design automations and integrations to resolve data inconsistencies and quality issues.
  • Perform system testing and validation to confirm successful integration and functionality.
  • Implement security and compliance controls in the cloud environment.
  • Validate data quality before and after migration, addressing completeness, consistency, and accuracy issues.
  • Collaborate with data architects and lead developers to document manual data movement workflows and define automation strategies.

Requirements

  • 10+ years of experience in a core data engineering skillset using AWS native technologies.
  • Experience with AWS Glue, Python, Snowflake, S3, and Redshift.
  • Proficiency with Snowflake for data transformations, ETL optimization, and scalable data processing.
  • Experience with streaming and batch data pipeline or engineering architectures.
  • Familiarity with DataOps concepts, source control, and CI/CD pipelines on AWS.
  • Hands-on experience with Databricks and willingness to expand capabilities.
  • Experience with data engineering and storage solutions such as AWS Glue, EMR, Lambda, Redshift, and S3.
  • Strong problem-solving and analytical skills.
  • Knowledge of Dataiku is required.
  • Graduate or post-graduate degree in Computer Science or a related field.
  • Experience with AWS Athena for querying data lakes.
  • Experience integrating with external systems such as FHIR.
  • Experience with secure data handling tools such as KMS and Macie.
  • Experience with cloud-native analytics, multi-account/multi-region data architecture, and BI tools such as Power BI, Tableau, or QuickSight.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Software Engineer - Data Integration & JVM Ecosystem

ClickHouse 51-250 IT Services

ClickHouse is hiring a Senior Software Engineer to own JVM-based data connectors and integrations that connect its high-performance analytics platform to the broader data ecosystem.

Apache Airflow Apache Spark ClickHouse dbt Grafana HTTP Java Kafka Metabase Pandas Power BI Python SQL Tableau TCP/IP
36 minutes ago

SAP BW Lead

Lingaro 5K-10K IT Services

SAP BW Lead for Poland’s CC Data Engineering & Management team at SAP, responsible for leading SAP BW-related data engineering work in a full-time remote role.

1 hour, 55 minutes ago

Python Data Engineer

Flatgigs Professional Services

FlatGigs is hiring a Python Data Engineer to build and maintain reliable, scalable data pipelines and ETL workflows that support analytics and data-driven decision-making.

Apache Airflow AWS Azure Docker GCP Kubernetes MongoDB NumPy Pandas PostgreSQL Python SQL
1 hour, 58 minutes ago

Lead Data / Rating Engineer

Alex Staff Agency 11-50 Professional Services

Rating Production Lead at a product company building scalable rating systems to improve creator monetization and information navigation, with the goal of turning existing algorithms and data methods into a production-ready system.

Machine Learning Python SQL Statistics
3 hours, 13 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers