AWS Data Engineer

2 months, 1 week ago
Full-time
Lead
Software Development
qode

qode

qode is a company that focuses on unlocking global opportunities and unleashing potential through no-code solutions. They provide tools and services to help individuals and businesses develop software without the need for traditional coding skills.

Internet Software & Services

Description

  • Lead and support data platform modernization projects.
  • Design and develop scalable data pipelines using AWS native services.
  • Optimize ETL processes for efficient data transformation and processing.
  • Migrate workflows from on-premise systems to AWS cloud environments.
  • Design automations and integrations to resolve data inconsistencies and quality issues.
  • Perform system testing and validation to confirm successful integration and functionality.
  • Implement security and compliance controls in the cloud environment.
  • Validate data quality before and after migration, addressing completeness, consistency, and accuracy issues.
  • Collaborate with data architects and lead developers to document manual data movement workflows and define automation strategies.

Requirements

  • 10+ years of experience in a core data engineering skillset using AWS native technologies.
  • Experience with AWS Glue, Python, Snowflake, S3, and Redshift.
  • Proficiency with Snowflake for data transformations, ETL optimization, and scalable data processing.
  • Experience with streaming and batch data pipeline or engineering architectures.
  • Familiarity with DataOps concepts, source control, and CI/CD pipelines on AWS.
  • Hands-on experience with Databricks and willingness to expand capabilities.
  • Experience with data engineering and storage solutions such as AWS Glue, EMR, Lambda, Redshift, and S3.
  • Strong problem-solving and analytical skills.
  • Knowledge of Dataiku is required.
  • Graduate or post-graduate degree in Computer Science or a related field.
  • Experience with AWS Athena for querying data lakes.
  • Experience integrating with external systems such as FHIR.
  • Experience with secure data handling tools such as KMS and Macie.
  • Experience with cloud-native analytics, multi-account/multi-region data architecture, and BI tools such as Power BI, Tableau, or QuickSight.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Lead Data Platform Engineer

PR Newswire 1K-5K Internet Software & Services

INFOnline, part of saas.group, is seeking a Lead Data Platform Engineer to own and evolve its GCP-native data platform that powers digital audience measurement for the German and Austrian media industry.

CI/CD dbt Docker GCP Go Serverless SQL Terraform
13 hours, 36 minutes ago

OFSAA - Basel Technical Consultant

Unison Group Technology consulting

An experienced OFSAA Basel Technical Consultant is needed to design, develop, and support Basel regulatory reporting solutions for Oracle Financial Services Analytical Applications at a banking environment.

13 hours, 50 minutes ago

Data Engineer for AI Product

Qonto 1K-5K Banks

Qonto is hiring a Data Engineer for AI Product to build the data layer and production infrastructure that powers machine learning products for its finance workspace serving SMEs across Europe.

Apache Airflow Apache Spark CI/CD dbt Machine Learning Python
14 hours, 5 minutes ago

Senior Azure Data Consultant

Trility Consulting 51-250 Internet Software & Services

Trility Consulting is hiring a Senior Azure Data Consultant to work remotely with U.S. clients and lead data architecture and engineering efforts from initial discovery through production delivery.

Agile Azure CI/CD Databricks SQL
14 hours, 6 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers