AWS Data Engineer

3 weeks, 6 days ago
Full-time
Lead
Software Development
qode

qode

qode is a company that focuses on unlocking global opportunities and unleashing potential through no-code solutions. They provide tools and services to help individuals and businesses develop software without the need for traditional coding skills.

Internet Software & Services

Description

  • Lead and support data platform modernization projects.
  • Design and develop scalable data pipelines using AWS native services.
  • Optimize ETL processes for efficient data transformation and processing.
  • Migrate workflows from on-premise systems to AWS cloud environments.
  • Design automations and integrations to resolve data inconsistencies and quality issues.
  • Perform system testing and validation to confirm successful integration and functionality.
  • Implement security and compliance controls in the cloud environment.
  • Validate data quality before and after migration, addressing completeness, consistency, and accuracy issues.
  • Collaborate with data architects and lead developers to document manual data movement workflows and define automation strategies.

Requirements

  • 10+ years of experience in a core data engineering skillset using AWS native technologies.
  • Experience with AWS Glue, Python, Snowflake, S3, and Redshift.
  • Proficiency with Snowflake for data transformations, ETL optimization, and scalable data processing.
  • Experience with streaming and batch data pipeline or engineering architectures.
  • Familiarity with DataOps concepts, source control, and CI/CD pipelines on AWS.
  • Hands-on experience with Databricks and willingness to expand capabilities.
  • Experience with data engineering and storage solutions such as AWS Glue, EMR, Lambda, Redshift, and S3.
  • Strong problem-solving and analytical skills.
  • Knowledge of Dataiku is required.
  • Graduate or post-graduate degree in Computer Science or a related field.
  • Experience with AWS Athena for querying data lakes.
  • Experience integrating with external systems such as FHIR.
  • Experience with secure data handling tools such as KMS and Macie.
  • Experience with cloud-native analytics, multi-account/multi-region data architecture, and BI tools such as Power BI, Tableau, or QuickSight.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Engineer II

Samsara 1K-5K IT Services

Samsara is hiring a remote Data Engineer II to build and scale the Databricks-based data platforms that power its Revenue Operations AI and data infrastructure for GTM analytics and generative AI applications.

Apache Spark AWS Databricks dbt Generative AI Machine Learning Python Salesforce Snowflake SQL
53 minutes ago

Synthetic Data Engineer (AI Data/Training)

Hyphen Connect 1-10 staffing & recruiting

A Synthetic Data Engineer at the organization will design and manage domain-specific synthetic data pipelines that support data processing and model training workflows.

Apache Airflow Apache Spark
1 hour, 30 minutes ago

Senior Developer / Systems & ETL Engineer

Metova 51-250 Internet Software & Services

Senior Developer / Systems & ETL Engineer at an unnamed company, responsible for building end-to-end information processing systems that span ETL, APIs, cloud-native deployment, and client-facing technical delivery.

ActiveMQ AWS Azure C CI/CD Docker Hadoop Java Kubernetes Linux Microservices MySQL Oracle OWASP Perl PostgreSQL Python RabbitMQ REST API Snowflake Spring Boot SQL SQL Server Unix
1 hour, 54 minutes ago

INGENIERO DE DATOS

NEORIS 5K-10K Internet Software & Services

NEORIS busca un Data Engineer para diseñar, desarrollar y desplegar soluciones de datos en un entorno Big Data y Cloud, alineadas con la arquitectura de datos y orientadas a eficiencia y mantenibilidad.

Agile Apache Spark AWS Azure Cassandra Elasticsearch GCP Hadoop HDFS MongoDB Neo4j Oracle PostgreSQL Python SQL Server
2 hours, 19 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers