RemoteLeaf Logo
Log in Sign up

Sênior Data Engineer - Governança

1 day, 10 hours ago
Brazil
Full-time
Senior
Data Architect
DevOps and Infrastructure
Apache Spark AWS Azure CloudFormation Databricks GCP Kafka Kubernetes Terraform
Apply Now
Harford County Public Library

Harford County Public Library

Access, Information, Service, Anytime, Anywhere

Diversified Consumer Services
51-250
Founded 1945
View All Jobs 15

Description

  • Propose the most suitable data pipeline architecture for defined business problems, such as lambda, kappa, ETL, or scraping approaches.
  • Use advanced cloud infrastructure knowledge to defend the best platform components for each solution, such as Kubernetes, VMs, or ECS.
  • Identify and propose performance optimizations across the data architecture, including Spark clusters, Kafka clusters, and databases.
  • Handle complex incidents, implement monitoring, and drive root-cause solutions for recurring issues.
  • Design and implement scalable and organized data storage environments as the foundation of the data platform.
  • Support the creation of data lakes and lakehouses with a focus on robustness and scalability.
  • Collaborate on infrastructure and architecture decisions that improve reliability, security, and maintainability.

Requirements

  • Solid experience designing and implementing Data Lakes and Lake Houses, including Delta Lake, Apache Iceberg, or Hudi.
  • Strong knowledge of data governance and quality tools for cataloging, lineage, and access control, such as Unity Catalog, Amundsen, or DataHub.
  • Proficiency with Infrastructure as Code using Terraform or CloudFormation.
  • Advanced cloud computing experience with AWS, Azure, or GCP, including services such as S3, Glue, Lake Formation, ADLS, Synapse, BigQuery, or Dataplex.
  • Knowledge of partitioning, file compression formats such as Parquet and Avro, and storage cost optimization.
  • Experience implementing Data Mesh is a plus.
  • Certifications in cloud architecture or data security are a plus.

Benefits

  • Health and dental insurance.
  • Digital health support through Vitta, with multidisciplinary care and 24/7 medical and mental health support.
  • Meal allowance and/or food allowance.
  • Remote work allowance plus initial setup support for remote roles.
  • Flexible working hours.
  • Education benefit with access to books, podcasts, training, and video courses through internal learning platforms.
  • Gympass fitness benefit.
  • Childcare assistance.
  • Profit sharing bonus (PLR).
  • Life insurance.
  • Transportation voucher for on-site roles.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Remofirst

Data Architect

Remofirst 11-50 Professional Services

RemoFirst is hiring a remote Data Architect to define and govern the company’s data architecture for a global HR platform serving international teams.

Poland Romania Ukraine Egypt South Africa Full-time Senior Data Architect
AWS Python SQL
13 minutes ago
CI&T

[Job - 29217] Data Architect (Azure), Brazil

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Data Architect (Azure) in Brazil to lead the design and evolution of its data platform, providing the technical foundation for data-driven business decisions across technology, product, and business teams.

Brazil Full-time Lead Data Architect
Azure CI/CD Databricks dbt Feature Engineering Git LLM Machine Learning MLOps Python Scala Snowflake SQL
19 hours, 12 minutes ago
NEORIS

Data Architect AWS

NEORIS 5K-10K Internet Software & Services

EPAM NEORIS is seeking a Cloud Infrastructure Architect – AWS (Data & Analytics) to design and define cloud components for analytics and data solutions in a transition toward cloud data architecture.

Colombia Full-time Senior Data Architect Infrastructure Engineer
AWS SageMaker Serverless
1 day ago
CI&T

[Job-29269] AWS - Data Architect, Colombia

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Data Architect in Colombia to design and govern AWS-based data and ML infrastructure for a public transportation demand forecasting system.

Colombia Full-time Senior Data Architect
AWS AWS CDK CI/CD Encryption Machine Learning Python TypeScript
1 day, 16 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers