RemoteLeaf Logo
Log in Sign up

[Job - 30760] Master Data Developer, Brazil

1 week, 2 days ago
Brazil
Full-time
Mid Level
Data Engineer
Software Development
Apache Spark AWS AWS CDK CloudFormation DynamoDB Git Linux Pandas Python SQL Terraform TypeScript
Apply Now
CI&T

CI&T

CI&T is a global digital technology agency empowering agile growth for leading companies through advanced technologies with a team of 2000 experts worldwide.

Internet Software & Services
5K-10K
Founded 1995
View All Jobs 82

Description

  • Design, build, and maintain ETL/ELT processes for a modern data lake architecture.
  • Develop and optimize distributed data processing workflows using Python and PySpark.
  • Implement partitioning strategies for data lake storage frameworks such as Delta Lake or Apache Iceberg.
  • Write and optimize complex SQL queries, including CTEs, window functions, conditional expressions, and aggregations.
  • Migrate and modernize data pipelines from legacy RDBMS platforms to cloud-native analytics environments.
  • Contribute to reusable in-house libraries using object-oriented programming principles.
  • Work with AWS-native services such as Glue, Athena, Redshift, S3, Lambda, and EventBridge.
  • Collaborate with infrastructure and DevOps teams to provision data resources using Infrastructure as Code tools.
  • Monitor pipeline health and performance using CloudWatch and other observability tools.
  • Partner with analysts, scientists, and business stakeholders to translate requirements into scalable technical solutions.

Requirements

  • Solid experience with ETL processes and data pipeline development on AWS.
  • Strong proficiency in Python and demonstrated experience with PySpark.
  • Thorough understanding of SQL, including complex queries and legacy RDBMS migration.
  • Hands-on experience with AWS Glue, Athena, and Redshift.
  • Solid understanding of data lake architectures and partitioning strategies.
  • Good understanding of object-oriented programming and reusable code libraries.
  • Comfortable working with Git, shell scripts, and Linux environments.
  • Familiarity with observability, monitoring, and metric tracking practices.
  • English proficiency at an advanced/fluent level.
  • Experience with Delta Lake or Apache Iceberg is preferred.
  • Knowledge of TypeScript is preferred.
  • Practical experience with IaC tools such as CloudFormation, CDK, or Terraform is preferred.
  • Familiarity with additional AWS services such as SageMaker AI, ECS, RDS, DynamoDB, IAM, or EventBridge is preferred.
  • Experience with Pandas for data manipulation and analysis is preferred.
  • Exposure to machine learning workflows or AI-driven data initiatives is preferred.

Benefits

  • Health and dental insurance.
  • Meal and food allowance.
  • Childcare assistance.
  • Extended paternity leave.
  • Gym and wellness partnerships via Wellhub (Gympass) and TotalPass.
  • Profit sharing and results participation (PLR).
  • Life insurance.
  • Continuous learning through CI&T University and other online learning partnerships.
  • Discount club.
  • Free online platform focused on physical, mental, and overall well-being.
  • Pregnancy and responsible parenting course.
  • Language learning platform.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Cortex

Senior Data Engineer

Cortex 11-50 Internet Software & Services

Cortex is hiring a Senior Data Engineer to own internal data systems and pipelines that power company-wide reporting, product analytics, and AI-driven operations from a fully remote US-based team.

United States Full-time Senior Data Engineer
$175k-$205k
ClickHouse dbt GCP OpenTelemetry Python Segment SQL
15 hours, 51 minutes ago
Standard Metrics

Data Solutions Engineer

Standard Metrics 11-50 Capital Markets

Standard Metrics is hiring a Data Solutions Engineer to own customer-facing data workflows, integrations, and AI-driven automation for a financial data platform serving investors and portfolio companies.

United States Mid Level Data Engineer Solutions Engineer
dbt LLM Python REST API Snowflake SQL
1 day, 16 hours ago
Oportun

Senior Data Engineer (R13923)

Oportun 1K-5K Banks

Oportun is hiring a Senior Data Engineer to design and deliver scalable data platforms and solutions that support business and analytical needs across cross-functional initiatives.

Mexico Full-time Senior Data Engineer
Agile Apache Airflow Apache Spark AWS Azure Databricks GCP Hadoop Java Jenkins Kafka Kanban MariaDB PostgreSQL Python Scala Scrum SQL
2 days, 16 hours ago
Xebia

AWS Senior DevOps Engineer

Xebia 1K-5K Internet Software & Services

Xebia is hiring a Senior DevOps Engineer to provision and operate a multi-region AWS environment for a US expansion while maintaining parity with the existing EU setup and supporting analytics and security operations.

Bulgaria Romania Senior Data Engineer DevOps Engineer
AWS CI/CD Penetration Testing PostgreSQL
2 days, 16 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers