CI&T

CI&T

CI&T is a global digital technology agency empowering agile growth for leading companies through advanced technologies with a team of 2000 experts worldwide.

Internet Software & Services
5K-10K
Founded 1995

Description

  • Design, build, and maintain ETL/ELT processes for a modern Data Lake architecture.
  • Develop and optimize distributed data processing workflows using Python and PySpark.
  • Implement partitioning strategies for data lake storage frameworks to balance performance and cost.
  • Write, optimize, and translate complex SQL queries for data transformation and modeling.
  • Migrate and modernize data pipelines from legacy RDBMS platforms to cloud-native analytics environments.
  • Contribute to reusable in-house libraries using object-oriented programming principles.
  • Work with AWS-native services such as Glue, Athena, Redshift, S3, Lambda, and EventBridge.
  • Collaborate with infrastructure and DevOps teams to provision and manage data resources using IaC tools.
  • Monitor pipeline health and performance using CloudWatch and other observability tools.
  • Partner with analysts, scientists, and business stakeholders to translate requirements into scalable technical solutions.

Requirements

  • Solid experience working with ETL processes and data pipeline development on AWS.
  • Strong proficiency in Python and demonstrated experience writing and optimizing PySpark code.
  • Thorough understanding of SQL, including CTEs, window functions, aggregations, and conditional expressions.
  • Hands-on experience with AWS Glue, Athena, and Redshift.
  • Solid understanding of Data Lake architectures and partitioning strategies.
  • Good understanding of object-oriented programming principles and reusable code libraries.
  • Comfortable working with Git, shell scripts, and Linux environments.
  • Familiarity with observability, monitoring, and metric tracking practices.
  • Advanced/fluent English.
  • Experience with Delta Lake or Apache Iceberg is preferred.
  • Knowledge of TypeScript is a plus.
  • Practical experience with Infrastructure as Code tools such as CloudFormation, CDK, or Terraform is preferred.
  • Familiarity with AWS services such as SageMaker AI, ECS, RDS, DynamoDB, IAM, or EventBridge is a plus.
  • Experience working with Pandas for data manipulation and analysis is a plus.
  • Exposure to machine learning workflows or AI-driven data initiatives is a plus.

Benefits

  • Premium healthcare.
  • Meal voucher.
  • Maternity and parental leave.
  • Mobile services subsidy.
  • Sick pay and life insurance.
  • CI&T University for learning and development.
  • Colombian holidays.
  • Paid vacations.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Engineer IV (6249)

Dan.com - a GoDaddy brand Internet Software & Services

itD is hiring a Data Engineer IV to build and optimize AWS-based data infrastructure and pipelines that support AI infrastructure and inference initiatives in a remote role.

AWS
14 hours, 5 minutes ago

Senior Data Engineer (GCP)

Xebia 1K-5K Internet Software & Services

Xebia is hiring a data engineer to support a BigQuery migration by building and maintaining scalable data pipelines for production reporting, analytics, and business intelligence solutions.

Apache Airflow CI/CD Databricks dbt Git Python Snowflake SQL
14 hours, 5 minutes ago

Staff Data Engineer (Coupang Pay)

Coupang 1K-5K Internet Software & Services

쿠팡페이 핀테크 데이터 플랫폼 팀의 Staff Data Engineer로서 실시간 결제·주문 데이터를 기반으로 데이터 파이프라인과 분석 인프라를 구축·고도화하는 역할입니다.

Apache Spark AWS ClickHouse Flink Hive Java Presto Python Scala SQL Tableau
14 hours, 20 minutes ago

Data Migration Engineer (SQL Server / TSQL)

Cresteo 51-200 information technology & services

Cresteo is hiring a Data Migration Engineer to own end-to-end SQL Server data migrations from legacy schemas into reconciled, production-ready data for US-based clients and international teams.

JSON SQL Server
14 hours, 20 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers