RemoteLeaf Logo
Log in Sign up

[Job - 29253] Senior Data Developer (AWS), Brazil

23 minutes ago
Brazil
Full-time
Senior
Data Engineer
Software Development
Apache Airflow Apache Spark AWS Databricks Pandas Python
Apply Now
CI&T

CI&T

CI&T is a global digital technology agency empowering agile growth for leading companies through advanced technologies with a team of 2000 experts worldwide.

Internet Software & Services
5K-10K
Founded 1995
View All Jobs 186

Description

  • Develop data transformation jobs using AWS Glue, Spark, or Python to turn raw data into curated datasets.
  • Structure and manage data in Amazon S3 data lakes and integrate it with vector databases or Redshift for analytics.
  • Process structured and unstructured data into optimized formats such as Parquet for efficient querying and analysis.
  • Configure and automate data workflows using AWS Step Functions or MWAA.
  • Collaborate with data scientists, engineers, and business stakeholders to gather data needs and deliver solutions.
  • Monitor data pipeline performance and improve reliability and efficiency.
  • Implement data governance practices and scalable architecture to support corporate data initiatives.
  • Support the integration of AI capabilities into data workflows.
  • Work hands-on with diverse files and datasets to transform them into processable data assets.

Requirements

  • Advanced English proficiency for communication with global teams and documentation.
  • Strong experience with the AWS ecosystem, especially Amazon S3 as a primary data source.
  • Proficiency with AWS Glue, Spark, or Python, including Pandas and Lambdas.
  • Experience with Databricks and Databricks Connector, including API integrations for data processing and structuring.
  • Experience handling structured and unstructured data.
  • Knowledge of vector databases such as Qdrant for AI applications.
  • Proven hands-on ability to transform diverse files into processable datasets.
  • Familiarity with AI frameworks and methodologies (nice to have).
  • Experience with data orchestration tools such as Apache Airflow (nice to have).
  • Knowledge of data governance and compliance standards, plus performance optimization techniques for data pipelines (nice to have).

Benefits

  • Health and dental insurance.
  • Meal and food allowance.
  • Childcare assistance.
  • Extended paternity leave.
  • Wellhub (Gympass) and TotalPass gym and wellness partnerships.
  • Profit sharing and results participation (PLR).
  • Life insurance.
  • Continuous learning through CI&T University, online learning partnerships, and a language learning platform.
  • Access to a free online platform focused on physical, mental, and overall well-being.
  • Pregnancy and responsible parenting course.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Bluefish

Senior Data Engineer

Bluefish 51-200 information technology & services

Bluefish is seeking a Senior Data Engineer to build and scale the AWS-based data platform that powers its AI-driven marketing product and supports rapid growth across new data sources and channels.

Germany Full-time Senior Data Engineer
AWS Python
8 minutes ago
Capital Rx

Underwriting Data Engineer

Capital Rx 251-1K Health Care Providers & Services

Judi Health is hiring an Underwriting Data Engineer to build and analyze data pipelines and analytical tools that improve underwriting, rebate administration, and sales operations.

United States Full-time Junior Data Engineer
$77k-$121k
Agile AWS Python R SQL
8 minutes ago
Zeta Global

Senior Data Engineer

Zeta Global 1K-5K Media

Zeta Global is seeking a Senior Data Engineer for its Data Cloud Acceleration Team to turn messy data into reliable, decision-ready assets that support new applications and measurable business outcomes.

India Senior Data Engineer
Apache Airflow Databricks dbt GCP Hive Prefect Python Snowflake SQL
23 minutes ago
Valtech

Lead Data Engineer (Platform)

Valtech 5K-10K Professional Services

Valtech is hiring a Lead Data Engineer (Platform) in Poland to build and support scalable data platform frameworks that improve how engineering teams deliver data solutions.

Poland Full-time Lead Data Engineer
Apache Spark AWS Azure CI/CD Databricks Docker Git GitHub Actions GitLab CI Kubernetes Microservices Python REST API Secrets Management Serverless SQL Terraform
38 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers