RemoteLeaf Logo
Log in Sign up

Mid Level/Senior Data Developer (Python/AWS), Brasil

1 hour, 23 minutes ago
Brazil
Full-time
Senior
Data Engineer
Software Development
Apache Spark AWS Kafka Python
Apply Now
CI&T

CI&T

CI&T is a global digital technology agency empowering agile growth for leading companies through advanced technologies with a team of 2000 experts worldwide.

Internet Software & Services
5K-10K
Founded 1995
View All Jobs 181

Description

  • Develop and evolve data ingestion applications using AWS services such as Glue, Lambda, ECS, SNS, SQS, and Kafka.
  • Participate in technical inceptions and story refinements.
  • Write and maintain automated tests with a focus on the testing pyramid.
  • Perform code reviews and contribute to improving code quality.
  • Handle production incidents and deployment activities.
  • Work collaboratively with multidisciplinary teams and communicate technical decisions clearly.
  • Contribute to the development and evolution of scalable data pipelines and applications.

Requirements

  • Solid experience with Python.
  • Familiarity with AWS Glue, Lambda, S3, EC2, and Athena.
  • Knowledge of PySpark.
  • Experience with unit test automation and testing pyramid practices.
  • Experience working with relational databases.
  • Ability to refine technical stories and solution approaches.
  • Strong code quality awareness and knowledge of programming best practices.
  • Clear communication and alignment with the team.
  • Experience with LocalStack and infrastructure as code is a plus.
  • Advanced knowledge of serverless architecture is a plus.
  • Experience with observability practices is a plus.
  • Experience with Kafka, SQS, and SNS messaging is a plus.
  • Knowledge of Step Functions and pipeline orchestration concepts such as DAG is a plus.
  • Familiarity with Medallion architecture, Datamesh, and federated data governance is a plus.
  • Experience applying FinOps to data is a plus.
  • Experience with data quality tools such as Great Expectations, Deequ, or PyDeequ is a plus.

Benefits

  • Health and dental insurance.
  • Meal and food allowance.
  • Childcare assistance.
  • Extended parental leave.
  • Gym and wellness partnerships through Wellhub (Gympass) and TotalPass.
  • Profit sharing (PLR).
  • Life insurance.
  • Continuous learning platform (CI&T University).
  • Discount club and free online health, mental wellness, and well-being platform.
  • Language learning platform and partnerships with online course providers.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Dropbox

Data Engineer, Analytics Data Engineering

Dropbox 1K-5K Internet Software & Services

Dropbox is hiring a data platform engineer to build new, large-scale analytics pipelines and foundational data architecture for a greenfield, modern big data environment.

Canada Full-time Senior Data Engineer
$95k-$129k
Apache Airflow Apache Spark C++ Databricks Java Python Scala SQL
23 minutes ago
Coinbase

Senior Software Engineer - Data Platform

Coinbase 1K-5K Capital Markets

Coinbase is hiring a Data Platform engineer to build the systems that centralize internal and third-party data for analytics, machine learning, and product experiences.

United States Full-time Senior Data Engineer
$186k-$219k
Apache Airflow Apache Spark Blockchain Ethereum Generative AI Go Java Kafka Microservices Python SQL
23 minutes ago
SpaceX

Application Software Engineer, Data

SpaceX 10K-50K Aerospace & Defense

SpaceX is hiring an Application Software Engineer, Data to build mission-critical data analysis and application systems that support launch operations, factory production, and Starlink network growth.

United States Full-time Junior Data Engineer Software Engineer
$125k-$175k
Angular C# CI/CD Git Grafana JavaScript Machine Learning Metabase OpenCV Pandas PostgreSQL Power BI Python PyTorch React SciPy Statistics
38 minutes ago
U

OFSAA ERM Technical Consultant (Basel / LRM)

Unison Group Technology consulting

OFSAA ERM Technical Consultant role at a banking and financial services organization focused on technical development, data integration, and customization of Basel and Liquidity Risk Management solutions within OFSAA to support regulatory and risk management needs.

India Senior Database Administrator Data Engineer
Agile FTP Shell Scripting Unix
1 hour, 8 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers