[Job - 29221] Senior Data Developer (Azure), Brazil

4 hours, 26 minutes ago
Full-time
Senior
Software Development
CI&T

CI&T

CI&T is a global digital technology agency empowering agile growth for leading companies through advanced technologies with a team of 2000 experts worldwide.

Internet Software & Services
5K-10K
Founded 1995

Description

  • Implement ELT/ETL pipelines for data ingestion, transformation, and delivery following defined architectural standards.
  • Build and maintain integrations with relational databases and unstructured sources such as emails and spreadsheets.
  • Develop data flows using Azure Data Factory, Microsoft Fabric Pipelines, and Databricks/Snowflake as defined by the team stack.
  • Implement incremental and full-load ingestion strategies based on domain requirements.
  • Ensure pipeline observability through logs, alerts, and proactive monitoring.
  • Build and organize Bronze, Silver, and Gold layers in the Data Lake/Lakehouse following the Medallion architecture.
  • Implement and maintain storage structures in Azure Data Lake Storage Gen2 using optimized formats such as Delta Lake, Parquet, and Iceberg.
  • Support Microsoft Fabric setup and usage, including Lakehouses, Warehouses, Dataflows, Notebooks, and Pipelines.
  • Implement analytical data models such as dimensional, relational, and Data Vault models.
  • Develop and maintain data transformations using advanced SQL, Python, and tools such as dbt.
  • Ensure data consistency, integrity, and quality across all processing layers.
  • Document data models, transformations, and business rules applied in pipelines.
  • Implement automated data quality checks and tests using tools such as Great Expectations and dbt tests.
  • Support data cataloging and documentation in Azure Purview, including lineage, classification, and dataset descriptions.
  • Help prepare and deliver datasets for machine learning training and validation, including feature engineering pipelines and feature store delivery.

Requirements

  • Proven experience in data engineering within cloud environments.
  • Strong SQL skills for querying, transformation, and analytical modeling.
  • Hands-on experience with Python for pipeline development and data transformations.
  • Practical experience building ELT/ETL pipelines in production environments.
  • Knowledge of Microsoft Azure services such as Data Factory, ADLS Gen2, Synapse Analytics, or Fabric.
  • Familiarity with Data Lake, Lakehouse, and Medallion architecture concepts.
  • Experience with data formats such as Delta Lake, Parquet, or ORC.
  • Ability to read and interpret architectural definitions and technical documentation.
  • Good development practices, including Git versioning, testing, documentation, and CI/CD.
  • Experience with Microsoft Fabric, including Lakehouses, Notebooks, Pipelines, or Dataflows, is a plus.
  • Experience with Databricks, including Spark, Delta Live Tables, or Workflows, is a plus.
  • Knowledge of dbt for data transformations and data quality testing is a plus.
  • Familiarity with Azure Purview for cataloging and data lineage is a plus.
  • Knowledge of Snowflake as a data platform is a plus.
  • Experience orchestrating pipelines with Apache Airflow or Prefect is a plus.
  • Basic knowledge of Gen AI and autonomous agents is a plus.

Benefits

  • Health and dental insurance.
  • Meal and food allowance.
  • Daycare assistance.
  • Extended parental leave.
  • Gym and wellness partnerships through Wellhub (Gympass) and TotalPass.
  • Profit sharing (PLR).
  • Life insurance.
  • Continuous learning platform (CI&T University) and access to online learning partnerships.
  • Discount club and free online platform focused on physical, mental, and well-being support.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Lead Data Engineer (Platform)

Valtech 5K-10K Professional Services

Valtech is hiring a Lead Data Engineer (Platform) in Poland to build and support scalable data platform frameworks that improve how engineering teams deliver data solutions.

Apache Spark AWS Azure CI/CD Databricks Docker Git GitHub Actions GitLab CI Kubernetes Microservices Python REST API Secrets Management Serverless SQL Terraform
5 minutes ago

Data Platform Engineer

Renaissance 1K-5K Internet Software & Services

Renaissance is hiring a mid-level Data Platform Engineer to help build and operate the data infrastructure that makes student data accessible, reliable, and scalable across its education technology platform.

Apache Airflow AWS dbt Docker GCP MySQL PostgreSQL Snowflake
20 minutes ago

Data Engineer, Azure - Remote, Latin America

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is hiring a remote Data Engineer, Azure to develop and optimize data pipelines and warehousing solutions for clients across Latin America.

Agile Apache Spark Azure Git Machine Learning Power BI Python REST API SQL Tableau
34 minutes ago

Data Engineer, Azure - Remote, Latin America

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is hiring a remote Data Engineer, Azure to develop and optimize data pipelines and warehousing solutions for client projects across Latin America.

Agile Apache Spark Azure Git Machine Learning Power BI Python REST API SQL Tableau
1 hour, 34 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers