[Job 28454] IA Data Engineer, Senior

2 hours, 58 minutes ago
Full-time
Senior
Data Science and Analytics
CI&T

CI&T

CI&T is a global digital technology agency empowering agile growth for leading companies through advanced technologies with a team of 2000 experts worldwide.

Internet Software & Services
5K-10K
Founded 1995

Description

  • Design and implement GenAI-based solutions that optimize critical stages of the data development lifecycle.
  • Develop AI agents that assist with creating Databricks notebooks, ADF pipelines, and Microsoft Fabric structures.
  • Build workflows that integrate LLMs with SQL Server and Power BI to automate data documentation and DAX measure creation.
  • Apply advanced prompt engineering to generate optimized, secure, and performant PySpark and T-SQL code.
  • Define quality metrics to validate AI-generated artifacts, including query efficiency and other output checks.
  • Ensure solutions align with data governance, security, and privacy practices.
  • Stay current on AI capabilities in Microsoft Fabric and Databricks to balance native features versus custom development.
  • Collaborate on translating business challenges into agents that support data modeling and dashboard development.

Requirements

  • Degree in Computer Science, Data Engineering, Statistics, or a related field.
  • Solid experience in Data Engineering and deep understanding of CI/CD pipelines applied to data.
  • Hands-on experience building GenAI solutions using OpenAI API, Azure OpenAI, or open-source models, with a focus on prompt engineering.
  • Experience with AI agent orchestration frameworks such as LangChain, Semantic Kernel, or AutoGen.
  • Strong technical command of the Azure Data ecosystem, including Databricks, Data Factory, and Fabric.
  • Proficiency in SQL and Python/PySpark.
  • Ability to translate business challenges into agents that support data modeling and dashboard creation.
  • DataOps mindset, including testing, versioning, and monitoring for data assets.
  • Deep knowledge of Microsoft Fabric and its AI integration capabilities is a plus.
  • Experience with Unity Catalog and data governance is a plus.
  • Knowledge of RAG (Retrieval-Augmented Generation) for building assistants that use internal technical documentation is a plus.
  • Azure Data Engineer or AI Engineer certification is a plus.

Benefits

  • Health and dental insurance.
  • Food and meal allowance.
  • Childcare assistance.
  • Extended parental leave.
  • Gym and wellness partnerships through Wellhub (Gympass) and TotalPass.
  • Profit sharing (PLR).
  • Life insurance.
  • Continuous learning platform (CI&T University).
  • Discount club and free online platforms for physical, mental, and wellbeing support.
  • Pregnancy and responsible parenting course, plus language-learning and online course partnerships.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior AI Engineer (Portugal-based Remote/Hybrid)

SWORD Health 251-1K Health Care Providers & Services

Sword Health is hiring a Senior AI Engineer in Portugal to build and optimize generative AI-powered internal tools that improve workflows across departments like Finance, Commercial, and Talent.

AWS Azure GCP JavaScript Node.js Python React SQL
2 hours, 58 minutes ago

Entrepreneur in Residence - Technical Co-founder (CTO)

FutureSight 11-50 Internet Software & Services

FutureSight is seeking an applied AI builder to co-found and lead a new B2B AI startup from the ground up, working closely with the venture studio to turn early ideas into a product customers trust and use.

LLM System Design
2 hours, 58 minutes ago

Principal Engineer - AI Products & Platform, Remote

Aledade 1K-5K Health Care Providers & Services

Aledade is hiring a Principal Engineer to shape and scale its AI-powered product ecosystem and platform for independent primary care, with responsibility for setting technical direction across multiple teams and delivering production-ready systems at national scale.

AWS Azure C# C++ CI/CD Docker GCP Go Java Kafka Kubernetes Microservices Python Scala SQL
3 hours, 13 minutes ago

Entrepreneur in Residence - Technical Co-founder (CTO)

FutureSight 11-50 Internet Software & Services

FutureSight is seeking an applied AI builder to co-found and lead the technical direction of a new B2B AI startup from the ground up, working closely with the studio to turn an ambiguous problem into a product customers trust and use.

LLM System Design
3 hours, 13 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers