RemoteLeaf Logo
Log in Sign up

AI Data Architect

4 weeks, 1 day ago
United States
Full-time
Lead
Data Architect
Data Science and Analytics
Apache Spark AWS Azure CI/CD Databricks Docker FastAPI GitHub Actions Grafana Hugging Face Java Kafka Kubernetes MLflow Neo4j OpenSearch Python Scala Snowflake SQL Terraform
Apply Now
3Pillar Global

3Pillar Global

3Pillar Global is an innovative product development company that builds breakthrough software products to power digital businesses. They offer a range of services including product strategy, management, user experience design, and software engineering ...

Internet Software & Services
1K-5K
Founded 2006
$26M raised
View All Jobs 50

Description

  • Architect and own the enterprise AI data platform that ingests, transforms, stores, and serves data for AI systems.
  • Design multi-domain data models and architecture patterns for lakehouse, data mesh, and event-driven workloads.
  • Define and enforce data contracts, lineage, versioning, and low-latency serving APIs for AI consumers.
  • Build and maintain retrieval infrastructure for RAG applications, including embedding pipelines and vector stores.
  • Own observability for agent behavior, including inputs, retrieved context, tool calls, reasoning traces, and outputs.
  • Design evaluation frameworks to measure accuracy, faithfulness, relevance, hallucination rates, and task completion.
  • Lead modernization of legacy data pipelines into cloud-native, AI-ready architectures.
  • Establish architecture standards, reference patterns, ADRs, testing practices, and CI/CD automation for data engineering teams.
  • Own the full data stack across streaming, batch processing, cloud storage, compute, and metadata management.
  • Drive security and access governance for both human and agent consumers of the platform.

Requirements

  • 15+ years of hands-on data engineering and architecture experience, including production AI/ML and LLM-era data infrastructure.
  • Strong experience with Databricks or Snowflake; experience with both is desirable.
  • Strong knowledge of data architecture patterns and principles for secure, scalable data lakes, data warehouses, data hubs, and event-driven architectures.
  • Expertise in writing ETL processes in Python, Java, or Scala.
  • Experience with Python, SQL, Snowflake/Databricks, AWS services, Docker, Kubernetes, Terraform, and GitHub Actions.
  • Experience with LangChain, LlamaIndex, LLM APIs such as OpenAI, AWS Bedrock, Claude, or HuggingFace.
  • Experience with vector stores and retrieval tools such as Pinecone, FAISS, ChromaDB, or OpenSearch.
  • Experience with knowledge graphs, including Neo4j.
  • Working knowledge of MLflow, FastAPI, CI/CD pipelines, observability tooling, and data lineage/metadata platforms.
  • Experience designing enterprise-scale AI data platforms serving multiple AI consumers, with preferred exposure to both cloud and on-prem modernization.

Benefits

  • Medical, dental, and vision insurance.
  • Employer-paid disability, life, and AD&D insurance.
  • Unlimited PTO.
  • Paid parental leave.
  • 401(k) plan.
  • Flexible work policy.
  • 12 paid holidays.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Carrot Fertility

Sr. Manager, Data Engineering

Carrot Fertility 251-1K Insurance

Carrot is hiring a Sr. Manager, Data Engineering to lead its BI data engineering function, shaping the data platform and team that power analytics and reporting across a regulated global healthcare business.

Anywhere Full-time Lead Data Architect Database Administrator
$170k-$210k
Apache Airflow AWS CI/CD dbt Git HIPAA Prefect Python Snowflake SQL
2 days, 15 hours ago
CI&T

[Job - 31053] Senior Data Architect (GCP, Salesforce Data Cloud), Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca uma Pessoa Arquiteta de Dados Sênior para liderar a transformação do ecossistema analítico de um cliente de varejo, conectando Salesforce Data Cloud e GCP em uma solução escalável e orientada a resultados de negócio.

Brazil Full-time Senior Data Architect
Apache Spark AWS Azure Databricks GCP Kubernetes Snowflake
1 week ago
Lighthouse

Staff Technical Data Architect, Integrations

Lighthouse Hotels, Restaurants & Leisure

Lighthouse is hiring a Staff Technical Data Architect for its Integrations team in Spain to shape the architecture of large-scale hospitality data systems that power its AI-driven platform.

Spain Full-time Lead Data Architect
Apache Airflow Databricks GCP Kubernetes Python Snowflake
1 week, 1 day ago
Caylent

Senior Data Architect - Databricks Platform

Caylent 251-1K IT Services

Caylent is seeking a Databricks Architect to design and harden enterprise-scale data platforms for client engagements, creating the governance and automation needed to move modern data capabilities into production.

Brazil Full-time Senior Data Architect
Apache Spark AWS CI/CD Databricks Terraform
1 week, 1 day ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers