RemoteLeaf Logo
Log in Sign up

AI Data Architect

1 week, 6 days ago
United States
Full-time
Lead
Data Architect
Data Science and Analytics
Apache Spark AWS Azure CI/CD Databricks Docker FastAPI GitHub Actions Grafana Hugging Face Java Kafka Kubernetes MLflow Neo4j OpenSearch Python Scala Snowflake SQL Terraform
Apply Now
3Pillar Global

3Pillar Global

3Pillar Global is an innovative product development company that builds breakthrough software products to power digital businesses. They offer a range of services including product strategy, management, user experience design, and software engineering ...

Internet Software & Services
1K-5K
Founded 2006
$26M raised
View All Jobs 68

Description

  • Architect and own the enterprise AI data platform that ingests, transforms, stores, and serves data for AI systems.
  • Design multi-domain data models and architecture patterns for lakehouse, data mesh, and event-driven workloads.
  • Define and enforce data contracts, lineage, versioning, and low-latency serving APIs for AI consumers.
  • Build and maintain retrieval infrastructure for RAG applications, including embedding pipelines and vector stores.
  • Own observability for agent behavior, including inputs, retrieved context, tool calls, reasoning traces, and outputs.
  • Design evaluation frameworks to measure accuracy, faithfulness, relevance, hallucination rates, and task completion.
  • Lead modernization of legacy data pipelines into cloud-native, AI-ready architectures.
  • Establish architecture standards, reference patterns, ADRs, testing practices, and CI/CD automation for data engineering teams.
  • Own the full data stack across streaming, batch processing, cloud storage, compute, and metadata management.
  • Drive security and access governance for both human and agent consumers of the platform.

Requirements

  • 15+ years of hands-on data engineering and architecture experience, including production AI/ML and LLM-era data infrastructure.
  • Strong experience with Databricks or Snowflake; experience with both is desirable.
  • Strong knowledge of data architecture patterns and principles for secure, scalable data lakes, data warehouses, data hubs, and event-driven architectures.
  • Expertise in writing ETL processes in Python, Java, or Scala.
  • Experience with Python, SQL, Snowflake/Databricks, AWS services, Docker, Kubernetes, Terraform, and GitHub Actions.
  • Experience with LangChain, LlamaIndex, LLM APIs such as OpenAI, AWS Bedrock, Claude, or HuggingFace.
  • Experience with vector stores and retrieval tools such as Pinecone, FAISS, ChromaDB, or OpenSearch.
  • Experience with knowledge graphs, including Neo4j.
  • Working knowledge of MLflow, FastAPI, CI/CD pipelines, observability tooling, and data lineage/metadata platforms.
  • Experience designing enterprise-scale AI data platforms serving multiple AI consumers, with preferred exposure to both cloud and on-prem modernization.

Benefits

  • Medical, dental, and vision insurance.
  • Employer-paid disability, life, and AD&D insurance.
  • Unlimited PTO.
  • Paid parental leave.
  • 401(k) plan.
  • Flexible work policy.
  • 12 paid holidays.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Bounteous

CDP Architect

Bounteous 1K-5K Internet Software & Services

Adobe RTCDP Developer at Adobe Experience Platform-focused teams to design and deliver unified customer data solutions that power profiling, segmentation, and marketing activation.

United States Contract Lead Data Architect Solutions Architect
Apache Spark AWS Azure GCP Hadoop Java JavaScript Kafka Python Scala SQL
1 day, 5 hours ago
Chainguard

Senior Data Governance and Tooling Manager

Chainguard 51-250 Internet Software & Services

Chainguard is hiring a Senior Data Governance & Tooling Manager to own the integrity and strategy of its GTM data ecosystem across CRM, enrichment, and related revenue systems.

United States Full-time Senior Data Architect Sales Operations
$174k-$205k
CRM Salesforce
3 days, 5 hours ago
3Cloud

Senior Director - Data Platforms & Architecture

3Cloud 251-1K Internet Software & Services

3Cloud is hiring a Senior Director to oversee a consulting practice’s delivery, client success, and technical direction for data and analytics work.

United States Full-time Lead Data Architect
$183k-$275k
Azure
3 days, 5 hours ago
CI&T

[job-30810] Master Data Architect, Brasil.

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Senior Data Architect to lead the modernization of a large education client’s data product on Databricks and AWS, defining the target architecture and guiding the migration strategy.

Brazil Full-time Senior Data Architect
Apache Airflow Apache Spark AWS CI/CD CRM Databricks DynamoDB ERP Hadoop Kanban MongoDB PostgreSQL Scrum SQL Server
4 days, 5 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers