3Pillar Global

3Pillar Global

3Pillar Global is an innovative product development company that builds breakthrough software products to power digital businesses. They offer a range of services including product strategy, management, user experience design, and software engineering ...

Internet Software & Services
1K-5K
Founded 2006
$26M raised

Description

  • Architect and own the enterprise AI data platform that ingests, transforms, stores, and serves data for AI systems.
  • Design multi-domain data models and architecture patterns for lakehouse, data mesh, and event-driven workloads.
  • Define and enforce data contracts, lineage, versioning, and low-latency serving APIs for AI consumers.
  • Build and maintain retrieval infrastructure for RAG applications, including embedding pipelines and vector stores.
  • Own observability for agent behavior, including inputs, retrieved context, tool calls, reasoning traces, and outputs.
  • Design evaluation frameworks to measure accuracy, faithfulness, relevance, hallucination rates, and task completion.
  • Lead modernization of legacy data pipelines into cloud-native, AI-ready architectures.
  • Establish architecture standards, reference patterns, ADRs, testing practices, and CI/CD automation for data engineering teams.
  • Own the full data stack across streaming, batch processing, cloud storage, compute, and metadata management.
  • Drive security and access governance for both human and agent consumers of the platform.

Requirements

  • 15+ years of hands-on data engineering and architecture experience, including production AI/ML and LLM-era data infrastructure.
  • Strong experience with Databricks or Snowflake; experience with both is desirable.
  • Strong knowledge of data architecture patterns and principles for secure, scalable data lakes, data warehouses, data hubs, and event-driven architectures.
  • Expertise in writing ETL processes in Python, Java, or Scala.
  • Experience with Python, SQL, Snowflake/Databricks, AWS services, Docker, Kubernetes, Terraform, and GitHub Actions.
  • Experience with LangChain, LlamaIndex, LLM APIs such as OpenAI, AWS Bedrock, Claude, or HuggingFace.
  • Experience with vector stores and retrieval tools such as Pinecone, FAISS, ChromaDB, or OpenSearch.
  • Experience with knowledge graphs, including Neo4j.
  • Working knowledge of MLflow, FastAPI, CI/CD pipelines, observability tooling, and data lineage/metadata platforms.
  • Experience designing enterprise-scale AI data platforms serving multiple AI consumers, with preferred exposure to both cloud and on-prem modernization.

Benefits

  • Medical, dental, and vision insurance.
  • Employer-paid disability, life, and AD&D insurance.
  • Unlimited PTO.
  • Paid parental leave.
  • 401(k) plan.
  • Flexible work policy.
  • 12 paid holidays.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Sr. Manager, Data Engineering

Carrot Fertility 251-1K Insurance

Carrot is hiring a Sr. Manager, Data Engineering to lead its BI data engineering function, shaping the data platform and team that power analytics and reporting across a regulated global healthcare business.

Apache Airflow AWS CI/CD dbt Git HIPAA Prefect Python Snowflake SQL
2 days, 15 hours ago

[Job - 31053] Senior Data Architect (GCP, Salesforce Data Cloud), Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca uma Pessoa Arquiteta de Dados Sênior para liderar a transformação do ecossistema analítico de um cliente de varejo, conectando Salesforce Data Cloud e GCP em uma solução escalável e orientada a resultados de negócio.

Apache Spark AWS Azure Databricks GCP Kubernetes Snowflake
1 week ago

Staff Technical Data Architect, Integrations

Lighthouse Hotels, Restaurants & Leisure

Lighthouse is hiring a Staff Technical Data Architect for its Integrations team in Spain to shape the architecture of large-scale hospitality data systems that power its AI-driven platform.

Apache Airflow Databricks GCP Kubernetes Python Snowflake
1 week, 1 day ago

Senior Data Architect - Databricks Platform

Caylent 251-1K IT Services

Caylent is seeking a Databricks Architect to design and harden enterprise-scale data platforms for client engagements, creating the governance and automation needed to move modern data capabilities into production.

Apache Spark AWS CI/CD Databricks Terraform
1 week, 1 day ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers