3Pillar Global

3Pillar Global

3Pillar Global is an innovative product development company that builds breakthrough software products to power digital businesses. They offer a range of services including product strategy, management, user experience design, and software engineering ...

Internet Software & Services
1K-5K
Founded 2006
$26M raised

Description

  • Architect and own the enterprise AI data platform that ingests, transforms, stores, and serves data for AI systems.
  • Design multi-domain data models and architecture patterns for lakehouse, data mesh, and event-driven workloads.
  • Define and enforce data contracts, lineage, versioning, and low-latency serving APIs for AI consumers.
  • Build and maintain retrieval infrastructure for RAG applications, including embedding pipelines and vector stores.
  • Own observability for agent behavior, including inputs, retrieved context, tool calls, reasoning traces, and outputs.
  • Design evaluation frameworks to measure accuracy, faithfulness, relevance, hallucination rates, and task completion.
  • Lead modernization of legacy data pipelines into cloud-native, AI-ready architectures.
  • Establish architecture standards, reference patterns, ADRs, testing practices, and CI/CD automation for data engineering teams.
  • Own the full data stack across streaming, batch processing, cloud storage, compute, and metadata management.
  • Drive security and access governance for both human and agent consumers of the platform.

Requirements

  • 15+ years of hands-on data engineering and architecture experience, including production AI/ML and LLM-era data infrastructure.
  • Strong experience with Databricks or Snowflake; experience with both is desirable.
  • Strong knowledge of data architecture patterns and principles for secure, scalable data lakes, data warehouses, data hubs, and event-driven architectures.
  • Expertise in writing ETL processes in Python, Java, or Scala.
  • Experience with Python, SQL, Snowflake/Databricks, AWS services, Docker, Kubernetes, Terraform, and GitHub Actions.
  • Experience with LangChain, LlamaIndex, LLM APIs such as OpenAI, AWS Bedrock, Claude, or HuggingFace.
  • Experience with vector stores and retrieval tools such as Pinecone, FAISS, ChromaDB, or OpenSearch.
  • Experience with knowledge graphs, including Neo4j.
  • Working knowledge of MLflow, FastAPI, CI/CD pipelines, observability tooling, and data lineage/metadata platforms.
  • Experience designing enterprise-scale AI data platforms serving multiple AI consumers, with preferred exposure to both cloud and on-prem modernization.

Benefits

  • Medical, dental, and vision insurance.
  • Employer-paid disability, life, and AD&D insurance.
  • Unlimited PTO.
  • Paid parental leave.
  • 401(k) plan.
  • Flexible work policy.
  • 12 paid holidays.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Architect / Data Scientist

Intellectsoft 251-1K Internet Software & Services

Intellectsoft is seeking a Senior Data Architect to design the data architecture that will support its Sales and Go-To-Market strategy through enterprise Microsoft-based analytics and business intelligence.

Databricks Power BI
1 hour, 58 minutes ago

Data Architect

Oxford Dynamics 1-10 Life Sciences Tools & Services

Oxford Dynamics is hiring a remote Data Architect to define and deliver data models for a high-profile NATO programme supporting mission-critical defence and security systems.

2 days, 1 hour ago

Senior Databricks Administrator/Architect

European Dynamics 251-1K IT Services

European Dynamics is hiring a Senior Databricks Administrator/Architect to support a remote enterprise data platform engagement with a major European client.

Apache Spark Azure CI/CD Generative AI Network Security Power BI Python SQL Terraform
2 days, 1 hour ago

Director, Data Engineering

SQUIRE 51-250 Internet Software & Services

SQUIRE is hiring a Director, Data Engineering to lead its data organization and shape the long-term data foundation supporting reporting, automation, and AI initiatives.

Apache Airflow CRM Dagster dbt JavaScript LLM Machine Learning MLOps Prefect Python Salesforce Snowflake SQL TypeScript
3 days, 1 hour ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers