3Pillar Global

3Pillar Global

3Pillar Global is an innovative product development company that builds breakthrough software products to power digital businesses. They offer a range of services including product strategy, management, user experience design, and software engineering ...

Internet Software & Services
1K-5K
Founded 2006
$26M raised

Description

  • Architect and own the enterprise AI data platform that ingests, transforms, stores, and serves data for AI systems.
  • Design multi-domain data models and architecture patterns for lakehouse, data mesh, and event-driven workloads.
  • Define and enforce data contracts, lineage, versioning, and low-latency serving APIs for AI consumers.
  • Build and maintain retrieval infrastructure for RAG applications, including embedding pipelines and vector stores.
  • Own observability for agent behavior, including inputs, retrieved context, tool calls, reasoning traces, and outputs.
  • Design evaluation frameworks to measure accuracy, faithfulness, relevance, hallucination rates, and task completion.
  • Lead modernization of legacy data pipelines into cloud-native, AI-ready architectures.
  • Establish architecture standards, reference patterns, ADRs, testing practices, and CI/CD automation for data engineering teams.
  • Own the full data stack across streaming, batch processing, cloud storage, compute, and metadata management.
  • Drive security and access governance for both human and agent consumers of the platform.

Requirements

  • 15+ years of hands-on data engineering and architecture experience, including production AI/ML and LLM-era data infrastructure.
  • Strong experience with Databricks or Snowflake; experience with both is desirable.
  • Strong knowledge of data architecture patterns and principles for secure, scalable data lakes, data warehouses, data hubs, and event-driven architectures.
  • Expertise in writing ETL processes in Python, Java, or Scala.
  • Experience with Python, SQL, Snowflake/Databricks, AWS services, Docker, Kubernetes, Terraform, and GitHub Actions.
  • Experience with LangChain, LlamaIndex, LLM APIs such as OpenAI, AWS Bedrock, Claude, or HuggingFace.
  • Experience with vector stores and retrieval tools such as Pinecone, FAISS, ChromaDB, or OpenSearch.
  • Experience with knowledge graphs, including Neo4j.
  • Working knowledge of MLflow, FastAPI, CI/CD pipelines, observability tooling, and data lineage/metadata platforms.
  • Experience designing enterprise-scale AI data platforms serving multiple AI consumers, with preferred exposure to both cloud and on-prem modernization.

Benefits

  • Medical, dental, and vision insurance.
  • Employer-paid disability, life, and AD&D insurance.
  • Unlimited PTO.
  • Paid parental leave.
  • 401(k) plan.
  • Flexible work policy.
  • 12 paid holidays.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

CDP Architect

Bounteous 1K-5K Internet Software & Services

Adobe RTCDP Developer at Adobe Experience Platform-focused teams to design and deliver unified customer data solutions that power profiling, segmentation, and marketing activation.

Apache Spark AWS Azure GCP Hadoop Java JavaScript Kafka Python Scala SQL
1 day, 5 hours ago

Senior Data Governance and Tooling Manager

Chainguard 51-250 Internet Software & Services

Chainguard is hiring a Senior Data Governance & Tooling Manager to own the integrity and strategy of its GTM data ecosystem across CRM, enrichment, and related revenue systems.

CRM Salesforce
3 days, 5 hours ago

Senior Director - Data Platforms & Architecture

3Cloud 251-1K Internet Software & Services

3Cloud is hiring a Senior Director to oversee a consulting practice’s delivery, client success, and technical direction for data and analytics work.

Azure
3 days, 5 hours ago

[job-30810] Master Data Architect, Brasil.

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Senior Data Architect to lead the modernization of a large education client’s data product on Databricks and AWS, defining the target architecture and guiding the migration strategy.

Apache Airflow Apache Spark AWS CI/CD CRM Databricks DynamoDB ERP Hadoop Kanban MongoDB PostgreSQL Scrum SQL Server
4 days, 5 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers