RemoteLeaf Logo
Log in Sign up

Content Pipeline Engineer

4 hours, 17 minutes ago
United States
Full-time
Senior
Data Engineer
Software Development
AWS Machine Learning OpenSearch Python
Apply Now
Black Canyon Consulting

Black Canyon Consulting

Black Canyon Consulting (BCC) is a Woman Owned Small Business specializing in innovative Program and IT Management Support Services with a focus on Integrity, Impact, and Innovation for Federal R&D programs.

Internet Software & Services
11-50
Founded 2017
View All Jobs 3

Description

  • Design and implement ingestion and processing pipelines for PDFs, scans, images, forms, maps, and other unstructured content.
  • Build OCR and multimodal workflows to extract text, tables, metadata, identifiers, and domain-specific attributes.
  • Process plats and survey drawings, including legal descriptions, labels, bearings, distances, and spatial information.
  • Develop document parsing, classification, normalization, chunking, and metadata-enrichment processes.
  • Maintain provenance linking extracted information to source documents, systems, and business records.
  • Build document and vector indexes using OpenSearch or comparable technologies, including embeddings and semantic retrieval.
  • Develop APIs and interfaces for downstream applications and AI services to search and retrieve document content.
  • Implement agentic workflows for classification, extraction strategy selection, validation, exception handling, and quality assurance.
  • Establish confidence thresholds, human-review processes, evaluation datasets, and quality measurements.
  • Build automated testing, monitoring, observability, and optimization processes for accuracy, throughput, repeatability, and cost.

Requirements

  • Bachelor’s degree in Computer Science, Software Engineering, Data Science, Information Systems, or a related technical field.
  • 5+ years of experience in software engineering, data engineering, search, document processing, or a related field.
  • Strong Python experience building production-grade data or content-processing pipelines.
  • Hands-on experience processing PDFs, images, scanned documents, and semi-structured content with OCR and extraction technologies.
  • Experience with document stores, search engines, or vector databases, including embeddings and semantic retrieval.
  • Experience with document parsing, classification, chunking, metadata enrichment, and source provenance.
  • Experience with LLM-enabled or agentic document-processing workflows.
  • Experience building pipelines with automated testing, logging, monitoring, error handling, and quality controls.
  • Experience evaluating OCR and extraction quality using measurable criteria and confidence thresholds.
  • Preferred: OpenSearch, AWS document-processing or AI services, LangChain, LangGraph, multimodal models, RAG, maps, engineering drawings, geospatial extraction, federal government, or permitting and regulatory documents.

Benefits

  • Medical, dental, and vision coverage.
  • 401(k) plan with employer contribution.
  • Paid holidays and vacation.
  • Tuition reimbursement.
  • Remote work arrangement.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Coderio

Especialista Data Engineer (Sr.)

Coderio 51-250 Internet Software & Services

Coderio busca un/a Especialista Data Engineer Senior para su área de Ingeniería de Datos en una gerencia de datos del sector Retail, responsable de construir y mantener soluciones cloud en AWS que habiliten la gestión y toma de decisiones en Argentina y proyectos regionales.

Argentina Contract Senior Data Engineer
Apache Spark AWS CI/CD Scrum SQL
4 hours, 2 minutes ago
F

Mechanical Data Engineer (Mechanical + Data Engineering Required) 3 Month Contract Role

Foundation EGI 11-50 Technology, Information and Internet

As an Individual Contributor on the Data Studio team at an MIT-born, venture-backed Silicon Valley startup, you will transform customer engineering data into reliable datasets and reference content that power AI systems for design and manufacturing.

United States Contract Mid Level Data Engineer
4 hours, 2 minutes ago
Attain Talent

Development Engineer

Attain Talent 1-10 staffing & recruiting

Attain Talent is hiring a Development Engineer to support CMS modernization by building and maintaining scalable AWS and Databricks data pipelines for healthcare analytics, reporting, and operational decision-making.

United States Full-time Mid Level Data Engineer
$63k-$92k
Apache Spark AWS CI/CD Databricks GitHub Python SQL
1 day, 3 hours ago
CodeRoad

Data Engineer

CodeRoad 51-250 Internet Software & Services

CodeRoad is seeking a Data Engineer to build and optimize production data pipelines, AI/RAG data systems, and analytics infrastructure for high-growth North American clients.

Latin America Contract Mid Level Data Engineer
Apache Airflow Azure Bitbucket CI/CD Docker Git JIRA Pandas PostgreSQL Python SQL SQL Server
1 day, 3 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers