RemoteLeaf Logo
Log in Sign up

Senior Data Engineer, Blockchain data and/or NLP pipelines

3 weeks, 4 days ago
United States
Full-time
Senior
Data Engineer
Software Development
Apache Airflow AWS AWS CDK Blockchain ClickHouse Dagster dbt Docker FastAPI Git GitHub Actions Go Kafka Kong Kubernetes LLM MongoDB Neo4j NLP OpenSearch PostgreSQL Prefect Python Snowflake SQL Terraform
Apply Now
Inca Digital

Inca Digital

Inca Digital specializes in transforming complex data into clear, risk-focused intelligence for the crypto and banking sectors, utilizing advanced data analytics to combat issues such as fraud, money laundering, and market risks while collaborating wit...

Internet Software & Services
11-50
Founded 2017
View All Jobs 4

Description

  • Design, build, and operate end-to-end batch and incremental ETL/ELT pipelines.
  • Acquire data from relational databases, third-party APIs, flat files, blockchain nodes and indexers, and social/web text sources.
  • Apply NLP and LLM-assisted processing for entity extraction, claim extraction, classification, deduplication, and enrichment.
  • Model and query data across relational, object, and graph stores based on access patterns.
  • Maintain provenance, reproducibility, versioning, and immutability of raw and published data.
  • Own data quality through validation, lineage, reconciliation, and freshness monitoring.
  • Partner with R&D, engineering, data science, and investigations teams to turn intelligence needs into scalable products.
  • Contribute to technical design and architecture through a written, argued design process.

Requirements

  • Advanced Python and SQL.
  • Experience building and operating production ETL/ELT pipelines under an orchestrator such as Airflow, Dagster, Prefect, or Step Functions.
  • Experience with backfills, idempotency, retries, schema drift, and on-call support for production pipelines.
  • Hands-on experience with PostgreSQL/RDS and object storage such as S3.
  • Experience building and versioning APIs such as Kong OSS or FastAPI, or feeding dashboards.
  • Experience with Docker, Git, CI/CD tools such as GitHub Actions or AWS CodeBuild/CodePipeline, and IaC such as Terraform or CDK.
  • Deep expertise in one of the core domains and working proficiency in the other: blockchain data or NLP/LLMs.
  • Preferred experience with streaming architectures such as Kafka or AWS SQS/SNS.
  • Preferred experience with document stores, warehouses, or analytical engines such as MongoDB, ClickHouse, DuckDB, Snowflake, or Athena.
  • Preferred experience with graph modeling and querying, transformation/data-quality tools, vector stores, Go, Kubernetes, or domain experience in blockchain, NLP, financial services, regulatory frameworks, or OSINT.
  • Please highlight your primary focus area in your application.

Benefits

  • Fully remote, high-trust work environment.
  • Competitive compensation.
  • Healthcare stipend.
  • Childcare stipends.
  • Dedicated employee assistance resources.
  • Impact-focused culture that prioritizes delivered results over hours logged.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Xebia

Senior AI/Data Engineer

Xebia 1K-5K Internet Software & Services

Xebia is seeking a senior data or analytics engineer to build an AI-powered Analytics Agent in Devin, integrating dbt, Databricks, GitHub, and related data-platform tools for client engineering teams.

Bulgaria Poland Romania Senior AI (Artificial Intelligence) Data Engineer
AWS Azure CI/CD Databricks dbt GCP Git GitHub MySQL Snowflake SQL
4 hours, 15 minutes ago
Trinetix

Databricks Developer

Trinetix 251-1K Internet Software & Services

Trinetix is seeking a Databricks Developer to build and maintain scalable data ingestion, transformation, and analytics pipelines for enterprise clients across its global delivery organization.

Poland Portugal Romania Bulgaria Spain Senior Data Engineer
Apache Spark CI/CD Databricks Pandas Python
1 day, 4 hours ago
8th Light

Principal Data Engineer (Remote)

8th Light 51-250 Internet Software & Services

8th Light is seeking a Principal Engineer to lead client-facing data platform architecture and delivery, turning complex software and data challenges into scalable solutions.

United States Full-time Lead Data Engineer
$152k-$221k
Apache Spark AWS CI/CD Databricks Kafka MLOps Python SQL
2 days, 3 hours ago
Climate First Bank

Data Engineer

Climate First Bank 51-250 Banks

Climate First Bank is hiring a Data Engineer to build and optimize Azure-based enterprise data solutions, pipelines, and analytics capabilities for a mission-driven financial institution.

United States Full-time Lead Data Engineer
Apache Spark Azure CI/CD Databricks Encryption Git Kafka Power BI Python Scala SQL SQL Server Terraform
2 days, 4 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers