RemoteLeaf Logo
Log in Sign up

Senior Data Engineer, Blockchain data and/or NLP pipelines

10 hours, 31 minutes ago
United States
Full-time
Senior
Data Engineer
Software Development
Apache Airflow AWS AWS CDK Blockchain ClickHouse Dagster dbt Docker FastAPI Git GitHub Actions Go Kafka Kong Kubernetes LLM MongoDB Neo4j NLP OpenSearch PostgreSQL Prefect Python Snowflake SQL Terraform
Apply Now
Inca Digital

Inca Digital

Inca Digital specializes in transforming complex data into clear, risk-focused intelligence for the crypto and banking sectors, utilizing advanced data analytics to combat issues such as fraud, money laundering, and market risks while collaborating wit...

Internet Software & Services
11-50
Founded 2017
View All Jobs 2

Description

  • Design, build, and operate end-to-end batch and incremental ETL/ELT pipelines.
  • Acquire data from relational databases, third-party APIs, flat files, blockchain nodes and indexers, and social/web text sources.
  • Apply NLP and LLM-assisted processing for entity extraction, claim extraction, classification, deduplication, and enrichment.
  • Model and query data across relational, object, and graph stores based on access patterns.
  • Maintain provenance, reproducibility, versioning, and immutability of raw and published data.
  • Own data quality through validation, lineage, reconciliation, and freshness monitoring.
  • Partner with R&D, engineering, data science, and investigations teams to turn intelligence needs into scalable products.
  • Contribute to technical design and architecture through a written, argued design process.

Requirements

  • Advanced Python and SQL.
  • Experience building and operating production ETL/ELT pipelines under an orchestrator such as Airflow, Dagster, Prefect, or Step Functions.
  • Experience with backfills, idempotency, retries, schema drift, and on-call support for production pipelines.
  • Hands-on experience with PostgreSQL/RDS and object storage such as S3.
  • Experience building and versioning APIs such as Kong OSS or FastAPI, or feeding dashboards.
  • Experience with Docker, Git, CI/CD tools such as GitHub Actions or AWS CodeBuild/CodePipeline, and IaC such as Terraform or CDK.
  • Deep expertise in one of the core domains and working proficiency in the other: blockchain data or NLP/LLMs.
  • Preferred experience with streaming architectures such as Kafka or AWS SQS/SNS.
  • Preferred experience with document stores, warehouses, or analytical engines such as MongoDB, ClickHouse, DuckDB, Snowflake, or Athena.
  • Preferred experience with graph modeling and querying, transformation/data-quality tools, vector stores, Go, Kubernetes, or domain experience in blockchain, NLP, financial services, regulatory frameworks, or OSINT.
  • Please highlight your primary focus area in your application.

Benefits

  • Fully remote, high-trust work environment.
  • Competitive compensation.
  • Healthcare stipend.
  • Childcare stipends.
  • Dedicated employee assistance resources.
  • Impact-focused culture that prioritizes delivered results over hours logged.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Nansen

Senior Data Engineer

Nansen 51-250 Internet Software & Services

Nansen is hiring a data engineer to build and operate the data infrastructure behind its onchain analytics product, with a clear path from individual contributor to Engineering Manager.

Europe Full-time Senior Data Engineer
Blockchain ClickHouse dbt PostgreSQL Python SQL
10 hours, 45 minutes ago
Kargo

Lead Data Engineer - Identity

Kargo 251-1K Media

Kargo is hiring a senior data engineering leader to own its identity graph, onboarding pipelines, and audience data layer for adtech products across web, CTV, mobile, and in-app inventory.

Europe Full-time Lead Data Engineer Technical Lead
Apache Airflow Apache Spark Argo CD AWS ClickHouse GitHub Actions Grafana Kafka Kubernetes Prometheus Python Snowflake SQL
11 hours, 16 minutes ago
Kargo

Staff Data Platform Engineer

Kargo 251-1K Media

Kargo is hiring a founding Data Platform Engineer to build the company-wide platform that makes data products discoverable, reliable, observable, and self-serve across its advertising stack.

Europe Lead Data Engineer
Apache Spark AWS CI/CD Kubernetes Python Snowflake Terraform
11 hours, 16 minutes ago
Eltropy

Lead Data Engineer

Eltropy 51-250 Communications Equipment

Lead Data Engineer at a remote India-based company to architect and deliver scalable data platforms and pipelines that support reporting, analytics, and self-service BI.

India Full-time Lead Data Engineer
Apache Airflow Apache Spark AWS Kafka Python SQL
11 hours, 16 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers