RemoteLeaf Logo
Log in Sign up

Senior Software Engineer, Data Ingestion Platform

4 weeks, 1 day ago
United States, Canada
Full-time
Senior
Software Engineer
Software Development
Apache Airflow Apache Spark AWS Azure Databricks GCP Go Java Kafka Microservices Python Scala Snowflake Terraform
Apply Now
Block

Block

Block is a company that consists of Square, Cash App, Spiral, TIDAL, TBD, and foundational teams. They are focused on economic empowerment by creating tools to expand access to the economy. Square helps sellers run and grow businesses, Cash App redefin...

Capital Markets
10K-50K
Founded 2009
View All Jobs 141

Description

  • Design, build, and operate scalable data replication and ingestion pipelines into Block's Lakehouse.
  • Develop and enhance Kafka Iceberg connectors and data loading frameworks for reliable, low-latency delivery to Snowflake and Databricks.
  • Drive modernization of the CDC platform and evaluate next-generation database replication approaches.
  • Build self-service tooling and observability features for onboarding, monitoring, and troubleshooting data pipelines.
  • Collaborate with data engineering, platform infrastructure, and product teams on data contracts and service boundaries.
  • Consolidate overlapping ingestion systems and help unify Block's data ingestion architecture.
  • Design and implement PII detection, masking, and privacy-compliant data handling in ingestion pipelines.
  • Establish best practices for pipeline reliability, cost optimization, schema management, and compliance.

Requirements

  • 8+ years of experience in software engineering or data platform development focused on scalable data systems or distributed infrastructure.
  • Strong programming proficiency in Java, Python, Scala, or Go.
  • Hands-on experience with streaming data systems such as Apache Kafka or Kafka Connect.
  • Solid understanding of Change Data Capture (CDC), database replication patterns, and data lake or Lakehouse architectures.
  • Experience with Apache Iceberg or Delta Lake.
  • Experience with cloud-based data ecosystems such as AWS, GCP, or Azure and infrastructure-as-code tools.
  • Experience developing data frameworks, libraries, or services.
  • Experience with cloud-native database replication or Iceberg-based ingestion patterns is preferred.
  • Familiarity with technologies such as Schema Registry, Debezium, Spark, Airflow, and Terraform.
  • Ability to work from anywhere in the US or Canada.

Benefits

  • Starting salary range of $217,800 to $326,800 USD for Zone A, $207,000 to $310,400 for Zone B, $196,100 to $294,100 for Zone C, and $185,200 to $277,800 for Zone D.
  • Remote work from anywhere in the US or Canada.
  • Medical insurance.
  • Flexible time off.
  • Retirement savings plans.
  • Modern family planning support.
  • Reasonable accommodations during the interview process for disabled applicants.
  • Opportunity to work in an inclusive, fair-chance hiring environment.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Affirm

Staff Software Engineer, Backend (Continuous Integration)

Affirm 1K-5K Diversified Financial Services

Affirm is hiring a Staff Engineer to lead its Continuous Integration team, improving the reliability and efficiency of development pipelines that help engineers ship high-quality software quickly and confidently.

United States Full-time Lead Software Engineer
$200k-$275k
AWS Buildkite CI/CD Java Kotlin Kubernetes Python
13 minutes ago
Pure Storage

Member of Technical Staff, FlashBlade

Pure Storage 1K-5K IT Services

EverPure is hiring a software engineer for the FlashBlade product team to help build a scale-out all-flash file and object storage system for modern data workloads.

India Full-time Lead Software Engineer
Apache Spark C C++ Elasticsearch Go Java Kafka Linux Python Splunk
50 minutes ago
ZoomInfo

Senior Software Engineer

ZoomInfo 1K-5K Professional Services

ZoomInfo is hiring a Senior Full Stack Engineer for its Chorus.ai Conversation Intelligence platform to build customer-facing product experiences that turn large-scale sales call data into actionable insights for sales teams.

Canada Full-time Senior Software Engineer
$161k-$242k
Angular DynamoDB Elasticsearch MongoDB MySQL Node.js Python React REST API Solr
1 hour, 2 minutes ago
Blueprint Technologies

Applications Engineer (Analytics Solutions Focus)

Blueprint Technologies 251-1K Internet Software & Services

Blueprint is hiring an Applications Engineer focused on analytics solutions to build and enhance applications that power reporting, data visualization, and enterprise decision-making.

United States Full-time Senior Software Engineer
$87k-$98k
Agile Databricks SQL Tableau
2 hours, 6 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers