Software Engineer II, Big Data

3 months, 4 weeks ago
Full-time
Mid Level
Software Development
tvScientific

tvScientific

tvScientific offers a pioneering Connected TV advertising and marketing platform that integrates traditional television's impact with the effectiveness of digital advertising, specifically tailored for performance marketers.

Media
11-50
Founded 2020
$22M raised

Description

  • Design and implement robust data infrastructure in AWS using Spark and Scala.
  • Evolve core data pipelines to scale efficiently with company growth.
  • Store data in optimal engines and formats to balance performance and cost.
  • Collaborate with cross-functional teams to design data solutions that meet business needs.
  • Design and implement knowledge graphs and expose them through batch processing and APIs.
  • Leverage and optimize AWS resources while designing for scale.
  • Work closely with Data Science and Product teams.
  • Implement automated data quality checks with strong attention to detail.
  • Define and implement a strategic vision for data engineering as an individual contributor.

Requirements

  • Production data engineering experience.
  • Proficiency in Spark and Scala, with preferred experience building data infrastructure in Spark using Scala.
  • Experience delivering significant technical initiatives and building reliable, large-scale services.
  • Experience delivering APIs backed by relationship-heavy datasets.
  • Familiarity with data lakes, cloud warehouses, and storage formats.
  • Strong proficiency in AWS services.
  • Expertise in SQL for data manipulation and extraction.
  • Excellent written and verbal communication skills.
  • Bachelor's degree in Computer Science or a related field.
  • Demonstrated ability to use AI to improve speed and quality in day-to-day workflow for relevant outputs.
  • Strong track record of critically evaluating and verifying AI-assisted work through testing, source-checking, data validation, or peer review.
  • High integrity and ownership, including protecting sensitive data and remaining accountable for final decisions and deliverables.
  • Experience in adtech is preferred.
  • Experience implementing data governance practices, including data quality, metadata management, and access controls, is preferred.
  • Strong understanding of privacy-by-design principles and handling sensitive or regulated data is preferred.
  • Familiarity with data table formats like Apache Iceberg or Delta is preferred.
  • Previous experience building out a Data Engineering function is preferred.
  • Proven experience working closely with Data Science teams on machine learning pipelines is preferred.

Benefits

  • Base salary range of $123,696 to $254,667 USD for US-based applicants.
  • Eligible for equity.
  • Remote-friendly working model noted via PinFlex.
  • Relocation assistance is not provided.
  • Additional culture and benefits information is available through Pinterest Life.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Databricks Engineer

RevStar 51-250 Internet Software & Services

RevStar is seeking a remote, US-based Databricks Engineer to build and optimize cloud-agnostic Lakehouse data pipelines and MLOps frameworks for enterprise AI projects across AWS, Azure, and GCP.

Agile Apache Airflow Apache Spark AWS Azure CI/CD Databricks Feature Engineering HIPAA Kafka MLflow MLOps Prefect Python SQL Terraform
5 hours, 34 minutes ago

Senior Data Engineer

phData 251-1K IT Services

Data Engineer at phData, a remote-first global data and AI consultancy, designing and delivering secure, scalable cloud data solutions for enterprise clients.

Apache Airflow Apache Spark AWS Azure Cassandra Databricks dbt Elasticsearch GCP Hadoop HDFS Kafka Luigi Python REST API Scala Snowflake Solr SQL System Design
1 day, 5 hours ago

Forward Deployed Data Engineer

Abacus Insights 51-250 Insurance

Abacus Insights is hiring a Forward Deployed Data Engineer to work alongside health plan clients, building governed data foundations, pipelines, and integrations that turn fragmented payer data into analytics-ready products.

Apache Spark Databricks Snowflake SQL
1 day, 5 hours ago

Data Engineer

Azumo 51-250 Internet Software & Services

Azumo is hiring a fully remote Latin America-based Data Engineer to build and operate production ingestion, transformation, storage, warehouse, and retrieval infrastructure that supports client AI systems.

Apache Airflow Apache Spark AWS Azure CI/CD Dagster Databricks dbt Docker Flink GCP Git GitHub Actions HIPAA Jupyter Kafka Prefect Python Snowflake SQL Terraform
1 day, 5 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers