3Pillar Global

3Pillar Global

3Pillar Global is an innovative product development company that builds breakthrough software products to power digital businesses. They offer a range of services including product strategy, management, user experience design, and software engineering ...

Internet Software & Services
1K-5K
Founded 2006
$26M raised

Description

  • Design, build, and maintain data engineering solutions centered on Snowflake.
  • Develop Python and Linux Bash scripts to automate data workflows.
  • Orchestrate complex data pipelines using Luigi.
  • Work with Hadoop ecosystem tools and SQL databases to support storage and query optimization.
  • Deploy and manage data solutions on AWS services including EC2, S3, RDS, and EMR.
  • Monitor data pipelines and troubleshoot issues using alerting and observability tools.
  • Lead projects and coordinate delivery with stakeholders.
  • Guide and support junior team members.
  • Collaborate with cross-functional and non-technical teams to align technical work with business goals.
  • Contribute to data lake architecture and optimization efforts.

Requirements

  • 5-10 years of experience in data engineering.
  • Strong experience with Snowflake.
  • Strong programming skills in Python and Linux Bash for automation and data workflows.
  • Hands-on experience with Luigi for workflow orchestration.
  • Experience with Hadoop ecosystem tools and SQL databases.
  • In-depth knowledge of AWS EC2, S3, RDS, and EMR.
  • Familiarity with monitoring and alerting tools for data pipelines.
  • Proven ability to lead projects, communicate with stakeholders, and mentor junior team members.
  • Experience designing or optimizing data lake solutions (additional experience).
  • Understanding of data security, data governance, and compliance (additional experience).
  • Familiarity with CI/CD tools for deployment and testing automation (additional experience).
  • Knowledge of big data tools such as Spark or Hive (additional experience).
  • Background in analytics or data science (additional experience).
  • Experience collaborating with non-technical teams on business goals and technical solutions (additional experience).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Cyber Data Engineer

D2 Technical Services 11-50 IT services and consulting

D2 Technical Services is hiring a systems engineer to support national security cybersecurity operations by managing infrastructure, data pipelines, and SIEM environments.

AWS Bash Cybersecurity DHCP DNS Elasticsearch GCP Linux PowerShell Python SIEM Splunk
17 hours, 47 minutes ago

Senior DataOps Engineer

Voyager Life Sciences Tools & Services

Voyager Technologies is hiring a remote US-based DataOps Engineer to own cloud-to-data platform migration and operations for mission-critical analytics in a regulated national security environment.

Ansible Apache Airflow Apache Spark AWS Azure Cassandra CloudFormation dbt Docker Git GitHub GitHub Actions GitLab GitLab CI Kafka Kubernetes MongoDB Pandas PostgreSQL PowerShell Python Redis Scala SQLAlchemy SQL Server Terraform
18 hours, 17 minutes ago

Data Engineering Manager

Dragos 251-1K Professional Services

Dragos is seeking a Data Engineering Manager to lead the team building the core data layer that supports its cybersecurity products and threat-focused engineering work.

Agile Apache Airflow ClickHouse Cybersecurity dbt Docker Kubernetes PostgreSQL Rust SOC
18 hours, 17 minutes ago

Senior Data Engineers

Movement Labs 11-50 Media

Movement Labs is hiring Senior and Mid-level Data Engineers to support its progressive political data platform, with a focus on building and operating systems for voter outreach, experimentation, and election readiness.

Apache Airflow Dagster dbt GCP Python SQL
18 hours, 32 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers