3Pillar Global

3Pillar Global

3Pillar Global is an innovative product development company that builds breakthrough software products to power digital businesses. They offer a range of services including product strategy, management, user experience design, and software engineering ...

Internet Software & Services
1K-5K
Founded 2006
$26M raised

Description

  • Design, build, and maintain data engineering solutions centered on Snowflake.
  • Develop Python and Linux Bash scripts to automate data workflows.
  • Orchestrate complex data pipelines using Luigi.
  • Work with Hadoop ecosystem tools and SQL databases to support storage and query optimization.
  • Deploy and manage data solutions on AWS services including EC2, S3, RDS, and EMR.
  • Monitor data pipelines and troubleshoot issues using alerting and observability tools.
  • Lead projects and coordinate delivery with stakeholders.
  • Guide and support junior team members.
  • Collaborate with cross-functional and non-technical teams to align technical work with business goals.
  • Contribute to data lake architecture and optimization efforts.

Requirements

  • 5-10 years of experience in data engineering.
  • Strong experience with Snowflake.
  • Strong programming skills in Python and Linux Bash for automation and data workflows.
  • Hands-on experience with Luigi for workflow orchestration.
  • Experience with Hadoop ecosystem tools and SQL databases.
  • In-depth knowledge of AWS EC2, S3, RDS, and EMR.
  • Familiarity with monitoring and alerting tools for data pipelines.
  • Proven ability to lead projects, communicate with stakeholders, and mentor junior team members.
  • Experience designing or optimizing data lake solutions (additional experience).
  • Understanding of data security, data governance, and compliance (additional experience).
  • Familiarity with CI/CD tools for deployment and testing automation (additional experience).
  • Knowledge of big data tools such as Spark or Hive (additional experience).
  • Background in analytics or data science (additional experience).
  • Experience collaborating with non-technical teams on business goals and technical solutions (additional experience).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Python Data Engineer

Flatgigs Professional Services

FlatGigs is hiring a Python Data Engineer to build and maintain reliable, scalable data pipelines and ETL workflows that support analytics and data-driven decision-making.

Apache Airflow AWS Azure Docker GCP Kubernetes MongoDB NumPy Pandas PostgreSQL Python SQL
1 hour, 25 minutes ago

Senior Software Engineer - Data Integration & JVM Ecosystem

ClickHouse 51-250 IT Services

ClickHouse is hiring a Senior Software Engineer to own JVM-based data connectors and integrations that connect its high-performance analytics platform to the broader data ecosystem.

Apache Airflow Apache Spark ClickHouse dbt Grafana HTTP Java Kafka Metabase Pandas Power BI Python SQL Tableau TCP/IP
2 hours, 43 minutes ago

SAP BW Lead

Lingaro 5K-10K IT Services

SAP BW Lead for Poland’s CC Data Engineering & Management team at SAP, responsible for leading SAP BW-related data engineering work in a full-time remote role.

4 hours, 2 minutes ago

Lead Data / Rating Engineer

Alex Staff Agency 11-50 Professional Services

Rating Production Lead at a product company building scalable rating systems to improve creator monetization and information navigation, with the goal of turning existing algorithms and data methods into a production-ready system.

Machine Learning Python SQL Statistics
5 hours, 21 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers