3Pillar Global

3Pillar Global

3Pillar Global is an innovative product development company that builds breakthrough software products to power digital businesses. They offer a range of services including product strategy, management, user experience design, and software engineering ...

Internet Software & Services
1K-5K
Founded 2006
$26M raised

Description

  • Collaborate with U.S.-based client stakeholders to define and design data solutions.
  • Translate business requirements into technical specifications and actionable work.
  • Write code and implement data engineering solutions.
  • Create and manage versioned data pipelines with change management controls.
  • Develop ETL and ELT processes to extract and transform data from multiple sources.
  • Design, build, and maintain batch and real-time data pipelines in production.
  • Automate data workflows for ingestion, aggregation, and ETL processing.
  • Add logging and instrumentation to pipelines and services.
  • Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
  • Guide other data engineers and help drive technical execution.

Requirements

  • 5+ years of experience as a data engineer or in a similar role.
  • Advanced SQL skills with experience in relational databases and database design.
  • Experience with cloud data warehouse solutions such as Snowflake, Redshift, BigQuery, or Azure Synapse.
  • Strong Python skills with hands-on experience using Pandas, NumPy, and related data libraries.
  • Experience with big data technologies such as Spark, MapReduce, Hadoop, or Hive.
  • Proficiency with data pipeline and workflow management tools such as Airflow.
  • Experience with data visualization tools such as Power BI, Tableau, or AWS QuickSight.
  • Experience with AWS, Azure, or GCP data engineering services.
  • Knowledge of AWS services such as S3, Lambda, EMR, Glue ETL, Athena, RDS, Redshift, EC2, and IAM, or Azure services such as ADF, Azure Synapse Analytics, ADLS Gen2, and Azure SQL DB.
  • Strong experience with data lakes and data warehouse solutions.
  • Excellent problem-solving, communication, and organizational skills.
  • Ability to work independently and as part of a team.
  • Ability to guide other data engineers.
  • High level of English proficiency to interact directly with U.S.-based clients.
  • Java and Java-based frameworks such as Spring, Spring Boot, Hibernate, or Apache are desired.
  • Good understanding of NoSQL databases such as Redis is desired.

Benefits

  • Medical insurance benefits as per company policy.
  • Life insurance as per company policy.
  • 15 days of paid vacation, plus sick leave and paid holidays as per local law.
  • Paternity and maternity leave as per local law.
  • Marriage, bereavement, and graduation leave as per company policy.
  • Christmas and mid-year bonuses as per local law.
  • Monthly productivity bonus as per local law.
  • Paid professional certifications.
  • Flexible remote-first work environment.
  • Fitness offerings and mental health plans, country-dependent.
  • Generous time off and dedicated wellbeing focus.
  • Direct deposit of payroll.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Data Engineer ( min 4+ years of experience in Python, Snowflake & DBT)

Outreach 1K-5K Internet Software & Services

Outreach is hiring a Senior Data Engineer for its Business Systems team in Hyderabad to build and optimize data pipelines, models, and analytics infrastructure that support finance, analytics, support systems, and broader revenue operations.

Apache Airflow Apache Spark AWS Databricks dbt GitHub Kafka Microservices Python RabbitMQ Snowflake
8 hours, 10 minutes ago

Data Engineer

Softeta 51-250 Internet Software & Services

Softeta is seeking a Senior Data Engineer for a banking client to design and improve data systems that support ingestion, processing, storage, and integration in a high-stakes financial environment.

Agile Apache Airflow Apache Spark AWS Azure dbt Docker GCP Kafka Kubernetes Python Scrum Snowflake SQL
8 hours, 10 minutes ago

[Job 29938] Senior Data Developer (Python/ AWS)

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Senior Data Developer in Brazil to build and improve scalable data ingestion and orchestration solutions for large-scale data workloads in a remote/home office setting.

Apache Spark AWS Datadog Generative AI Kafka Python
8 hours, 25 minutes ago

Data scraping

Distro 11-50 Internet Software & Services

Solvo Global is hiring a full-time remote Data Scraping Specialist in Bogotá to collect, organize, and normalize public and government data into reliable formats.

FTP Git HTTP PostgreSQL Python
8 hours, 25 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers