AWS Data Engineer - Fully Remote - US Only

1 week, 2 days ago
Full-time
Senior
DevOps and Infrastructure
Scalepex

Scalepex

Scalepex is a transformational consulting company with over 21 years of experience in managing and developing human capital. They provide onshore and nearshore BPO services, focusing on aligning with client growth strategies and delivering impactful ta...

Professional Services
51-250
Founded 2021

Description

  • Design and build scalable, reliable data pipelines using AWS services such as Glue, S3, and Redshift.
  • Orchestrate data workflows using AWS Step Functions, with Airflow as an acceptable alternative.
  • Develop ETL and ELT processes using PySpark, Python, and Pandas to clean, transform, and integrate data from multiple sources.
  • Apply distributed systems expertise to ensure reliability, scalability, and performance for large-scale utility data.
  • Build serverless data-processing solutions using AWS Lambda.
  • Design data models for utilities use cases such as energy consumption forecasting and advanced analytics.
  • Monitor and optimize data pipeline performance to reduce latency, improve throughput, and maintain high availability.
  • Implement security and compliance measures to protect sensitive utility data and meet industry regulations.

Requirements

  • At least 5 years of experience in data engineering.
  • Proficiency with AWS services including Step Functions, Lambda, Glue, S3, DynamoDB, and Redshift.
  • Strong programming skills in Python, with experience using PySpark and Pandas for large-scale data processing.
  • Hands-on experience with distributed systems and scalable architectures.
  • Knowledge of ETL and ELT processes for integrating diverse datasets into centralized systems.
  • Familiarity with utilities-specific datasets such as smart meters and energy grids is highly desirable.
  • Strong analytical skills with the ability to work on unstructured datasets.
  • Knowledge of data governance practices to ensure accuracy, consistency, and security of data.
  • Ability to work independently and collaborate with cross-functional teams and business stakeholders.
  • Ability to obtain and maintain the required clearance for this role.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Sr. Data Engineer I (6436)

MetroStar 251-1K IT Services

MetroStar is hiring a Sr. Data Engineer I to support an enterprise AI-enabled financial compliance initiative for the Department of War, building the data foundation for compliance modernization across 180+ systems.

PostgreSQL Python SQLAlchemy XML YAML
1 day, 6 hours ago

Staff Software Engineer - Product Analytics

Datadog 5K-10K IT Services

Datadog is hiring a Staff Engineer to lead the backend technical direction for its Product Analytics platform, building systems that help customers analyze user behavior, retention, and growth at scale.

SQL
1 day, 6 hours ago

Senior Staff Data Engineer

SoFi 1K-5K Capital Markets

SoFi is seeking a Senior Staff Data Engineer to lead the architecture and evolution of its AI-powered Data Platform, advancing data reliability, governance, and scalable data experiences for members.

Apache Airflow Apache Spark AWS GCP GitLab Hadoop Kafka Python Snowflake SQL
1 day, 6 hours ago

Principal Engineer, Ads Measurement

Unity 5K-10K Internet Software & Services

Unity is hiring a Principal Engineer for Ads Measurement to lead the development of self-attribution and install measurement systems that help the company independently evaluate ad performance and support optimization across its ads platform.

C++ Go Java
1 day, 6 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers