Sand Technologies

Sand Technologies is a leading provider of enterprise AI solutions, offering cutting-edge technology to solve complex challenges. With a focus on outcomes over hype, we work with global enterprises to identify meaningful AI use cases, develop custom al...

Internet Software & Services

Information Technology

4 open positions

Links

View All Jobs

Senior Data Engineer

14 hours, 47 minutes ago

South Africa

Full-time

Senior

Data Engineer

Software Development

Apache Spark Azure Databricks Flink IoT Kafka Machine Learning MQTT Python SFTP SQL

Apply Now

Sand Technologies

Internet Software & Services

View All Jobs 4

Description

Design and build reusable data ingestion pipelines from operational source systems into the Azure data platform.
Define canonical data models and transformation logic for analytical indices and the intelligence layer.
Design high-performance schemas using lakehouse patterns for storage, retrieval, and analysis.
Establish and document ingestion and modelling standards that other engineers can reuse consistently.
Partner with client data owners, stewards, and enterprise architects to agree access, security, and integration approaches.
Own data quality, lineage, observability, and pipeline reliability across the platform.
Implement governance and security controls appropriate for a regulated critical-infrastructure environment.
Mentor and unblock mid-level and junior data engineers and review their work.
Promote engineering best practice across the squad.
Contribute across a portfolio of water and energy utility clients as the platform grows.

Requirements

Proven experience as a Senior Data Engineer with hands-on production pipeline and data architecture experience.
Strong commercial experience with the Azure data platform, such as Data Factory, Synapse, Fabric, ADLS, or Databricks.
Expert-level SQL and Python skills.
Solid data modelling experience across dimensional and/or lakehouse patterns.
Experience integrating heterogeneous source data via API, file transfer, batch, or streaming.
Experience setting standards and patterns and mentoring or leading other engineers.
Ability to work directly with client data owners, stewards, and architects and communicate with non-technical stakeholders.
Knowledge of data governance, quality frameworks, and security practices in regulated environments.
Exposure to operational technology (OT)/SCADA, IoT/asset telemetry, or MQTT systems is desirable.
Utilities, water, or other asset-intensive industry experience is desirable.
Experience with Kafka, Spark/Spark Streaming, or Flink is desirable.
Understanding of machine learning workflows and how to support them with robust data pipelines is desirable.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Sr. Data Engineer

Bloomerang 251-1K Specialized Consumer Services

Bloomerang is hiring a Senior Data Engineer to build and harden the unified data foundation behind its nonprofit giving platform, powering analytics, reporting, and AI products.

United States Canada Full-time Senior Data Engineer

$108k-$181k

Apache Spark AWS CI/CD CRM Databricks dbt GCP Honeycomb Kafka Machine Learning MLflow OpenTelemetry Python Scala Snowflake SQL

15 hours, 2 minutes ago

Apply

15 hours, 2 minutes ago

Data Engineering Manager

Redwood Materials 251-1K Industrial Conglomerates

Redwood Materials is hiring a Data Engineering Manager to lead its data engineering and analytics team, own the data platform roadmap, and support the company’s battery supply chain operations through reliable data systems.

United States Full-time Lead Data Engineer

AWS AWS CDK Kubernetes Python SQL Trino

15 hours, 2 minutes ago

Apply

15 hours, 2 minutes ago