RemoteLeaf Logo
Log in Sign up

Python Data Engineer

4 months, 2 weeks ago
India, Pakistan, Sri Lanka
Senior
Data Engineer
Software Development
Apache Spark Azure Celery Pandas Python Redis REST API Scikit-learn SQLAlchemy
Apply Now
Flatgigs

Flatgigs

FlatGigs tailors recruitment strategies for flat-structured companies, aligning teams with skills and culture. Utilizing tech tools for precise candidate organization.

Professional Services
View All Jobs 20

Description

  • Own the Python engine layer that powers core operational workflows for planning, rostering, dispatch, and performance analytics.
  • Build and maintain the planning engine that evaluates operational schedules, business rules, and engagement profiles to generate workforce planning demands.
  • Develop constraint-based rostering logic that creates periodic staff rosters using planning demands, certifications, and leave data from external HR systems.
  • Implement a real-time dispatch engine that assigns tasks using proximity scoring, live location data, attendance records, and operational schedules.
  • Create and maintain a performance engine that aggregates KPIs and calculates SLA scores across the platform on a scheduled basis.
  • Process large-scale operational data through event-driven and batch workflows using Celery, Azure Functions, and related infrastructure.
  • Integrate data from third-party HR and workforce management APIs, message queues, and real-time location streams.
  • Persist clean, reliable outputs to Azure SQL and manage intermediate files in Azure Blob Storage.
  • Collaborate with surrounding platform services by publishing and consuming data through Redis and Azure SQL boundaries.

Requirements

  • 5 or more years of Python backend or data engineering experience.
  • Experience with constraint solving, optimization, or scheduling algorithms such as OR-Tools, PuLP, or equivalent.
  • Strong data processing experience with large datasets using Polars, pandas, or Apache Spark.
  • Experience with task queues and async processing such as Celery, RQ, or equivalent.
  • Familiarity with Azure and Azure-based serverless or app-hosting services.
  • Comfortable working with SQL databases and writing performant queries.
  • Experience consuming REST APIs and message queues.
  • Preferred: experience with Azure Functions or equivalent serverless compute.
  • Preferred: experience with OR-Tools specifically.
  • Preferred: knowledge of scikit-learn or ML integration tools such as ONNX or Azure ML for future model support.
  • Preferred: experience with Pydantic for data validation and schema enforcement.
  • Nice to have: experience with large-scale workforce management or scheduling systems.
  • Nice to have: familiarity with SLA-based operational frameworks.
  • Nice to have: experience working in fast-paced, operationally critical environments.
  • This is a pure Python engineering role with no expectation to write TypeScript, work on the API layer, or contribute to the frontend.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

RevStar

Databricks Engineer

RevStar 51-250 Internet Software & Services

RevStar is seeking a remote, US-based Databricks Engineer to build and optimize cloud-agnostic Lakehouse data pipelines and MLOps frameworks for enterprise AI projects across AWS, Azure, and GCP.

United States Mexico Argentina Brazil Chile Colombia Venezuela Contract Mid Level Data Engineer
Agile Apache Airflow Apache Spark AWS Azure CI/CD Databricks Feature Engineering HIPAA Kafka MLflow MLOps Prefect Python SQL Terraform
4 hours, 57 minutes ago
phData

Senior Data Engineer

phData 251-1K IT Services

Data Engineer at phData, a remote-first global data and AI consultancy, designing and delivering secure, scalable cloud data solutions for enterprise clients.

India Full-time Mid Level Data Engineer
Apache Airflow Apache Spark AWS Azure Cassandra Databricks dbt Elasticsearch GCP Hadoop HDFS Kafka Luigi Python REST API Scala Snowflake Solr SQL System Design
1 day, 4 hours ago
Abacus Insights

Forward Deployed Data Engineer

Abacus Insights 51-250 Insurance

Abacus Insights is hiring a Forward Deployed Data Engineer to work alongside health plan clients, building governed data foundations, pipelines, and integrations that turn fragmented payer data into analytics-ready products.

United States Full-time Senior Data Engineer
Apache Spark Databricks Snowflake SQL
1 day, 4 hours ago
Azumo

Data Engineer

Azumo 51-250 Internet Software & Services

Azumo is hiring a fully remote Latin America-based Data Engineer to build and operate production ingestion, transformation, storage, warehouse, and retrieval infrastructure that supports client AI systems.

Mexico Argentina Brazil Chile Colombia Peru Full-time Senior Data Engineer
Apache Airflow Apache Spark AWS Azure CI/CD Dagster Databricks dbt Docker Flink GCP Git GitHub Actions HIPAA Jupyter Kafka Prefect Python Snowflake SQL Terraform
1 day, 4 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers