RemoteLeaf Logo
Log in Sign up

Python Data Engineer

2 weeks, 4 days ago
India, Pakistan, Sri Lanka
Senior
Data Engineer
Software Development
Apache Spark Azure Celery Pandas Python Redis REST API Scikit-learn SQLAlchemy
Apply Now
Flatgigs

Flatgigs

FlatGigs tailors recruitment strategies for flat-structured companies, aligning teams with skills and culture. Utilizing tech tools for precise candidate organization.

Professional Services
View All Jobs 28

Description

  • Own the Python engine layer that powers core operational workflows for planning, rostering, dispatch, and performance analytics.
  • Build and maintain the planning engine that evaluates operational schedules, business rules, and engagement profiles to generate workforce planning demands.
  • Develop constraint-based rostering logic that creates periodic staff rosters using planning demands, certifications, and leave data from external HR systems.
  • Implement a real-time dispatch engine that assigns tasks using proximity scoring, live location data, attendance records, and operational schedules.
  • Create and maintain a performance engine that aggregates KPIs and calculates SLA scores across the platform on a scheduled basis.
  • Process large-scale operational data through event-driven and batch workflows using Celery, Azure Functions, and related infrastructure.
  • Integrate data from third-party HR and workforce management APIs, message queues, and real-time location streams.
  • Persist clean, reliable outputs to Azure SQL and manage intermediate files in Azure Blob Storage.
  • Collaborate with surrounding platform services by publishing and consuming data through Redis and Azure SQL boundaries.

Requirements

  • 5 or more years of Python backend or data engineering experience.
  • Experience with constraint solving, optimization, or scheduling algorithms such as OR-Tools, PuLP, or equivalent.
  • Strong data processing experience with large datasets using Polars, pandas, or Apache Spark.
  • Experience with task queues and async processing such as Celery, RQ, or equivalent.
  • Familiarity with Azure and Azure-based serverless or app-hosting services.
  • Comfortable working with SQL databases and writing performant queries.
  • Experience consuming REST APIs and message queues.
  • Preferred: experience with Azure Functions or equivalent serverless compute.
  • Preferred: experience with OR-Tools specifically.
  • Preferred: knowledge of scikit-learn or ML integration tools such as ONNX or Azure ML for future model support.
  • Preferred: experience with Pydantic for data validation and schema enforcement.
  • Nice to have: experience with large-scale workforce management or scheduling systems.
  • Nice to have: familiarity with SLA-based operational frameworks.
  • Nice to have: experience working in fast-paced, operationally critical environments.
  • This is a pure Python engineering role with no expectation to write TypeScript, work on the API layer, or contribute to the frontend.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

PR Newswire

Lead Data Platform Engineer

PR Newswire 1K-5K Internet Software & Services

INFOnline, part of saas.group, is seeking a Lead Data Platform Engineer to own and evolve its GCP-native data platform that powers digital audience measurement for the German and Austrian media industry.

Europe Full-time Lead Data Engineer
CI/CD dbt Docker GCP Go Serverless SQL Terraform
3 hours, 18 minutes ago
U

OFSAA - Basel Technical Consultant

Unison Group Technology consulting

An experienced OFSAA Basel Technical Consultant is needed to design, develop, and support Basel regulatory reporting solutions for Oracle Financial Services Analytical Applications at a banking environment.

India Full-time Senior Database Administrator Data Engineer
3 hours, 33 minutes ago
Qonto

Data Engineer for AI Product

Qonto 1K-5K Banks

Qonto is hiring a Data Engineer for AI Product to build the data layer and production infrastructure that powers machine learning products for its finance workspace serving SMEs across Europe.

France Germany Spain Italy Full-time Senior Data Engineer
Apache Airflow Apache Spark CI/CD dbt Machine Learning Python
3 hours, 48 minutes ago
Trility Consulting

Senior Azure Data Consultant

Trility Consulting 51-250 Internet Software & Services

Trility Consulting is hiring a Senior Azure Data Consultant to work remotely with U.S. clients and lead data architecture and engineering efforts from initial discovery through production delivery.

United States Full-time Senior Data Engineer
Agile Azure CI/CD Databricks SQL
3 hours, 48 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers