RemoteLeaf Logo
Log in Sign up

Python Data Engineer

3 months ago
India, Pakistan, Sri Lanka
Senior
Data Engineer
Software Development
Apache Spark Azure Celery Pandas Python Redis REST API Scikit-learn SQLAlchemy
Apply Now
Flatgigs

Flatgigs

FlatGigs tailors recruitment strategies for flat-structured companies, aligning teams with skills and culture. Utilizing tech tools for precise candidate organization.

Professional Services
View All Jobs 21

Description

  • Own the Python engine layer that powers core operational workflows for planning, rostering, dispatch, and performance analytics.
  • Build and maintain the planning engine that evaluates operational schedules, business rules, and engagement profiles to generate workforce planning demands.
  • Develop constraint-based rostering logic that creates periodic staff rosters using planning demands, certifications, and leave data from external HR systems.
  • Implement a real-time dispatch engine that assigns tasks using proximity scoring, live location data, attendance records, and operational schedules.
  • Create and maintain a performance engine that aggregates KPIs and calculates SLA scores across the platform on a scheduled basis.
  • Process large-scale operational data through event-driven and batch workflows using Celery, Azure Functions, and related infrastructure.
  • Integrate data from third-party HR and workforce management APIs, message queues, and real-time location streams.
  • Persist clean, reliable outputs to Azure SQL and manage intermediate files in Azure Blob Storage.
  • Collaborate with surrounding platform services by publishing and consuming data through Redis and Azure SQL boundaries.

Requirements

  • 5 or more years of Python backend or data engineering experience.
  • Experience with constraint solving, optimization, or scheduling algorithms such as OR-Tools, PuLP, or equivalent.
  • Strong data processing experience with large datasets using Polars, pandas, or Apache Spark.
  • Experience with task queues and async processing such as Celery, RQ, or equivalent.
  • Familiarity with Azure and Azure-based serverless or app-hosting services.
  • Comfortable working with SQL databases and writing performant queries.
  • Experience consuming REST APIs and message queues.
  • Preferred: experience with Azure Functions or equivalent serverless compute.
  • Preferred: experience with OR-Tools specifically.
  • Preferred: knowledge of scikit-learn or ML integration tools such as ONNX or Azure ML for future model support.
  • Preferred: experience with Pydantic for data validation and schema enforcement.
  • Nice to have: experience with large-scale workforce management or scheduling systems.
  • Nice to have: familiarity with SLA-based operational frameworks.
  • Nice to have: experience working in fast-paced, operationally critical environments.
  • This is a pure Python engineering role with no expectation to write TypeScript, work on the API layer, or contribute to the frontend.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

CI&T

[Job 31300] Senior Data Developer, Colombia

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Senior Data Developer to support a Digital Supply Chain Analytics team building data platforms, applications, AI agents, forecasting systems, and machine learning solutions for enterprise manufacturing and logistics operations.

Colombia Full-time Senior Data Engineer Software Engineer
Computer Vision Feature Engineering Git Machine Learning SAP SQL
9 hours, 56 minutes ago
3Pillar Global

Senior Python Software Engineer - Data Engineer

3Pillar Global 1K-5K Internet Software & Services

Software Engineer at 3Pillar Global developing data and cloud migration solutions for enterprise clients, with a focus on moving on-premise assets to Snowflake and Azure platforms.

Guatemala Full-time Senior Backend Engineer Data Engineer
Agile Apache Airflow Azure C# CI/CD dbt Django Docker FastAPI Flask Git Jenkins Kubernetes Oracle Power BI Python React Scrum Snowflake SQL SQL Server
9 hours, 56 minutes ago
CI&T

[Job-31276] Engenheiro(a) de Dados PLENO, Brasil

CI&T 5K-10K Internet Software & Services

A CI&T busca um(a) Engenheiro(a) de Dados Pleno para construir e evoluir soluções de dados em larga escala para projetos globais, utilizando Azure, Databricks e arquitetura Data Lakehouse.

Brazil Full-time Mid Level Data Engineer
Apache Spark Azure Azure Pipelines Bitbucket CI/CD Databricks Generative AI Git Oracle Python SQL SQL Server
9 hours, 56 minutes ago
CI&T

Sênior Data Developer(Azure/Databricks), Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca um Data Developer para atuar em um projeto do setor financeiro, garantindo a integridade, eficiência, governança e disponibilidade dos dados desde a ingestão até o uso por modelos de IA e áreas de negócio.

Brazil Full-time Senior Data Engineer
Apache Spark Azure CI/CD Databricks GitHub MLflow MLOps MongoDB Python SQL Teradata
10 hours, 11 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers