RemoteLeaf Logo
Log in Sign up

Python Data Engineer

1 month, 1 week ago
India, Pakistan, Sri Lanka
Senior
Data Engineer
Software Development
Apache Spark Azure Celery Pandas Python Redis REST API Scikit-learn SQLAlchemy
Apply Now
Flatgigs

Flatgigs

FlatGigs tailors recruitment strategies for flat-structured companies, aligning teams with skills and culture. Utilizing tech tools for precise candidate organization.

Professional Services
View All Jobs 26

Description

  • Own the Python engine layer that powers core operational workflows for planning, rostering, dispatch, and performance analytics.
  • Build and maintain the planning engine that evaluates operational schedules, business rules, and engagement profiles to generate workforce planning demands.
  • Develop constraint-based rostering logic that creates periodic staff rosters using planning demands, certifications, and leave data from external HR systems.
  • Implement a real-time dispatch engine that assigns tasks using proximity scoring, live location data, attendance records, and operational schedules.
  • Create and maintain a performance engine that aggregates KPIs and calculates SLA scores across the platform on a scheduled basis.
  • Process large-scale operational data through event-driven and batch workflows using Celery, Azure Functions, and related infrastructure.
  • Integrate data from third-party HR and workforce management APIs, message queues, and real-time location streams.
  • Persist clean, reliable outputs to Azure SQL and manage intermediate files in Azure Blob Storage.
  • Collaborate with surrounding platform services by publishing and consuming data through Redis and Azure SQL boundaries.

Requirements

  • 5 or more years of Python backend or data engineering experience.
  • Experience with constraint solving, optimization, or scheduling algorithms such as OR-Tools, PuLP, or equivalent.
  • Strong data processing experience with large datasets using Polars, pandas, or Apache Spark.
  • Experience with task queues and async processing such as Celery, RQ, or equivalent.
  • Familiarity with Azure and Azure-based serverless or app-hosting services.
  • Comfortable working with SQL databases and writing performant queries.
  • Experience consuming REST APIs and message queues.
  • Preferred: experience with Azure Functions or equivalent serverless compute.
  • Preferred: experience with OR-Tools specifically.
  • Preferred: knowledge of scikit-learn or ML integration tools such as ONNX or Azure ML for future model support.
  • Preferred: experience with Pydantic for data validation and schema enforcement.
  • Nice to have: experience with large-scale workforce management or scheduling systems.
  • Nice to have: familiarity with SLA-based operational frameworks.
  • Nice to have: experience working in fast-paced, operationally critical environments.
  • This is a pure Python engineering role with no expectation to write TypeScript, work on the API layer, or contribute to the frontend.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Career TEAM

Data Conversion Software Engineer

Career TEAM 251-1K Professional Services

Career Team is hiring a Data Conversion Software Engineer to build data transformation and integration software for government-funded workforce development programs across the United States.

United States Full-time Mid Level Data Engineer Software Engineer
$60k-$100k
Agile Angular CI/CD Docker Express.js JavaScript JSON MongoDB NestJS Next.js Node.js React Scrum TypeScript XML
12 hours, 59 minutes ago
TWO95 International

Sr. Associate Data Platform - Remote

TWO95 International 51-250 Internet Software & Services

Sr. Associate Data Platform is a contract role with a Los Angeles-based team supporting Adobe analytics and data platform implementation work across on-site and remote locations.

United States Contract Senior Data Engineer
CSS Digital Marketing HTML JavaScript jQuery Vue.js
13 hours, 14 minutes ago
Mindrift.ai: Be the “I” in AI

Freelance Data Scraping Engineer (Python)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a part-time remote Python Data Scraping Engineer for the Tendem project to deliver accurate, structured data extraction and processing within a hybrid AI-plus-human workflow.

Kuwait Qatar Saudi Arabia Turkey Israel Jordan Part-time Junior Backend Engineer Data Engineer
Up to $37k
AJAX GitHub JavaScript JSON LLM Python Selenium
13 hours, 14 minutes ago
Mindrift.ai: Be the “I” in AI

Freelance Data Scraping Engineer (Python)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a part-time freelance Python Data Scraping Engineer for the Tendem project to build and oversee data extraction workflows in a hybrid AI + human environment.

United States Part-time Mid Level Backend Engineer Data Engineer
AJAX GitHub JavaScript JSON LLM Python Selenium
13 hours, 14 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers