RemoteLeaf Logo
Log in Sign up

Python Data Engineer

2 months ago
India, Pakistan, Sri Lanka
Senior
Data Engineer
Software Development
Apache Spark Azure Celery Pandas Python Redis REST API Scikit-learn SQLAlchemy
Apply Now
Flatgigs

Flatgigs

FlatGigs tailors recruitment strategies for flat-structured companies, aligning teams with skills and culture. Utilizing tech tools for precise candidate organization.

Professional Services
View All Jobs 25

Description

  • Own the Python engine layer that powers core operational workflows for planning, rostering, dispatch, and performance analytics.
  • Build and maintain the planning engine that evaluates operational schedules, business rules, and engagement profiles to generate workforce planning demands.
  • Develop constraint-based rostering logic that creates periodic staff rosters using planning demands, certifications, and leave data from external HR systems.
  • Implement a real-time dispatch engine that assigns tasks using proximity scoring, live location data, attendance records, and operational schedules.
  • Create and maintain a performance engine that aggregates KPIs and calculates SLA scores across the platform on a scheduled basis.
  • Process large-scale operational data through event-driven and batch workflows using Celery, Azure Functions, and related infrastructure.
  • Integrate data from third-party HR and workforce management APIs, message queues, and real-time location streams.
  • Persist clean, reliable outputs to Azure SQL and manage intermediate files in Azure Blob Storage.
  • Collaborate with surrounding platform services by publishing and consuming data through Redis and Azure SQL boundaries.

Requirements

  • 5 or more years of Python backend or data engineering experience.
  • Experience with constraint solving, optimization, or scheduling algorithms such as OR-Tools, PuLP, or equivalent.
  • Strong data processing experience with large datasets using Polars, pandas, or Apache Spark.
  • Experience with task queues and async processing such as Celery, RQ, or equivalent.
  • Familiarity with Azure and Azure-based serverless or app-hosting services.
  • Comfortable working with SQL databases and writing performant queries.
  • Experience consuming REST APIs and message queues.
  • Preferred: experience with Azure Functions or equivalent serverless compute.
  • Preferred: experience with OR-Tools specifically.
  • Preferred: knowledge of scikit-learn or ML integration tools such as ONNX or Azure ML for future model support.
  • Preferred: experience with Pydantic for data validation and schema enforcement.
  • Nice to have: experience with large-scale workforce management or scheduling systems.
  • Nice to have: familiarity with SLA-based operational frameworks.
  • Nice to have: experience working in fast-paced, operationally critical environments.
  • This is a pure Python engineering role with no expectation to write TypeScript, work on the API layer, or contribute to the frontend.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Accenture

Data Conversion Developer

Accenture 100K+ Professional Services

Accenture Federal Services is seeking a Data Conversion Developer to support migration of legacy enterprise data into Oracle Cloud ERP for federal mission systems.

United States Full-time Mid Level Data Engineer
$100k-$203k
SQL
2 hours, 11 minutes ago
D

Cyber Data Engineer

D2 Technical Services 11-50 IT services and consulting

D2 Technical Services is hiring a systems engineer to support national security cybersecurity operations by managing infrastructure, data pipelines, and SIEM environments.

United States Full-time Senior Data Engineer Security Engineer
$140k-$145k
AWS Bash Cybersecurity DHCP DNS Elasticsearch GCP Linux PowerShell Python SIEM Splunk
1 day, 1 hour ago
Voyager

Senior DataOps Engineer

Voyager Life Sciences Tools & Services

Voyager Technologies is hiring a remote US-based DataOps Engineer to own cloud-to-data platform migration and operations for mission-critical analytics in a regulated national security environment.

United States Full-time Senior Data Engineer
$150k-$180k
Ansible Apache Airflow Apache Spark AWS Azure Cassandra CloudFormation dbt Docker Git GitHub GitHub Actions GitLab GitLab CI Kafka Kubernetes MongoDB Pandas PostgreSQL PowerShell Python Redis Scala SQLAlchemy SQL Server Terraform
1 day, 1 hour ago
Dragos

Data Engineering Manager

Dragos 251-1K Professional Services

Dragos is seeking a Data Engineering Manager to lead the team building the core data layer that supports its cybersecurity products and threat-focused engineering work.

United States Full-time Lead Data Engineer Engineering Manager
$220k-$220k
Agile Apache Airflow ClickHouse Cybersecurity dbt Docker Kubernetes PostgreSQL Rust SOC
1 day, 1 hour ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers