RemoteLeaf Logo
Log in Sign up

Big Data Platform Engineer

1 month, 1 week ago
India
Full-time
Lead
Cloud Engineer
DevOps and Infrastructure
Argo CD Azure Bash CI/CD Docker Flux Git GitOps Grafana Kubernetes Nginx OpenTelemetry PowerShell Prometheus Python Secrets Management Terraform YAML
Apply Now
TWO95 International

TWO95 International

TWO95 International is a global technology firm that specializes in providing comprehensive enterprise solutions, including BPM, Mobility, Cloud, Analytics, E-commerce, and Social Business, while also focusing on emerging technologies such as Generativ...

Internet Software & Services
51-250
Founded 2009
View All Jobs 112

Description

  • Manage and support AKS-based Big Data platform infrastructure across production environments.
  • Administer Apache NiFi, Azure Event Hub, and Azure Functions, including deployment, scaling, monitoring, and troubleshooting.
  • Implement and maintain Azure DevOps CI/CD pipelines and automated environment promotion.
  • Provision and manage infrastructure using Terraform, Bicep, and ARM Templates.
  • Monitor platform health with Azure Monitor, Log Analytics, Application Insights, and related observability tools.
  • Troubleshoot platform, Kubernetes, networking, container, and infrastructure issues.
  • Perform AKS upgrades, patching, node pool management, capacity planning, and resource optimization.
  • Implement platform security, governance, compliance, access controls, and vulnerability management.
  • Collaborate with Data Engineering teams to enable and support enterprise data platforms.
  • Support production incidents, high availability, disaster recovery, and platform reliability initiatives.

Requirements

  • 8+ years of overall IT experience.
  • 5+ years of Cloud Infrastructure Engineering experience.
  • 4+ years of experience working with Kubernetes platforms, including production AKS environments.
  • 3+ years of experience supporting enterprise-scale Data Platforms.
  • 3+ years of experience in DevOps/SRE practices.
  • 2+ years of experience with Azure Data Services.
  • Strong hands-on experience with Apache NiFi and Azure Event Hub; both are mandatory.
  • Strong expertise in AKS administration, Kubernetes networking, Azure networking, Docker, Azure Container Registry, and cluster security.
  • Experience with Azure DevOps Pipelines, YAML, Git workflows, CI/CD, Terraform, Bicep, and ARM Templates.
  • Experience with Azure Monitor, Log Analytics, KQL, Application Insights, distributed tracing, and AKS observability.
  • Experience with Azure Functions, including Function App management, scaling, Managed Identity, monitoring, and CI/CD deployment.
  • Preferred experience with NiFi Registry, service mesh technologies such as Istio, GitOps using ArgoCD or Flux, Grafana, Prometheus, OpenTelemetry, Microsoft Defender for Cloud, Azure Data Factory, Synapse Analytics, multi-region architecture, and disaster recovery.
  • Proficiency with PowerShell, Bash, or Python is preferred.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Dijital Team

Senior Microsoft Cloud Engineer

Dijital Team 11-50 Internet Software & Services

Join an established managed technology services provider as a Senior Microsoft Cloud Engineer, serving as the Level 3 escalation lead for Microsoft 365, Azure, and modern cloud infrastructure while delivering customer projects and developing the engineering team.

Sri Lanka Full-time Senior Cloud Engineer
Active Directory Azure Cloudflare Cybersecurity DHCP DNS PowerShell TCP/IP Windows Server
3 hours, 18 minutes ago
CI&T

[Job-31961] Data Developer Sênior - Cloud DB Specialist, Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca um Cloud Data Developer Sênior para liderar a arquitetura e execução da migração de bancos de dados on-premises para o Azure em um projeto estratégico de modernização de infraestrutura para um cliente do setor de saúde.

Brazil Full-time Senior Cloud Engineer Database Administrator
Agile Azure CI/CD Kanban Microservices Scrum
3 hours, 18 minutes ago
CoreView

Cloud Engineer

CoreView 51-250 Internet Software & Services

CoreView is hiring a Cloud Engineer in Milan, Italy, to build and operate its Azure-based, cloud-native Microsoft 365 resilience platform and improve application delivery, reliability, security, and performance.

Italy Mid Level Cloud Engineer
Ansible Argo CD Azure Bash CI/CD DevSecOps Docker Flux Git GitHub Actions GitLab CI GitOps Grafana Helm Kubernetes Linux PowerShell Prometheus Python RabbitMQ Redis Secrets Management Terraform Windows Server
3 hours, 33 minutes ago
PHIZENIX

Atlassian Cloud Migration Engineer

PHIZENIX 11-50 information technology & services

Atlassian Cloud Migration Engineer supporting a client’s transition of Jira and Confluence from Server/Data Center to Atlassian Cloud, with ownership of migration workstreams and ScriptRunner remediation.

United States Senior Cloud Engineer
Confluence Groovy JIRA
1 day, 3 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers