RemoteLeaf Logo
Log in Sign up

Big Data Platform Engineer

3 weeks ago
India
Full-time
Lead
Cloud Engineer
DevOps and Infrastructure
Argo CD Azure Bash CI/CD Docker Flux Git GitOps Grafana Kubernetes Nginx OpenTelemetry PowerShell Prometheus Python Secrets Management Terraform YAML
Apply Now
TWO95 International

TWO95 International

TWO95 International is a global technology firm that specializes in providing comprehensive enterprise solutions, including BPM, Mobility, Cloud, Analytics, E-commerce, and Social Business, while also focusing on emerging technologies such as Generativ...

Internet Software & Services
51-250
Founded 2009
View All Jobs 109

Description

  • Manage and support AKS-based Big Data platform infrastructure across production environments.
  • Administer Apache NiFi, Azure Event Hub, and Azure Functions, including deployment, scaling, monitoring, and troubleshooting.
  • Implement and maintain Azure DevOps CI/CD pipelines and automated environment promotion.
  • Provision and manage infrastructure using Terraform, Bicep, and ARM Templates.
  • Monitor platform health with Azure Monitor, Log Analytics, Application Insights, and related observability tools.
  • Troubleshoot platform, Kubernetes, networking, container, and infrastructure issues.
  • Perform AKS upgrades, patching, node pool management, capacity planning, and resource optimization.
  • Implement platform security, governance, compliance, access controls, and vulnerability management.
  • Collaborate with Data Engineering teams to enable and support enterprise data platforms.
  • Support production incidents, high availability, disaster recovery, and platform reliability initiatives.

Requirements

  • 8+ years of overall IT experience.
  • 5+ years of Cloud Infrastructure Engineering experience.
  • 4+ years of experience working with Kubernetes platforms, including production AKS environments.
  • 3+ years of experience supporting enterprise-scale Data Platforms.
  • 3+ years of experience in DevOps/SRE practices.
  • 2+ years of experience with Azure Data Services.
  • Strong hands-on experience with Apache NiFi and Azure Event Hub; both are mandatory.
  • Strong expertise in AKS administration, Kubernetes networking, Azure networking, Docker, Azure Container Registry, and cluster security.
  • Experience with Azure DevOps Pipelines, YAML, Git workflows, CI/CD, Terraform, Bicep, and ARM Templates.
  • Experience with Azure Monitor, Log Analytics, KQL, Application Insights, distributed tracing, and AKS observability.
  • Experience with Azure Functions, including Function App management, scaling, Managed Identity, monitoring, and CI/CD deployment.
  • Preferred experience with NiFi Registry, service mesh technologies such as Istio, GitOps using ArgoCD or Flux, Grafana, Prometheus, OpenTelemetry, Microsoft Defender for Cloud, Azure Data Factory, Synapse Analytics, multi-region architecture, and disaster recovery.
  • Proficiency with PowerShell, Bash, or Python is preferred.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Rackner

FDA - Platform Engineer

Rackner 11-50 Internet Software & Services

Rackner is seeking a Senior Platform Engineer to own and operate a secure, cloud-native platform supporting data, analytics, and AI/ML workloads for a federal health mission in AWS GovCloud.

United States Full-time Senior Platform Engineer
Apache Airflow Apache Spark Argo CD AWS Bash CI/CD Dagster dbt DevSecOps Flux Generative AI GitLab CI GitOps Go Grafana Jenkins Kubeflow Kubernetes MLflow MLOps Presto Prometheus Python Secrets Management Terraform Trino
1 day, 22 hours ago
Kooku Recruiting Partners

CI/CD Platform Lead | HR SaaS | Top Company Kununu | Remote DE

Kooku Recruiting Partners 11-50 Professional Services

Als CI/CD Platform Lead (m/w/d) bei der GIP – Gesellschaft für innovative Personalwirtschaftssysteme mbH führst du ein DevOps-Team und entwickelst die CI/CD-Plattform für die Cloud-basierte KIDICAP®-HCM-Lösung weiter.

Germany Full-time Lead Platform Engineer
Agile Bitbucket CI/CD Docker GitLab Jenkins
2 days, 23 hours ago
Appian

Principal ML Platform Engineer

Appian 1K-5K Internet Software & Services

Appian is hiring a remote US Principal ML Platform Engineer to architect and deliver scalable, reliable AI-powered automation systems for large enterprises while influencing engineering direction across teams.

United States Full-time Lead Machine Learning Engineer Platform Engineer
$175k-$325k
AWS Azure CI/CD Docker GCP Go Java Kubernetes Microservices Python Salesforce System Design
3 days, 23 hours ago
CI&T

[Job - 31716] Cloud Architect

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Cloud Architect to redesign and migrate a client’s Azure-based data platform from an inconsistent legacy environment to a standardized Terraform-managed architecture.

Brazil Full-time Senior Cloud Engineer
Azure JIRA Snowflake Terraform
3 days, 23 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers