Hadoop developer

2 months ago
Contract
Senior
Data Science and Analytics
TWO95 International

TWO95 International

TWO95 International is a global technology firm that specializes in providing comprehensive enterprise solutions, including BPM, Mobility, Cloud, Analytics, E-commerce, and Social Business, while also focusing on emerging technologies such as Generativ...

Internet Software & Services
51-250
Founded 2009

Description

  • Design, develop, and maintain Hadoop-based data processes and integrations within the database environment.
  • Maintain and monitor the Hadoop environment, including cluster health, performance, and overall functionality.
  • Identify and remediate vulnerabilities and resolve OS-level issues affecting Hadoop nodes.
  • Monitor Hadoop clusters and functionality to support data migration activities and ensure successful data transfers.
  • Develop, run, and troubleshoot ETL pipelines to process and transform data for downstream systems.
  • Participate in Hadoop deployments and migrations, including planning, execution, and validation.
  • Support and troubleshoot data warehouse issues and handle erroneous or dirty data to ensure data quality.
  • Collaborate with enterprise stakeholders and support a large number of users by addressing operational and access issues.

Requirements

  • 5+ years of experience as a Hadoop Developer.
  • 2+ years of experience with Python and demonstrated ETL experience.
  • Proven experience maintaining and monitoring Hadoop environments, including addressing vulnerabilities and OS issues.
  • Previous experience with Hadoop deployments and migrations.
  • Prior experience working in an enterprise environment with a large number of users.
  • Experience working with data warehouses and managing/cleaning erroneous data.
  • Willingness to work as a W2 contractor on a contract-to-hire engagement.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Lead Data Platform Engineer

PR Newswire 1K-5K Internet Software & Services

INFOnline, part of saas.group, is seeking a Lead Data Platform Engineer to own and evolve its GCP-native data platform that powers digital audience measurement for the German and Austrian media industry.

CI/CD dbt Docker GCP Go Serverless SQL Terraform
7 hours, 57 minutes ago

OFSAA - Basel Technical Consultant

Unison Group Technology consulting

An experienced OFSAA Basel Technical Consultant is needed to design, develop, and support Basel regulatory reporting solutions for Oracle Financial Services Analytical Applications at a banking environment.

8 hours, 12 minutes ago

Data Engineer for AI Product

Qonto 1K-5K Banks

Qonto is hiring a Data Engineer for AI Product to build the data layer and production infrastructure that powers machine learning products for its finance workspace serving SMEs across Europe.

Apache Airflow Apache Spark CI/CD dbt Machine Learning Python
8 hours, 27 minutes ago

Senior Azure Data Consultant

Trility Consulting 51-250 Internet Software & Services

Trility Consulting is hiring a Senior Azure Data Consultant to work remotely with U.S. clients and lead data architecture and engineering efforts from initial discovery through production delivery.

Agile Azure CI/CD Databricks SQL
8 hours, 27 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers