Hadoop developer

3 weeks, 2 days ago
Contract
Senior
Data Science and Analytics
TWO95 International

TWO95 International

TWO95 International is a global technology firm that specializes in providing comprehensive enterprise solutions, including BPM, Mobility, Cloud, Analytics, E-commerce, and Social Business, while also focusing on emerging technologies such as Generativ...

Internet Software & Services
51-250
Founded 2009

Description

  • Design, develop, and maintain Hadoop-based data processes and integrations within the database environment.
  • Maintain and monitor the Hadoop environment, including cluster health, performance, and overall functionality.
  • Identify and remediate vulnerabilities and resolve OS-level issues affecting Hadoop nodes.
  • Monitor Hadoop clusters and functionality to support data migration activities and ensure successful data transfers.
  • Develop, run, and troubleshoot ETL pipelines to process and transform data for downstream systems.
  • Participate in Hadoop deployments and migrations, including planning, execution, and validation.
  • Support and troubleshoot data warehouse issues and handle erroneous or dirty data to ensure data quality.
  • Collaborate with enterprise stakeholders and support a large number of users by addressing operational and access issues.

Requirements

  • 5+ years of experience as a Hadoop Developer.
  • 2+ years of experience with Python and demonstrated ETL experience.
  • Proven experience maintaining and monitoring Hadoop environments, including addressing vulnerabilities and OS issues.
  • Previous experience with Hadoop deployments and migrations.
  • Prior experience working in an enterprise environment with a large number of users.
  • Experience working with data warehouses and managing/cleaning erroneous data.
  • Willingness to work as a W2 contractor on a contract-to-hire engagement.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Platform Engineer

Lola Blankets 1-10 Textiles, Apparel & Luxury Goods

Lola Blankets is hiring a Data Platform Engineer to own its analytics platform and support engineering work across product, operations, integrations, and platform reliability.

Apache Airflow Dagster dbt LLM Prefect Python Snowflake SQL TypeScript
5 hours, 26 minutes ago

Oracle Data Engineer (with German Language)

Soname Solutions 11-50 Internet Software & Services

Soname Solutions is seeking a Senior Data Warehouse Developer to support a German telecom client by designing, optimizing, and evolving its multi-layer data warehouse environment.

Oracle PostgreSQL Power BI SQL
7 hours, 29 minutes ago

Synthetic Data Engineer (AI Data/Training)

Hyphen Connect 1-10 staffing & recruiting

A Synthetic Data Engineer at the organization will design and manage domain-specific synthetic data pipelines that support data processing and model training workflows.

Apache Airflow Apache Spark
8 hours, 1 minute ago

Senior Data Engineer

Alpaca 51-250 Capital Markets

Alpaca is seeking a Senior Data Platform Engineer to build and operate the data management layer for its global brokerage infrastructure as it scales across customers, jurisdictions, and high-volume financial event streams.

Apache Airflow dbt Docker GCP Helm Kafka Kubernetes Python SQL Terraform Trino
9 hours, 48 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers