Data Engineer

9 hours, 9 minutes ago
Full-time
Senior
Software Development
Creative Chaos

Creative Chaos

Creative Chaos is an integrated technology innovation firm that helps startups and enterprises bring their ideas to life through web, mobile, and IoT solutions.

Internet Software & Services
251-1K
Founded 2000

Description

  • Design and implement robust data pipeline solutions within Azure Data Lake.
  • Integrate and transform data from various sources to enable comprehensive analytics and reporting.
  • Develop and maintain ETL processes and data warehousing solutions.
  • Ensure data quality and integrity and implement data governance practices.
  • Collaborate with cross-functional teams to understand data requirements and develop scalable solutions.
  • Monitor and optimize data processing workflows for performance and reliability.
  • Document processes and architecture to ensure maintainability and scalability.
  • Stay abreast of new Azure technologies and best practices for data engineering.

Requirements

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Minimum of 5 years of experience working as a Data Engineer, with a strong emphasis on Azure Data Lake.
  • Proficiency in Azure Data Services, particularly Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics.
  • Demonstrated experience with data modeling, ETL processes, and data warehousing solutions.
  • Strong programming skills in Python and SQL, and familiarity with Java or C#.
  • Knowledge of data quality assurance and data governance practices.
  • Excellent problem-solving skills and a detail-oriented approach.
  • Ability to communicate technical concepts clearly to non-technical stakeholders and to manage multiple priorities and meet deadlines.

Benefits

  • Paid time off.
  • Work from home.
  • Health insurance including OPD coverage.
  • Training and development opportunities.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Data Engineer – Backend (Python / Typescript / Big Data / AWS / Kubernetes)

Varicent 251-1K Professional Services

Senior Software Engineer at Varicent working on the ELT data platform to design, scale, and advance backend services and data-processing systems that accelerate data workflows and enable high-throughput, cloud-native data pipelines.

Apache Spark AWS CI/CD Docker Kafka Kubernetes Microservices Node.js Python REST API Terraform TypeScript
7 hours, 39 minutes ago

Senior Software Engineer – Backend (Python / Typescript / Big Data / AWS / Kubernetes)

Varicent 251-1K Professional Services

Senior Software Engineer at Varicent contributing to the ELT application to simplify data workflows and enable faster insights by designing and scaling large-scale, data-intensive backend and cloud-native systems.

Apache Spark AWS CI/CD Docker DynamoDB EC2 Kafka Kubernetes Microservices Node.js Python REST API System Design Terraform TypeScript
7 hours, 39 minutes ago

Senior Data Engineer – Backend (Python / Typescript / Big Data / AWS / Kubernetes)

Varicent 251-1K Professional Services

Senior Software Engineer at Varicent responsible for advancing the ELT application and cloud-native data platform to enable faster insights and automation for customers working with large-scale, data-intensive workflows.

Apache Spark AWS CI/CD DynamoDB EC2 Kafka Kubernetes Microservices Node.js Python REST API System Design Terraform TypeScript
7 hours, 39 minutes ago

Senior Data Engineer – Backend (Python / Typescript / Big Data / AWS / Kubernetes)

Varicent 251-1K Professional Services

Varicent is seeking a Senior Software Engineer to advance its ELT data platform by designing and scaling backend services and data processing pipelines that simplify data workflows and accelerate insights for customers.

Apache Spark AWS CI/CD Kafka Kubernetes Microservices Node.js Python REST API Terraform TypeScript
7 hours, 39 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers