Data Engineer - Web Scraping (3 months contract)

22 hours, 20 minutes ago
Contract
Junior
Software Development

CXG

CXG provides customer sentiment analysis and consulting services to help businesses enhance customer experiences and drive growth.

Description

  • Maintain and manage Python-based website-scraping configurations.
  • Monitor scraping configurations for errors, crashes, issues, and blockages.
  • Oversee retrieved data to identify data-quality issues.
  • Coordinate with stakeholders on scraping requirements and issue reporting.
  • Prepare and share periodic reports on scraping activities.
  • Develop pipelines to ingest scraped data into the data lake.
  • Perform required data transformations.

Requirements

  • At least 2 years of experience in a similar data engineering role.
  • Experience designing and implementing scalable data architectures.
  • Strong experience with ETL processes, data modeling, and data warehousing.
  • Excellent Python skills for data engineering and automation.
  • Experience with relational SQL and NoSQL database technologies.
  • Knowledge of Azure cloud platforms.
  • Hands-on experience with Airflow and/or DBT.
  • Experience with Git version control systems.
  • Experience with Terraform for infrastructure management.
  • Fluency in English; French is preferred.

Benefits

  • Remote work arrangement.
  • 3-month contract opportunity.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Cloud Platform and Data Engineer [U.S. Citizenship Required, Public Trust Eligibility]

Via Logic 1-10 Internet Software & Services

Via Logic is hiring a remote Cloud Platform and Data Engineer to support DHS programs by operating secure AWS infrastructure and Salesforce-connected applications, integrations, and data workflows.

Agile Ansible AWS Bash Cybersecurity DevSecOps Docker Encryption Git Helm Java Jenkins Kubernetes Microservices Monday.com New Relic PostgreSQL Power BI Python Redis Salesforce Secrets Management SQL Tableau Terraform
9 hours, 50 minutes ago

Data Engineer

Inductive 51-200 Health Care Providers & Services

Join InductiveHealth as a Data Engineer to modernize and operate secure, scalable public health data pipelines that support disease surveillance and decision-making for public health agencies.

Agile AWS Azure CI/CD Docker Elasticsearch Encryption GitHub GitHub Actions Grafana Kafka Kubernetes OpenSearch Python Secrets Management SQL Terraform
1 day, 10 hours ago

Senior Engineer - Platform & Data Infrastructure

Ampd Energy 51-200 Electrical Equipment

Ampd Energy is seeking a hands-on senior software engineer to scale and stabilize Enernet, its cloud platform for monitoring and managing connected battery energy storage systems on construction sites.

AWS ClickHouse Go Grafana GraphQL InfluxDB Kafka NestJS Node.js REST API SQL Terraform TimescaleDB TypeScript Vue.js
1 day, 10 hours ago

#8 Data Engineer Senior - Databricks - Mexico

MUTT DATA 51-200 Internet Software & Services

Muttdata is seeking a remote Data Engineer to build and govern scalable data products for a multinational beverage company in Mexico City.

Apache Spark AWS Azure Databricks dbt Deep Learning GCP Generative AI Looker Machine Learning Python Tableau
1 day, 10 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers