Bluelight Consulting

Bluelight Consulting is a leading Nearshore Software Development company that provides access to highly skilled Nearshore Tech Talent in the US timezone. They offer services such as Nearshore Staffing, Cloud consulting, Cloud migration strategies, and ...

Internet Software & Services

Information Technology

11-50 (20)

Founded 2015

1221 open positions

Links

View All Jobs

Azure Data Engineer - Remote, Latin America

2 days, 17 hours ago

Latin America, Ecuador

Full-time

Mid Level

Data Engineer

Software Development

Agile Apache Spark Azure Git Power BI Python REST API SQL Tableau

Apply Now

Bluelight Consulting

Internet Software & Services

11-50

Founded 2015

View All Jobs 1221

Description

Develop and maintain ETL processes using Python (PySpark) in Azure Synapse Analytics notebooks and pipelines.
Design and build data storage structures using data warehousing concepts such as star schemas, facts, and dimensions.
Extract and integrate data from REST APIs, SQL database tables, and CSV files.
Design and optimize Azure Synapse Analytics notebooks and pipelines for scalability and performance.
Contribute to data lake, lakehouse, delta lake, and data cataloging initiatives.
Collaborate with data architects to create data models and schemas aligned with business needs.
Implement data quality checks and validation processes to ensure accurate and consistent data.
Identify and resolve performance bottlenecks and troubleshoot ETL jobs to meet SLAs.
Maintain documentation for ETL processes, data flows, and transformations.
Work with cross-functional teams on data requirements, data-related initiatives, security, and compliance.

Requirements

Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent work experience.
Certification related to data engineering or data science is a plus, such as Azure Data Engineer.
Proven experience in ETL data engineering using Python (PySpark).
Experience extracting, transforming, and loading data from REST APIs, SQL database tables, and CSV files.
Proficiency with Azure Synapse Analytics resources, including Notebooks, Pipelines, Linked Services, and Azure Key Vault.
Ability to write complex SQL queries and optimize query performance using SparkSQL and MS SQL.
Knowledge of data integration best practices and tools.
Experience with version control systems such as Git and Azure DevOps.
Strong problem-solving and analytical skills with close attention to detail.
Excellent verbal and written communication skills and the ability to work collaboratively in a team with shifting priorities.
Familiarity with big data technologies, machine learning, and data analysis is preferred.
Experience with data visualization tools such as Power BI or Tableau is a plus.
Experience with Agile methodologies is a plus.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Engineer

Philippine Outsourcing & BPO Call Center Services 51-250 Professional Services

A Data Engineer on the Professional Services team at a B2B sales intelligence platform will work directly on customer implementations for wholesale distributors to build data workflows, configure systems, and resolve data issues.

Colombia Full-time Mid Level Data Engineer

Apache Airflow Asana ERP GCP Git GitHub Actions HubSpot JSON Kubernetes Looker Python REST API Salesforce SFTP SQL

38 minutes ago

Apply

38 minutes ago

Software Engineer II, Big Data

tvScientific 11-50 Media

tvScientific is hiring a Data Engineer to build and evolve the company’s AWS-based data infrastructure and pipelines that support its CTV advertising platform and data-heavy operations.

United States Full-time Mid Level Data Engineer

$124k-$255k

Apache Spark AWS Machine Learning Scala SQL

1 hour, 1 minute ago

Apply

1 hour, 1 minute ago

Data Engineer

Fuze Health Health Care Providers & Services

Fuze Health is hiring a Data Engineer to build and maintain data infrastructure that delivers timely, accurate information for operational and business decision-making in a fast-moving digital health environment.