N-iX

N-iX is a global software development company that helps organizations achieve lasting business value through advanced technology solutions, serving various sectors with expertise in cloud, data analytics, and IoT.

Internet Software & Services

Information Technology

1K-5K (2000)

Founded 2002

31 open positions

Links

View All Jobs

Senior Data Engineer

4 hours, 57 minutes ago

Europe

Full-time

Senior

Data Engineer

Software Development

Apache Airflow AWS Azure CI/CD ClickHouse GCP GitHub Actions Go Java Python Scala Serverless Snowflake SQL

Apply Now

N-iX

Internet Software & Services

1K-5K

Founded 2002

View All Jobs 31

Description

Architect and optimize scalable, high-throughput ingestion pipelines on GCP.
Build serverless and containerized pipelines using BigQuery, Dataflow, Pub/Sub, Cloud Storage, and GKE.
Design CDC and incremental processing workflows for multi-platform delta synchronization.
Develop dbt transformation models and Airflow orchestration using Data Vault and dimensional modeling patterns.
Implement hash-based delta tracking for row-level asset and metadata changes.
Optimize Snowflake integration layers, including deduplication, canonical filtering, and policy controls.
Deploy and manage ClickHouse for low-latency metadata retrieval, aggregation, and indexing.
Build integration views and API query layers for real-time delta consumption.
Enforce metadata standardization, canonical asset mapping, and automated data validation.
Integrate metadata pipelines with feature extraction tools, search indexes, and licensing platforms.

Requirements

4+ years of production experience with GCP data technologies, including BigQuery, Dataflow, Cloud Pub/Sub, GKE, and Cloud Storage.
Deep proficiency with Snowflake warehousing, semi-structured queries, and integration layers.
Deep proficiency with ClickHouse, including real-time aggregation, columnar storage, and indexing.
Experience architecting CDC pipelines and incremental loading for multi-terabyte datasets.
Advanced Python and SQL skills.
Hands-on expertise with dbt Core or Cloud and Apache Airflow in enterprise CI/CD environments such as GitHub Actions.
Experience with Data Vault 2.0, hash-key generation, and raw, staging, and integration layer design (preferred).
Experience with AI/ML metadata, computer vision feature vectors, C2PA provenance, or semantic search (preferred).
Familiarity with media metadata schemas for images, 3D models, and video derivatives (preferred).
Experience with Go, Java, Scala, AWS, Azure, or Oracle Cloud is a plus.

Benefits

Flexible remote, office-based, or hybrid working arrangements.
Competitive salary and compensation package.
Personalized career growth opportunities.
Professional development through mentorship, tech talks, training, and centers of excellence.
Active technical communities and knowledge-sharing programs.
Education reimbursement.
Corporate events, team-building activities, and location-specific benefits.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Databricks Forward Deployed Engineer (AI/ML)

RevStar 51-250 Internet Software & Services

RevStar is seeking a remote, LATAM-based Senior Databricks Forward Deployed Engineer to lead enterprise data modernization and Generative AI delivery while advising clients and expanding Databricks adoption.

Mexico Argentina Brazil Chile Colombia Venezuela Contract Senior Data Engineer Machine Learning Engineer

Apache Spark AWS Azure Databricks Generative AI Hadoop Machine Learning MLflow Python Snowflake SQL Server Teradata

5 hours, 12 minutes ago

Apply

5 hours, 12 minutes ago

Staff Data Engineer

Venice.ai

Venice is seeking a Staff Database Engineer to own the architecture, integrity, and accessibility of its high-volume PostgreSQL data ecosystem, enabling reliable answers across engineering and business teams.

Anywhere Lead Data Engineer

LLM PostgreSQL SQL

1 day, 4 hours ago

Apply

1 day, 4 hours ago