Smart Working

Smart Working

Smart Working is a company that specializes in software development outsourcing and staff augmentation. They offer nearshore software development services, outsourcing solutions, and staff augmentation with a focus on providing highly skilled Indian de...

Internet Software & Services

Description

  • Architect and build scalable data pipelines and infrastructure for AI and product systems.
  • Design and maintain data ingestion, transformation, and storage architectures for operational and AI workloads.
  • Develop and manage batch and real-time data pipelines.
  • Build and optimize systems for vector search, retrieval, and machine learning data workflows.
  • Ensure data reliability, security, and governance across the platform.
  • Collaborate with AI, backend, product, and leadership teams to support training, inference, and product features.
  • Implement monitoring, observability, and data quality frameworks.
  • Optimize performance for large-scale datasets and query systems.
  • Contribute to technical architecture decisions and long-term data strategy.
  • Define the data function, establish standards, and help build the team as the company scales.

Requirements

  • 7+ years of professional experience, with most of it in dedicated data engineering roles.
  • Strong experience designing and building data pipelines and distributed data systems.
  • Experience with relational databases, with PostgreSQL preferred but MySQL or similar acceptable.
  • Experience working with NoSQL databases.
  • Experience with vector databases used in modern AI systems.
  • Strong programming experience in Python.
  • Demonstrated ability to make and justify architectural decisions.
  • Experience building scalable backend systems.
  • Experience designing data models and storage architectures.
  • Strong understanding of data processing performance and optimization.
  • Experience with Apache Spark, Apache Airflow, Kafka, and Elasticsearch or OpenSearch is highly desirable.
  • Experience with PostgreSQL, MongoDB, and vector databases such as Qdrant, Milvus, or pgvector is highly desirable.
  • Experience with Python data-processing libraries such as Pandas or Polars is highly desirable.
  • Experience working on AI or machine learning platforms is preferred.
  • Familiarity with stream processing and event-driven architectures is preferred.
  • Experience with cloud infrastructure such as GCP, AWS, or Azure is preferred.
  • Experience working in high-growth startups or early-stage companies is preferred.

Benefits

  • Remote-first work environment.
  • Opportunity to join a genuine community focused on growth and well-being.
  • Full-time, long-term role with a global team.
  • Work with a company that values personal and professional growth.
  • Join one of the highest-rated workplaces on Glassdoor.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Manager, Data Platform Engineering

Cohere Health 251-1K Insurance

Cohere Health is seeking a Senior Manager, Data Platform Engineering to lead its data platform team, strengthen engineering practices, and deliver a scalable, reliable data foundation supporting healthcare products and business growth.

Apache Airflow Apache Spark AWS CI/CD Git System Design
7 hours, 17 minutes ago

Data Engineer

Sonatype 51-250 Internet Software & Services

Sonatype is hiring a Data Engineer to build and maintain cloud-based data infrastructure that supports software supply chain security and trusted analytics.

Apache Spark AWS Cassandra CI/CD Databricks dbt Java Kafka Pandas Python Scala SQL Terraform
8 hours, 47 minutes ago

Data Engineer

AHEAD 1K-5K IT Services

The Data Engineer, Data Platform will build and operate AHEAD’s cloud data capabilities, delivering trusted and governed data products for analytics, applications, automation, and AI workflows.

Agile Azure CI/CD dbt GraphQL NetSuite Python REST API Salesforce Snowflake SQL
8 hours, 47 minutes ago

Senior / Lead Data Engineer Cloud (Terraform, DBT, Azure)

Coforge 10K-50K IT Services

Coforge is seeking a Senior/Lead Cloud Data Engineer to build and govern production-grade data products on Azure Databricks, with a focus on DBT, Terraform, data quality, and AI-assisted engineering practices; the role is open to candidates across LATAM.

Apache Airflow Apache Spark Azure CI/CD dbt Git Python SQL Terraform
1 day, 8 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers