AI Inference Engineer QVAC

2 months, 3 weeks ago
Full-time
Senior
Software Development
ITRex

ITRex

ITRex is a global technology consulting and software development company that transforms businesses with cutting-edge solutions in AI, IoT, Data Science, Cloud, and RPA, serving medium-sized companies and Fortune 500 giants across diverse industries.

Internet Software & Services
251-1K
Founded 2009

Description

  • Work on deploying machine learning models to edge devices using llama.cpp and ggml.
  • Optimize the inference runtime so models load faster, run leaner, and perform well across different hardware.
  • Collaborate closely with researchers to help code, train, and transition models from research into production.
  • Integrate AI features into existing products to add the latest machine learning capabilities.
  • Ensure the inference layer is stable and ready for integration with the rest of the stack.

Requirements

  • Strong programming skills in C++.
  • Experience with JavaScript is a bonus.
  • Strong experience with llama.cpp and ggml inference engines.
  • Good understanding of deep learning concepts and model architectures.
  • Experience with transformers, LLMs, and diffusion models.
  • Demonstrated ability to rapidly learn new technologies and techniques.
  • A degree in Computer Science, AI, Machine Learning, or a related field.
  • A solid track record in AI R&D.

Benefits

  • Remote flexibility with the ability to work where and how you work best.
  • Competitive salary plus benefits including medical and learning support.
  • Ownership opportunities to take initiative and solve meaningful problems.
  • AI-enhanced workflows designed to complement your abilities.
  • English classes and professional development support.
  • Clear career progression opportunities.
  • Responsive, supportive teammates and a collaborative culture.
  • Regular meetups and tech talks that build human connections.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Staff AI Engineer - US

Typeform 251-1K Internet Software & Services

Typeform is hiring a Staff AI Engineer to shape and operate the AI systems powering Research Flow and other customer-facing products, from experimentation through scalable production delivery.

Apache Airflow Apache Spark AWS CI/CD Datadog Docker FastAPI Generative AI Kafka Kubernetes LLM Machine Learning Microservices MLflow OpenSearch Python PyTorch REST API SageMaker Snowflake SQL Terraform
5 minutes ago

Senior Machine Learning Data Scientist

OURA 251-1K Health Care Providers & Services

Oura is hiring a Senior Machine Learning Data Scientist for its Health Foundation Models team to develop longitudinal wearable-data models and turn research advances into validated, production health experiences for Oura members.

Machine Learning Python PyTorch Statistics
50 minutes ago

Staff AI Engineer - EU

Typeform 251-1K Internet Software & Services

Typeform is hiring a Staff AI Engineer to shape and operate the AI systems powering Research Flow, turning research concepts into secure, scalable, and dependable customer experiences.

Apache Airflow Apache Spark AWS CI/CD Datadog Docker FastAPI Generative AI Kafka Kubernetes LLM Machine Learning MLflow OpenSearch Python PyTorch SageMaker Snowflake SQL Terraform
50 minutes ago

Senior AI Software Engineer

Caseware 251-1K Internet Software & Services

Caseware is hiring a fully remote AI Platform Architect in Colombia to define, build, and operate scalable, secure, and trustworthy AI capabilities for its global accounting and audit software platform.

AWS AWS CDK Confluence DynamoDB GitHub GitHub Actions JIRA Microservices NestJS Python Terraform TypeScript
1 day, 1 hour ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers