Skip to content

AI Inference Engineer

INTEGRA, a.s. · Software

Summary

The AI Inference Engineer will develop and optimize production AI systems for large models, including LLMs. Responsibilities include optimizing inference pipelines, working with frameworks like PyTorch and TensorRT, and deploying AI systems in production environments.

Key facts

Status
Available
Location
Prague
Contract
Full-time
Level
Mid
Education
Master's
Languages (required)
  • EnglishBasic
Required skills
  • C++
  • Python
  • Linux
  • PyTorch
  • TensorRT
  • vLLM
  • CUDA
  • OpenCL
Estimated salary (not official)
~85k–105k Kč/moRough estimate for a full-time role — not provided by the employer How is this calculated?

Full description

We are looking for an AI Inference Engineer to join our technologically international engineering environment, who wants to participate in the development and optimization of production AI systems for operating large models including LLM. You will work on performance-critical AI solutions, optimizing the inference pipeline, and collaborating with top specialists in software, hardware, and artificial intelligence.

You will tackle real technical challenges from model deployment to scaling and performance optimization.

2 Where and on what you will be working

  • design and optimize inference pipelines for large AI models and LLMs
  • work with frameworks such as PyTorch, TensorRT, and vLLM
  • implement and optimize ML models using techniques like INT8/FP8 quantization, kernel fusion, and efficient batching
  • optimize key ML operators, such as GEMM operations, convolutions, and activation functions
  • troubleshoot performance issues using system tuning and performance analysis
  • test, deploy, and scale AI systems in production environments
  • work with modern hardware including GPUs and AI accelerators
  • collaborate on the design of high-performance software solutions
  • contribute to improving the performance, stability, and efficiency of AI platforms
  • collaborate with AI, software, and platform engineering teams in an international environment

3 Requirements

  • Master’s degree in computer science, engineering, mathematics, or a related field
  • Very good knowledge of programming in C/C++ or Python
  • Experience with development in a Linux environment
  • Good knowledge of computer architecture, data structures, and system software
  • Practical experience with implementing algorithms in C, C++ or Python
  • Experience with accelerated hardware, such as GPUs, FPGAs, DSPs, or AI accelerators
  • Knowledge of CUDA, OpenCL, or similar frameworks
  • Experience in designing or developing high-performance systems
  • Good orientation in the field of machine learning and AI
  • Ability to analyze and solve complex technical problems
  • Independence, responsibility, and team spirit
  • English at a communicative level
  • Experience with LLM, inference optimization, TensorRT, vLLM, or performance optimization of models on GPUs is an advantage.

4 Why collaborate with Integra

  • We are a reliable and stable company with an international reach
  • In case of project termination, we immediately offer another one
  • We have projects from more than 200 different companies
  • We guarantee timely invoice payments and minimal administration
  • We organize great corporate events for our entire IT community
  • We provide free accounting and tax consulting
  • We pride ourselves on a personal approach and fairness, you can rely on us.
Apply on the company site