Senior Deep Learning Software Engineer, Inference
Join to apply for the Senior Deep Learning Software Engineer, Inference role at NVIDIA
NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will design, build, and optimize GPU‑accelerated software that powers today’s most sophisticated AI applications.
Our team develops and maintains high‑performance deep learning frameworks, including SGLang and vLLM, at the forefront of efficient large‑scale model serving and inference. You will improve these platforms, facilitate deployment and serving of groundbreaking language models, and implement the latest algorithms for public release in frameworks like SGLang, vLLM, and other DL frameworks.
What You’ll Be Doing

Performance optimization, analysis, and tuning of DL models in domains like LLM, multimodal, and generative AI.
Scale performance of DL models across different NVIDIA accelerators.
Contribute features and code to NVIDIA’s inference libraries, vLLM, SGLang, FlashInfer, and LLM software solutions.
Collaborate with cross‑framework teams across NVIDIA libraries and inference optimization solutions.

What We Need To See

Masters or PhD or equivalent experience in relevant field (Computer Engineering, Computer Science, EECS, AI).
5+ years of relevant software development experience.
Excellent C/C++ programming and software design skills. SW Agile skills are helpful and Python experience is a plus.
Prior experience with training, deploying or optimizing the inference of DL models in production is a plus.
Prior background with performance modeling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU is a plus.

Ways To Stand Out From The Crowd

Contribute to Deep Learning Software projects, such as PyTorch, vLLM, and SGLang to drive advancements in the field.
Experience with Multi‑GPU Communications (NCCL, NVSHMEM).
Experience building and shipping products to enterprise customers.
GPU programming experience (CUDA, OAI TRITON or CUTLASS).

NVIDIA is at the forefront of breakthroughs in Artificial Intelligence, High‑Performance Computing, and Visualization. As an equal opportunity employer, we are committed to fostering a supportive and empowering workplace for all.
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. For Poland: The base salary range is 213,750 PLN - 370,500 PLN for Level 3, and 281,250 PLN - 487,500 PLN for Level 4.
JR1997930
Seniority level

Mid‑Senior level

Employment type

Full‑time

Job function

Computer Hardware Manufacturing, Software Development, and Computers and Electronics Manufacturing

#J-18808-Ljbffr