Senior Research Engineer 3141115 I.Html

Passionate about Generative AI inference, the full-time Senior Research Engineer will design and evaluate routing policies for LLM traffic, build benchmarks to measure algorithm quality, and collaborate with engineering teams to ensure seamless software integration, with opportunities for remote work.

##### Key responsibilities

Design and evaluate routing policies for LLM traffic to optimize model system usage

Build and run agentic benchmarks to assess algorithm quality and develop routing profiles

Collaborate with engineering teams to ensure integration across the NVIDIA accelerated serving stack

##### Required qualifications

Bachelor's or Master's degree in Computer Science or equivalent experience

8+ years of industry experience in Deep Learning frameworks (PyTorch or TensorFlow)

Experience designing or running LLM evaluations/benchmarks and drawing statistically sound conclusions

Understanding of modern techniques in Machine Learning, Deep Neural Networks, or Natural Language Processing

Strong computer science fundamentals, including algorithms, data structures, and parallel computing