About this role
The role involves optimizing the vLLM inference engine to improve the speed and cost of running LLMs and diffusion models. You will work on model execution across diverse hardware and architectures, including mixture-of-experts and multimodal systems.
Candidates need a degree in computer science or equivalent experience with deep expertise in transformer architectures, PyTorch, and LLM inference systems. Proficiency in implementing research papers and contributing performant code to complex ML codebases is required.
What they're looking for
PythonPyTorchvLLMTensorRT-LLMSGLangTGITransformer ArchitecturesLLM Inference
Frequently asked questions
What does a Member of Technical Staff, Inference at Inferact do?
The role involves optimizing the vLLM inference engine to improve the speed and cost of running LLMs and diffusion models. You will work on model execution across diverse hardware and architectures, including mixture-of-experts and multimodal systems. Candidates need a degree in computer science or …
What skills does this Member of Technical Staff, Inference role need?
Key skills for this role include Python, PyTorch, vLLM, TensorRT-LLM, SGLang, TGI.
How much does a Member of Technical Staff, Inference at Inferact pay?
The employer did not list a salary for this role. Most similar Singapore roles publish their band on the job page.
Is this Member of Technical Staff, Inference role remote, hybrid, or on-site?
This role is on-site, based in Singapore.
How do I apply for this Member of Technical Staff, Inference role?
You can apply directly on Inferact's careers page. ApplyLah can tailor your résumé and cover letter to this exact role in seconds first.