About this role
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build. ABOUT THE ROLE We're looking for an inference runtime engineer to push the boundaries of what's possible in LLM and diffusion model serving. Models grow larger. Architectures shift: mixture-of-experts, multimodal, agentic. Every breakthrou…
What they're looking for
Nice to have
- •Experience with LLM inference serving systems
- •Experience with GPU programming (CUDA, Triton, OpenCL)
- •Experience with deep learning frameworks (PyTorch, TensorFlow)
- •Experience with performance optimization and profiling
- •Experience with distributed systems
- •Experience with C++ and Python
Frequently asked questions
What does a Member of Technical Staff, Inference at Inferact do?
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build. ABOUT THE ROLE We're l…
How much does a Member of Technical Staff, Inference at Inferact pay?
The employer did not list a salary for this role. Most similar Singapore roles publish their band on the job page.
Is this Member of Technical Staff, Inference role remote, hybrid, or on-site?
The listing is based in Singapore. Check the posting for remote or hybrid options.
How do I apply for this Member of Technical Staff, Inference role?
You can apply directly on Inferact's careers page. ApplyLah can tailor your résumé and cover letter to this exact role in seconds first.