About this role
Design and implement foundational distributed systems layers to enable vLLM to serve models across thousands of accelerators. Focus on minimizing latency and maximizing reliability to make large-scale model deployment straightforward.
Requires a bachelor's degree and strong systems programming skills in Rust, Go, or C++ with experience in high-performance distributed systems. Preferred candidates have expertise in GPU programming, interconnects, and ML serving infrastructure.
What they're looking for
RustGoC++Distributed SystemsNetwork ProtocolsHigh-performance I/OML Serving InfrastructureDisaggregated Inference Architecture
Frequently asked questions
What does a Member of Technical Staff, Performance and Scale at Inferact do?
Design and implement foundational distributed systems layers to enable vLLM to serve models across thousands of accelerators. Focus on minimizing latency and maximizing reliability to make large-scale model deployment straightforward. Requires a bachelor's degree and strong systems programming skill…
What skills does this Member of Technical Staff, Performance and Scale role need?
Key skills for this role include Rust, Go, C++, Distributed Systems, Network Protocols, High-performance I/O.
How much does a Member of Technical Staff, Performance and Scale at Inferact pay?
The employer did not list a salary for this role. Most similar Singapore roles publish their band on the job page.
Is this Member of Technical Staff, Performance and Scale role remote, hybrid, or on-site?
This role is on-site, based in Singapore.
How do I apply for this Member of Technical Staff, Performance and Scale role?
You can apply directly on Inferact's careers page. ApplyLah can tailor your résumé and cover letter to this exact role in seconds first.