About this role
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware, a position that took years to build. About the Role We're looking for a TPU performance engineer to make vLLM a first-class inference engine on Google TPUs. You'll build and optimize TPU backends, compiler integrations, runtime paths, and benchmarking infrastructure using JA…
What they're looking for
Required
- •Experience with TPU performance engineering
- •Ability to build and optimize TPU backends
- •Proficiency in compiler integrations
- •Skills in runtime path optimization
- •Experience with benchmarking infrastructure using JAX
Frequently asked questions
What does a Member of Technical Staff, TPU Performance Engineering at Inferact do?
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware, a position that took years to build. About the Role We're …
How much does a Member of Technical Staff, TPU Performance Engineering at Inferact pay?
The employer did not list a salary for this role. Most similar Singapore roles publish their band on the job page.
Is this Member of Technical Staff, TPU Performance Engineering role remote, hybrid, or on-site?
The listing is based in Singapore. Check the posting for remote or hybrid options.
How do I apply for this Member of Technical Staff, TPU Performance Engineering role?
You can apply directly on Inferact's careers page. ApplyLah can tailor your résumé and cover letter to this exact role in seconds first.