About this role
Develop and maintain evaluation frameworks and pipelines to measure the capabilities of Large Language Models. Collaborate with cross-functional teams to perform data preparation, AI modelling, and testing to ensure reliable and scalable AI solutions.
Requires a degree in computer science, AI, data science, or a related field with a deep understanding of LLM evaluation methods. Candidates must be proficient in Python, PyTorch, and LLM inference frameworks, with strong communication skills and the ability to read research papers.
What they're looking for
Large Language ModelsLLM EvaluationPythonPyTorchvLLMGitData AnalysisAI Modelling
Frequently asked questions
What does a AI Engineer (Evaluation) at Nanyang Technological University Singapore do?
Develop and maintain evaluation frameworks and pipelines to measure the capabilities of Large Language Models. Collaborate with cross-functional teams to perform data preparation, AI modelling, and testing to ensure reliable and scalable AI solutions. Requires a degree in computer science, AI, data …
What skills does this AI Engineer (Evaluation) role need?
Key skills for this role include Large Language Models, LLM Evaluation, Python, PyTorch, vLLM, Git.
How much does a AI Engineer (Evaluation) at Nanyang Technological University Singapore pay?
The employer did not list a salary for this role. Most similar Singapore roles publish their band on the job page.
Is this AI Engineer (Evaluation) role remote, hybrid, or on-site?
This role is on-site, based in Singapore.
How do I apply for this AI Engineer (Evaluation) role?
You can apply directly on Nanyang Technological University Singapore's careers page. ApplyLah can tailor your résumé and cover letter to this exact role in seconds first.