Senior Software Engineer(AI & LLM) - 12 Months Contract - Up To Sgd12K

We are seeking a Senior Software Engineer to own our ACS embedded-evaluation workstream. You will embed with AI product teams to build the infrastructure, automated pipelines, and observability tools that ensure our LLM agents perform accurately, cost-effectively, and reliably at scale. Key Responsibilities AI Evaluation Infrastructure: Own and scale EvalsHub (backend, SDK, CLI, frontend). Build golden datasets, regression pipelines, and CI/CD model-release integration. Advanced Automation: Convert human review procedures into LLM-as-judge, multi-turn, trajectory, and deterministic evaluators to eliminate manual testing. Observability & Tracing: Instrument distributed agent systems using OpenTelemetry across Go/Python services and Temporal workflows to ensure flawless debugging data. Optimization: Run experiments across model architectures, RAG, and embeddings to balance accuracy, latency, and cloud costs. Enablement: Author technical docs, lead tool migrations, and participate in the LLMOps production operational rotation. Requirements Education: Bachelor's degree in Computer Science or related field. Experience: Minimum 2+ years of relevant software engineering experience. AI & Workflow Ecosystem: Hands-on with LangSmith, LangGraph/LangChain, FastAPI, or Temporal. AI Domain Expertise: Proven track record in LLM-as-judge frameworks, agent-trajectory analysis, RAG, semantic retrieval, or Text-to-SQL. Data & Core Tech: Strong analytical skills handling geospatial data. Proficiency in React/TypeScript (for developer tools), Grafana, and Redis. Soft Skills: Metrics-driven problem solver with excellent cross-functional communication skills. Interested candidates may apply through the application system or send it to sg-rscontracting@morganmckinley.com. Shortlisted candidates will be notified. By sending us your personal data and curriculum vitae (CV), you are deemed to consent to Morgan Mckinley Pte Ltd and its affiliates to collect, use and disclose your personal data for the purposes set out in the Privacy Policy available at https://www.morganmckinley.com/sg/privacy-policy. You acknowledge that you have read, understood, and agree with the Privacy Policy. Morgan McKinley Pte Ltd Koh Boon Sien EA Licence No: 11C5502 EA Registration No. R1110345