Backend Engineer, Ark Large Model Platform (Singapore)

About Us Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.​ Why Join ByteDance Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.​ As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.​ Diversity & Inclusion​ ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.​ Job highlights Positive team atmosphere, Career growth opportunity, Flat organization Responsibilities About the Team The Applied Machine Learning (AML) - Ark team provides machine learning platform products on VolcanoEngine with cloud native resource scheduling system which intelligently orchestrates different tasks and jobs with minimised costs of every experiment and maximised resource utilisation, rich modelling tools including customised machine learning tasks and web IDE, and multi-framework high performance model inference services. In 2021, through VolcanoEngine, we released this machine learning infrastructure to the public, to provide more enterprises with reduced costs of computation power, lower barriers to machine learning engineering and deeper developments in AI capabilities. Responsibilities -Design and develop core pipeline components for the Ark MaaS platform (Model as a Service), supporting API capabilities such as text conversations, multimodal understanding, and multimodal generation. -Participate deeply in the evolution of cloud-native architectures, including Service Mesh, load balancing (LB), and intelligent routing. Design and implement highly available solutions such as full-link canary releases, traffic degradation, circuit breaking, and rate limiting. -Optimize system performance for large-model multimodal inference scenarios involving long connections, high throughput, streaming output, and low-latency requirements. -Ensure system stability under large-scale model invocation scenarios and resolve architectural bottlenecks caused by sudden traffic surges. Qualifications Minimum Qualifications - B. Sc or higher degree in Computer Science or related fields from accredited and reputable institutions with at least 3 years of relevant experience. - Familiar with developments and operations of distributed systems under Linux platform. - Proficient with at least 2 or more programming languages such as Golang / Python / C / C++ / Java / Scala / Javascript. ACM ICPC / Codeforces winners are preferred - Excellent in technical design and coding skills. Able to balance technical perspectives with product sense, hardware performance & stability and team cooperation. Preferred Qualifications -Understanding of Agent-related concepts and technologies such as Function Calling and MCP; hands-on experience building Agents is a plus. -Familiarity with cloud-native and Service Mesh technologies such as Kubernetes, Docker, Istio, and Envoy. -Strong understanding of multimodal data processing and storage, including image and video/audio data. -Interest in or practical experience with LLM inference pipelines and large-model engineering systems.