Hi, I'm Bryan Soong Jun Shen, a final-year Mathematics and Computer Science student at NTU Singapore, graduating July 2027. I build LLM agents and the systems under them: agent harnesses, tool calling, retrieval, evaluation, and inference serving.
Lately, I've been spending a lot of time experimenting with different harnesses, and enjoy building tooling around agents as much as the agents themselves.
My Final Year Project (2026 to 2027) explores online request scheduling for LLM inference. I'm building a vLLM-style serving simulator with continuous batching, prefix caching, and preemption to study scheduling policies and starvation under memory pressure.
As a Software Engineer Intern at G Element (Jan to Jul 2026), I built and shipped a conversational AI agent for building-management systems running on local 9B/35B models via llama.cpp. I designed the agent loop, tool executor, guardrails, and an LLM-as-judge eval harness.
At the NTU Investment Interactive Club, I built a Golang limit order book exchange simulator with Hawkes-process traders, ~100 concurrent traders over WebSockets. I also built the IIC Cashflow Game, a Flutter financial-literacy game used by ~600 participants in the National Cashflow Competition.
I was the technical co-founder of SoPets (2024 to 2025), an NTU-incubated social gaming startup. Players breed, collect, and care for digital pets through real-world social interactions. I led 4 engineers. We were awarded S$40,000 in grants and prizes from the NTU CCDS SEP Programme and NTUitive MDT Fund, including 1st Place, Web3 Track, Port63 Innovation Challenge 2025. The little guy above is one of our SoPets pets.
I was also the sole developer of GoReach's memorial-services platform (Flutter, React, Firebase), live on the App Store and Play Store.
Stack: Python, TypeScript, Go, Dart · llama.cpp, LangGraph, FastAPI, MCP · PostgreSQL, Redis, gRPC, Docker