Portfolio

2025

• Sep 8
  Released AlphaTrion, an open-source framework to help build GenAI applications, including experiment tracking, adaptive model routing, prompt optimization and performance evaluation.
  
  
• Jul 22
  Joined CNCF TAG Workloads as Tech Lead for a two-year term. CNCF is one of the world’s most successful open-source foundations.
  
  
• Mar 20
  Founded ModelSpec.ai with the mission of creating a model hub and benchmarking platform for AI models.

2024

• Feb 22
  Released LeaderWorkerSet, a multi-host LLM serving framework. Adopted by companies like AWS, Google, Nvidia, RedHat and projects like Kubeflow Trainer, llm-d, Nvidia Dynamo, vLLM, SGLang, volcano and more.

2023

• Nov 20
  Released llmaz, an unified LLM serving platform supporting various inference engines like vLLM, SGLang, TGI, llama.cpp and more.
  
  
• Aug 14
  Founded InftyAI, a community-driven, open-source initiative for developing scalable AI infrastructure.

2022

• Jun 17
  Joined Kubernetes SIG-Scheduling maintainers team. Kubernetes is one of the most popular and influential open-source projects in the world.
  
  
• Feb 16
  Released Kueue, the Kubernetes-native Job queueing system. Adopted by companies like Google, RedHat, IBM Research, CERN, Apple and more.