GitHub radar
Open Source Reimagines Sakana's LLM Router
An open reimplementation of Sakana AI's Fugu — the orchestrator that routes queries to the best model in your pool and measured 107% over any single model alone.
OpenFugu is an open source implementation of the proprietary Fugu system developed by Sakana AI. Fugu is an orchestrator which utilizes a small 0.6B routing model to route queries to the best suited worker amongst a set of LLMs. This setup achieves a score of 107% compared to using just the best worker model. We’ll go through how to understand the architecture, run the demos, train your own router and finally serve your router using an API.
Why a vibe-coder should care
With this setup you can use cheaper and faster models for easy tasks while reserving the big guns for more difficult ones. With OpenFugu it’s now possible to implement this architecture without having access to proprietary technology by training your own router on your data!
▌ More finds