Self-routing specialists in testing.
We moved away from a dedicated router model. Instead, each specialist now has domain awareness built into its system prompt and decides for itself whether a query belongs to it. This removes the router as a single point of failure and cuts one full model call from the latency chain. Testing on STEM and HASS domains. Results are promising. The cold-start time on consumer hardware is still the main problem we have not solved.