Discussion about this post

User's avatar
Pawel Jozefiak's avatar

The 20+ tools threshold where single-agent becomes unreliable is something I hit empirically before I had a name for it. Around tool 15 the behavior started getting inconsistent - the agent would use the wrong tool for the job because everything was equally accessible. Splitting into specialized agents with narrower tool access fixed most of it.

The routing layer you describe here is the part I built last and should have built first. The orchestration overhead only becomes visible once you've already paid for the inconsistency. For routing logic: rule-based first, LLM routing only when rules can't cover the variance?

No posts

Ready for more?