Pinned
My thoughts on the future of model routing and AI:
- We have not even scratched the surface of runaway inference costs
- Solving this requires intelligent model routing, especially as the inference landscape continues fragmenting. This is a *hard* problem.
- Naive solutions
I made an angel investment in @tomas_hk two years ago, believing model routing would become a massive business.
Now companies are spending $500m per month on tokens. Increased quality and decreased cost are not mutually exclusive.
Here's Tomas' essay about how Model Routing













