Tag

routers

ai, local models, routers

Models Will Be Commodities

Terminal chat: a weather question routed to a local tool, then a fun fact answered by a local 35B model
Local-first: a weather lookup and a fun fact, answered on the machine.

Most of what people ask a model is about to run on hardware they already own. Here is what I think that changes.

Read full note →