For this to work there needs to be a standard protocol for model routing so that you as the user can decide where requests go. You may wish to use mainly local models but at some times for some tasks you'll need to route requests to cloud models.
I've designed the role-model protocol for this, allowing routing between any model, however to function optimally it needs consumer applications to use the protocol when sending requests: https://role-model.dev/concepts/how-role-model-works
I've designed the role-model protocol for this, allowing routing between any model, however to function optimally it needs consumer applications to use the protocol when sending requests: https://role-model.dev/concepts/how-role-model-works