Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

For this to work there needs to be a standard protocol for model routing so that you as the user can decide where requests go. You may wish to use mainly local models but at some times for some tasks you'll need to route requests to cloud models.

I've designed the role-model protocol for this, allowing routing between any model, however to function optimally it needs consumer applications to use the protocol when sending requests: https://role-model.dev/concepts/how-role-model-works



Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: