Imho there are two dimensions here: Firstly different LLMs and secondly the strategy in which you break down the problem in an agentic fashion (e.g. break up to separate agents with own persona and then judge evaluates across all agents). You can of course mix-up the dimensions as well and that's what I have been tinkering* with for a good few months with some success. This was all done using home-brew setup running on openrouter.
Personally I prefer understanding the dimensions and the interplay and controlling it though can see why openrouter and others are now offering this a solved solution.
Just be careful when you start outsourcing too much of your intelligence needs to a blackbox.
This is interesting. Would you share a few ways in which you're using this in your workflow? What about if you were to start a new project and test and built it out from scratch - how do you work this approach in without bogging everything down(including the simple things) down with overanalysis?
I only use this for high value problems/challenges. A lot related to life decisions including work, where to live, finances etc. It gives me a small army that can break down and slice, dice the problem in different ways then someone to reconcile it all and present it back to me. The variance in their opinions is the most interesting part of this project so f ar.
Personally I prefer understanding the dimensions and the interplay and controlling it though can see why openrouter and others are now offering this a solved solution.
Just be careful when you start outsourcing too much of your intelligence needs to a blackbox.
* https://github.com/monkeydust/rightmind