We had filters already, but removed them about 2y ago...
The hordes would have been an issue, just coming in and downvoting claims that they disagree with.
When we switch from the all votes average, we might introduce them again. For individual perspectives, it would already make sense, you would then only see claims that a particular user voted of at least impact 2 or so.
I would not rely on the "impact votes" today, plus, the average is not really interesting. What is more interesting is how people that agree or disagree with the main thesis voted. (hint: what we'll be building)
Currently my attention is drawn to good and bad claims equally. Only after reading do I check the score and realize the claim is incorrect.
It wastes my time reading bad claims and the thought will stay with me regardless of quality.