Is there a privacy vulnerability with prefetching?
I can imagine timing it and making inferences about whether it's been cached and therefore previously visited.
I don't see how you would be able to tell how long it takes to load- unless you control the site it's prefetching, in which case you should be able to tell if they've been there before anyway.