It sounds like a joke, but there actually have been attempts in this vein; @mathbrush ran a competition for the best IFComp reviewer a couple years ago (here’s the thread with results), as a way to encourage reviewers – and as a prize, I wrote a review of one of the winner’s reviews. That’s actually a bit I lifted from Mike Sousa, who reviewed all the 2002 Comp reviews (including mine, since that was the first IF Comp I judged!)
I think Brian wound up being a bit unsatisfied with how the competition went in terms of its main aim of generating more reviews, but I think there’d be scope to kick the idea around some more, perhaps with a different goal in mind (and maybe moving away from a competition structure since I think folks might be pretty Comped-out).
EDIT: While we’re on this topic, I feel like I should say that I think @kaemi’s reviews (and exegesis on Victor Gijsber’s IF archive are maybe the best contemporary example of the kind of criticism we’re talking about – so it does exist, though as Autumn says above, there’s a disappointingly low level of engagement.