I hope you don't mind me jumping in...
At my old school, we had a system for voting for school captains, where votes from the upper grades counted for more than the lower. So basically, you could have something like three 'grades'. The lowest being people who have only posted one or two reviews, new to the section and that sort of thing. Next, people who write decent fics and/or post a number of decent reviews, then finally the experienced writers/reviewers. Those in the two top categories would be able to nominate fics, (possibly needing an okay from the top level?). Then all three groups could vote, with different ratings assigned to each. As for deciding which category people belong in, and when they can move up, pick a few experienced users and let them choose.
Would that apply to what you're thinking about doing? If not, sorry for interrupting.
EDIT- Or you could make a fanfic Rotten Tomatoes XD
At my old school, we had a system for voting for school captains, where votes from the upper grades counted for more than the lower. So basically, you could have something like three 'grades'. The lowest being people who have only posted one or two reviews, new to the section and that sort of thing. Next, people who write decent fics and/or post a number of decent reviews, then finally the experienced writers/reviewers. Those in the two top categories would be able to nominate fics, (possibly needing an okay from the top level?). Then all three groups could vote, with different ratings assigned to each. As for deciding which category people belong in, and when they can move up, pick a few experienced users and let them choose.
Would that apply to what you're thinking about doing? If not, sorry for interrupting.
EDIT- Or you could make a fanfic Rotten Tomatoes XD